Mohammad ABDEL-MAJEED, Tasneem ALMOUS, Maysaa ALSALMAN, Abeer YOSF

Sketic: a machine learning-based digital circuit recognition platform

In digital system design, digital logic circuit diagrams are built using interconnects and symbolic represen- tations of the basic logic gates. Constructing such diagrams using free sketches is the first step in the design process. After that the circuit schematic or code has to be generated before being able to simulate the design. While most of the mentioned steps are automated using design automation tools, drafting the schematic circuit and then converting it into a valid format that can be simulated are still done manually due to the lack of robust tools that can recognize the free sketches and incorporate them into end user simulators. Hence, the goal of this paper is to construct and deploy computer simulation tools capable of understanding free sketches and incorporate them into useful simulation tools. Such a tool will be useful at both the educational and the industrial levels. Moreover, while this tool is designed to deal with sketched logic circuits, it can be generalized and applied to many other fields to convert the sketched design into a digital format. To implement this tool, we relied on the emerging machine learning and image processing concepts to make sure that the designed system is robust and accurate. Our results show that our system is able to recognize all the gates in the digital circuit with more than 95% accuracy.

PDF

___

[1] Intel Corporation. Simulation quick-start for ModelSim* - Intel FPGA edition. White paper, 2017. [2] Palnitkar S. Verilog HDL: a guide to digital design and synthesis. Englewood Cliffs, NJ, USA: Prentice-Hall, 1996.
[3] Liwicki M, Knipping L. Recognizing and simulating sketched logic circuits. In: Proceedings of the Ninth Inter- national Conference on Knowledge-based Intelligent Information and Engineering Systems; Melbourne, Australia; 2005. pp. 588-594.
[4] Burch C. Logisim: a graphical system for logic circuit design and simulation. Journal on Educational Resources in Computing 2002; 2 (1): 5-16. doi: 10.1145/545197.545199
[5] Alvarado C, Davis R. Sketch READ: a multi-domain sketch recognition engine. In: Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology; Santa Fe, NM, USA; 2004. pp. 23-32.
[6] Alvarado C, Kearney A, Keizur A, Loncaric C, Parker M et al. LogiSketch: a free-sketch digital circuit design and simulation system. In: Proceedings of the Workshop on the Impact of Pen and Touch Technologies in Education; Los Angeles, CA, USA; 2013. pp. 83-90.
[7] Zamora S, Eyjólfsdóttir E. CircuitBoard: sketch-based circuit design and analysis. In: Proceedings of International Conference on Intelligent User Interfaces (IUI) Workshop on Sketch Recognition; Sanibel Island, FL, USA; 2009.
[8] Alzubi J, Nayyar A, Kumar A. Machine learning from theory to algorithms: an overview. Journal of Physics: Conference Series 2018; 1142: 012012. doi: 10.1088/1742-6596/1142/1/012012
[9] Saifan R, Dweik W, Abdel-Majeed M. A machine learning based deaf assistance digital system. Computer Appli- cation in Engineering Education 2018; 26 (4): 1008-1019. doi: 10.1002/cae.21952
[10] Kia M, Alzubi J, Gheisari M, Zhang X, Rahimi M et al. A novel method for recognition of Persian alphabet by using fuzzy neural network. IEEE Access 2018; 6: 1-20. doi: 10.1109/ACCESS.2018.2881050
[11] Boutaba R, Salahuddin MA, Limam N, Ayoubi S, Shariar N et al. A comprehensive survey on machine learning for networking: evolution, applications and research opportunities. Journal of Internet Services and Applications 2018; 9 (16): 1-100. doi: 10.1186/s13174-018-0087-2
[12] Ma S, Sun Y, Lyu P, Polsley S, Hammond T. DCSR: a digital circuit sketch recognition system for education. In: Hammond T, Adler A, Prasad M (editors). Frontiers in Pen and Touch. New York, NY, USA: Springer, 2017. pp. 137-146
13] Patare M, Joshi M. Hand-drawn digital logic circuit component recognition using SVM. International Journal of Computer Applications 2016; 143 (3): 24-28. doi: 10.5120/ijca2016910058
[14] Datta R, De P, Mandal S, Chanda B. Detection and identification of logic gates from document images using math- ematical morphology. In: Fifth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics; Patna, India; 2015. pp 1-4.
[15] Moetesum M, Younus S, Warsi M, Siddiqi I. Segmentation and recognition of electronic components in hand-drawn circuit diagrams. EAI Endorsed Transactions on Scalable Information Systems 2018; 5 (16): 1-6. doi: 10.4108/eai.13- 4-2018.154478
[16] Lakshman R, Dinesh R, Prabhanjan S. Handwritten electric circuit diagram recognition: an approach based on finite state machine. International Journal of Machine Learning and Computing 2019; 9 (3): 374-380. doi: 10.18178/ijmlc.2019.9.3.813
[17] Dewangan A, Dhole A. KNN based hand drawn electrical circuit recognition. International Journal for Research in Applied Science and Engineering Technology 2018; 6 (6): 1111-1115. doi: 10.22214/ijraset.2018.6164
[18] Grother P, NIST Special Database 19. NIST Handprinted Forms and Characters Database; Gaithersburg, MD, USA; 1995.
[19] MATLAB and Statistics Toolbox Release 2012b, The MathWorks, Inc.; Natick, MA, USA; 2012. [20] Peng C, Lee K, Ingersoll G. An introduction to logistic regression analysis and reporting. The Journal of Educational Research 2002; 96 (1): 3-14. doi: 10.1080/00220670209598786
[21] Yao X. Evolving artificial neural networks. Proceedings of the IEEE 1999; 87 (9): 1423-1447. doi: 10.1109/5.784219 [22] Qian H, Xu J, Zhou J. Object detection using deep convolutional neural networks. Chinese Automation Congress (CAC); Xi’an, China; 2018. pp. 1151-1156.
[23] Redmon J, Divvala S, Girshick R, Farhadi A. You only look once: unified, real-time object detection. In: The IEEE Conference on Computer Vision and Pattern Recognition; Long Beach, CA, USA; 2016. pp. 779-788.
[24] Liu W, Anguelov D, Erhan D, Szegedy C, Reed S et al. SSD: single shot multibox detector. In: European Conference on Computer Vision; Amsterdam, Netherlands; 2016. pp. 21-37.
[25] Ren S, He K, Girshick R, Sun J. Faster R-CNN: towards real-time object detection with region pro- posal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 2017; 39: 1137-1149. doi: 10.1109/TPAMI.2016.2577031
[26] Burges C. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 1998; 2 (2): 121-167. doi: 10.1023/A:1009715923555
[27] Gehrke J, Ramakrishnan R, Ganti V. Rainforest - a framework for fast decision tree construction of large datasets. In: Proceedings of 24th International Conference on Very Large Data Bases; New York, NY, USA; 1998. pp. 416-427.