Mouse Design Using Image Processing for Disabled

This paper presents a method to control pointer with the help of camera for a person who is not able to control the pointer with hands. Physical problems result from brain paralysis are the most dominant obstacles for pointer control. This paper aims to control pointer with the help of human-computer interaction technologies instead of hands. The proposed design is similar to common pointer control. According to disability condition, people can choose the usage of the system because of the adjustability of the system. One can control the pointer by wearing a colored wristband or any item on body parts like arms, feet or any other moving part of the body. The designed system requires software, a camera, and a table lamp. The working principle of the system is inferring information from camera and transforming this information to pixels to control the pointer on the screen. In this paper, computer vision system was combined with Java class to control the pointer. When the camera gets the first snapshot from a real-time video, first, the software finds the location of the colored item on the screen then moves the pointer towards to location. In this real-time system, clicking is a problem because of the physical inabilities. In order to solve this problem, we use another colored item on the field vision of the camera. According to the location of the second object, the software decides about left or right clicks.

Keywords:

Pointer Control, Image Processing, Computer-Human Interaction,

PDF

___

Abhik Banerjee1 , Abhirup Ghosh2 , Koustuvmoni Bharadwaj3 , Hemanta Saikia4.(2014). Mouse Control using a Web Camera based on Colour Detection. International Journal of Computer Trends and Technology (IJCTT) – volume 9 number 1– Mar 2014
Celik. Y, Altun. M, Gunes. M, Color Based Moving Object Tracking with An Active Camera Using Motion Information International Conference on Artificial Intelligence and Data Processing (IDAP17), September 16-17, Malatya, Turkey.
H. Dee and S. Velastin. (2008). How close are we to solving the problem of automated visual surveillance? Machine Vision and Applications, 19(5-6):329-343.
Manpreet. (2014). Color Based Object Detection Matlabgui, International Journal of Scientific & Engineering Research, Volume 5, Issue 6, June-2014 823 ISSN 2229-5518.
Mahmoud A. Mohamed, Christoph B¨oddeker, and B¨arbel Mertsching. Real-Time Moving Objects Tracking for Mobile-Robots Using Motion Information. Safety, Security, and Rescue Robotics (SSRR), 2014 IEEE International Symposium.
R. Lulu, Vanshri Kurhade, Neha Pande, Rohini Gaidhane , Nikita Khangar, Priya Chawhan, Ashwini Khaparde.(2015). Web Camera Based Mouse Controlling Using RGB Colours. International Journal of Advanced Research in Computer Engineering & Technology (IJARCET) Volume 4 Issue 2, February 2015.
Theo Gevers, Arnold W.M. Smeulders. (1997). Color-based object recognition. ISIS, Faculty of WINS, University of Amsterdam, Kruislaan 403, 1098 SJ, Amsterdam, The Netherlands.
Tran Thi Trang, Cheolkeun Ha. Irregular Moving Object Detecting and Tracking Based on Color and Shape in Real-time System. 2013 IEEE.
Vishesh Goel, Sahil Singhal, Tarun Jain, Silica Kole. (2017). Specific Color Detection in Images using RGB Modelling in MATLAB, International Journal of Computer Applications (0975 – 8887). Volume 161 – No 8.
https://www.mathworks.com/matlabcentral/fileexchange/42943-virtual-mouse--mouse-pointer-control-using-color-detection
https://www.mathworks.com/help/images/ref/im2bw.html
http://kulis.kocaeli.edu.tr/pub/otomasyon_kamera_takip.pdf