IIAE CONFERENCE SYSTEM, The 1st IEEE/IIAE International Conference on Intelligent Systems and Image Processing 2013 (ICISIP2013)

Font Size: 
Hardware Platform of Camera-control Part on a Supporting System for Visually Impaired People Operating Touchscreen
Tatsuya Hamachi, Takayoshi Abe, Akira Yamawaki

Last modified: 2013-10-01


In recent years, the touchscreen is adopted as various electronic devices. However, on a flat touchscreen, for a vision disabled person, tactile feeling with the finger which is important information may not be obtained. Therefore operativity may be spoiled. We have proposed a wearable supporting system to operate a capacitive touchscreen for them. In a proposal system, an image sensor is equipped under the middle finger and an ear is equipped with the earphone for audio assists. And if a touchscreen is traced by the middle finger, the color barcode which the image sensor caught will be recognized, and the audio assist according to a result will be made. A user pushes an icon not by the middle finger but by an index finger, following an audio assist. In this paper, the hardware platform of the camera -control part in a proposal supporting system is developed. This platform consists of an interface with a camera or a host and an image processing part. The implementation result to FPGA showed that the interface was small and most resources could be used for an image processing part. The image from a camera was able to be displayed on the display through a fundamental verification of operation.


touchscreen;visually impaired;assist;color barcode;camera


[1] T. Yoshida, K. M. Kitani, H. Koike, S. Belongie, and K. Schlei : “EdgeSonic: Image Feature Sonification for the Visually Impaired,” Proc. of the 2nd Augmented Human International Conference pp.11:1-11:4,2011.

[2] J.Su, A. Rosenzweig, A. Goel, E. de Lara, and K. N. Truong : “Timbremap: Enabling the Visually-Impaired to Use Maps on Touch-Enabled Devices,” Proc. of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services, pp.17-26, 2010.

[3] G. Yfantidis and G. Evreinov, “Adaptive blind interaction technique for touchscreens,” Universal Access in the Information Society, vol.4, no.4, pp.328-337, 2006.

[4] S. K. Kane, J.P. Bigham, and J.O. Wobbrock, “Slide rule: Making Mobile touch screens accessible to blind people using multi-touch interaction technique,” Proc. of the ACMSIGACCESS Conference on Computers and Accessibility, pp.73-78, 2008.

[5] T. Handa, T. Sakai, M. Misono, T. Morita, and T. Ito, “Braille presentation method for tactile display,” in IEICE Technical Report, WIT200794, 2008, pp.23-26 in japanese.

[6] O. Bau, I. Poupyrev, A. Israr, and C. Harrison, “Teslatouch: Electrovibration for touch surfaces,” Proc. of the 23rd ACMSymp. on User Interface Software and Technology, pp.283-292, 2010.

[7] S. Kuno, A. Yamashita, and T. Kaneko, “Assisting System in Touch-Panel Operation Using Stereo Camera,” The transactions of the Institute of Electrical Engineers of Japan. D, A publication of Industry Applications Society Vol.131 no. 4, pp.458-465, 2011 in japanese.

[8] A. Yamawaki and S. Serikawa:“A Wearable Supporting System for Visually Impaired People in Operating Capacitive Touchscreen,” Applied Mechanics and Materials, Vol.103 pp.687-694, 2011.

[9] A. Yamawaki and S. Serikawa: “A Detection Method of Color Barcode on a Supporting System for Visually Impaired People in Operating a Touchscreen”, HCG SYMPOSIUM 2012 pp.159-166, 2012 in japanese.

[10] A. Yamawaki and S. Serikawa : “Development of Image Processing Hardware on a System Supporting Visually Impaired People Using Touchscreen with Finger Camera”, The Japanese Journal of the Institute of Industrial Applications Engineers, Vol.1, No.1, pp.10-19, 2013 in japanese.

Full Text: PDF