System for Art Knowledge Improvement by Interactions with Pictures

Haruya Tamaki, Tsugunosuke Sakai, Yosuke Ota, Fusako Kusunoki, Shigenori Inagaki, Ryohei Egusa, Masanori Sugimoto, Hiroshi Mizoguchi


We are developing an art-appreciation system that can teach viewers about pictures through active appreciation. This system can convey information about pictures by enabling a viewer to “talk” to an artist or people portrayed in the pictures using a voice recognition system. Furthermore, the system responds to the movement and location of the user, and it generates a sensation such that the user feels he/she is interacting with the pictures and thus actively appreciating them. Here, we quantitatively evaluate this system two ways. We measure electrodermal activity to determine whether the user is interested in a picture when interacting with it using the voice recognition system. We also conducted a questionnaire-based user evaluation with schoolchildren. In this paper, we summarize the current system and the describe two evaluation results, which show that the system has good potential for use in general museums.

Full Text:



Elliot W. Eisner: The Arts and the Creations of Mind, New Haven & London, Yale UP, (2002)

Carl A. Benware and Edward L. Deci: Quality of learning with an active versus passive motivational set, American Educational Research Journal, 21, 4, 755–765 (1984)

E. Vahter: Designing the Learning Process in Visual Art Classes in Primary School, Procedia - Social and BehavioralSciences, 45, 147–157 (2012)

F. Wachowiak, and R. D. Clements: Emphasis Art: A Quali- tative Art Program for Elementary and Middle Schools, Addison Wesley Longman, Inc, (2001)

S. Freeman, S. L. Eddy, M. McDonough, M. K. Smith, N. Okoroafor, H. Jordt, and M. P. Wenderoth: Active learning increases student performance in science, engineering, and mathematics, Proceedings of the National Academy of Sciences, 111, 23, 8410–8415 (2014)

Ryuuichi Yosida, Tomohiro Nakayama, Takeki Ogitsu, and Hiroshi Mizoguchi: Feasibility study on estimating method of visual attention using electrodermal activity, Proceedings of the 8th International Conference on Sensing Technology, 589-592 (2014)

Petar Palasek, Heng Yang, Zongyi Xu, Navid Hajimirza, Ebroul Izquierdo, and Ioannis Patras: A flexible calibration method of multiple Kinects for 3D human reconstruction, In Multimedia & Expo Workshops (ICMEW), 2015 IEEE International Conference on, 1-4 (2015)



  • There are currently no refbacks.

Online edition: ISSN 2187-8811 Print edition: ISSN 2188-1758