Skip to content

ICAD2011 Jose González

Jose González

Chiba University, Japan.

Auditory Display as an Aid for Prosthetic Hand Manipulation
Upper limb amputees have to rely extensively on visual feedback in order to monitor and manipulate successfully their prosthetic device. This situation leads to high consciousness burden, which generates fatigue and frustration. This lack of sensory feedback is a major drawback that many researchers are trying to cope by using indirect methods, such as electrocutaneous or vibrotactile stimulation, to convey artificial tactile information from the artificial limb to the amputee. Although the results obtained are very positive, they focus mainly on somatosensory information in order to improve object grasping. Therefore, during the reaching stage of the motion, the amputees still have to rely heavily on their vision due to the lack of spatio-temporal information feedback. Furthermore, one of the main drawbacks of these methods is the limited amount of information that can be transmitted and its high learning curve.

To improve the manipulation of a prosthetic device, kinematic information should be conveyed as proprioceptive feedback during reaching and grip pressure as somatosensory feedback. This will allow better human-machine interaction during the whole reaching and grasping process. Therefore, we proposed that, in order to enhance motor-sensory performance and awareness in prosthetic applications, auditory perception can be used as a redundant source of both kinematic and somatosensory information because of it’s high dimensionality, thus, exploring the difficulties people face when using a prosthetic hand and how the usage of auditory information affects their performance.

Interests to discuss

3D audio rendering, sonification models, sound generation methods, sound fatigue factor.


Herberts, P, Körner, L (1979). Ideas on sensory feedback in hand prostheses. Prosthet Orthot Int, Vol.3, No.3,pp.157-62.
Stepp, C. & Matsuoka, Y. (2010), Relative to direct haptic feedback, remote vibrotactile feedback improves but slows object manipulation. EMBC 2010, IEEE, pp.2089 -2092.
Hernández, et al. (2005) FES as Biofeedback for an EMG Controlled Prosthetic Hand. TENCON 2005, IEEE, pp.1-6.
Vogt, K. et al.(2010), PhysioSonic - Evaluated Movement Sonification as Auditory Feedback in Physiotherapy. In Sølvi Ystad et al. ed., 'Auditory Display', Springer Berlin / Heidelberg, pp. 103-120.
Kousidou, N.G. et al.(2007). Task-orientated biofeedback system for the rehabilitation of the upper Limb. IEEE Conference on Rehab. Robotics, pp. 376 - H.Huang, et al. (2006) Recent developments in biofeedback for neuromotor rehabilitation, Journal of NeuroEng. and Rehab. Vol. 3, No. 11.



Back to ICAD2011 Think Tank

Back to Benjamin Davison

Next to Philart (Myounghoon) Jeon

Back to top