|Welcome to The Neuromorphic Engineer|
Biological Models » Somatosensory
Sensory feedback for body awareness in prosthetic applications
PDF version | Permalink
Every time we perform an action, our brain receives a large amount of sensory information about both the environment and our own bodies. All this information is used to continuously update our model of the world and act accordingly. Sensory-motor coordination—literally the coordination of our sensory and motor systems—allows us to create a mental representation of our own bodies. When this coordination is disrupted, as is the case with amputees, our ability to interact with the environment is reduced. The lack of sensory feedback from that limb means our representation of our bodies is no longer complete, and this can producing a ‘phantom limb’ effect. This is generally experienced as a false sensation in the missing limb, which can include severe pain.1
Though motor control can, to an extent be restored through myoelectric-controlled prosthetic devices,3 providing rich feedback to the user is still an open challenge. The major problem for amputees using such devices is a lack of awareness of the artificial limb: it has not been ‘incorporated’ into their body representation or body schema.4 A side-effect of this is that users experience an increased cognitive load while using the prosthesis, which in turn results in them abandoning it.5 The principal goal of our research is to find ways to include rich sensory feedback in prosthetic devices that would aid their incorporation of the user's body representation or schema. This should reduce the cognitive load and increase the device's functional repertoire.
There have been several attempts to provide tactile feedback in prosthetic applications.6 Our studies build upon two approaches for conveying information to the prosthetic users: using electrical stimulation of the skin, and audio feedback modulation. In terms of the former, we developed a high frequency electrical stimulator2 to convey somatosensory feedback. Depending on the waveform and intensity provided to the stimulator, we can generate a wide range of sensations. Skin stimulation faces the challenge of habituation, where the perception of the stimuli received is reduced over time. However, by using high frequency electrical stimulation, we can reduce these habituation effects, and transmit information for more extended periods of time2 as can be seen in Figure 1.
We also explored the use of audio feedback to convey proprioceptive information. The results of the study presented similar responses between both audio and visual feedback in the performance between groups.7
To evaluate the effects of the interaction between sensory and motor modalities we performed some experiments using an electromyography- (EMG-) controlled prosthetic hand with an amputee patient. Using an fMRI scanner, we recorded the activation of the motor and somatosensory cortices during her interaction with the robot hand. The participant controlled it using the EMG signals from her right arm (stump), whilst the electrical stimulation was administered in the contralateral upper arm.8,9
Our studies presented an interesting reaction of the brain when the stimulation occurs as an isolated event. In such case, the parietal lobe perceives the stimulus presented to the body as an uncorrelated event, without a strong mapping to the somatosensory area as can be seen in Figure 2. However, when electrical stimulation was used to provide haptic feedback while grasping an object with the robot hand—even though the stimulus was provided to the arm opposite to the one used to control the robot hand—we detected activation in the somatosensory area of the left hemisphere. This can be seen in Figure 3.
The results presented here provide insights to the mechanisms responsible for generating body image representations. The production of this tactile illusion points to a correlative behavior of the brain in processing active motor commands and their corresponding feedback. This behavior can be used to shape the interaction between an amputee and a prosthetic device, promoting the ‘incorporation’ of the latter in the mental body representation of the amputee. In our future work, we will explore the benefits from using a multisensory feedback to promote this incorporation, which we believe will reduce the currently constant requirement of conscious mental activity in controlling a prosthetic device.
Tell us what to cover!
If you'd like to write an article or know of someone else who is doing relevant and interesting stuff, let us know. E-mail the editor and suggest the subject for the article and, if you're suggesting someone else's work, tell us their name, affiliation, and e-mail.