A brain–computer interface translates speech and gestures together
Researchers demonstrated a system allowing participants with severe paralysis to control a virtual avatar through neural signals.
Researchers worked with three participants who had severe vocal-tract paralysis. Implanted electrodes recorded activity associated with attempted speech and movement.
The interface could decode speech and upper-body gestures within the same system, letting a virtual avatar express more than words alone.
Communication involves gesture, facial expression and other nonverbal signals. A multimodal interface could eventually support richer interaction for people with paralysis.
This was a small proof-of-concept study using implanted hardware. Wider clinical availability and generalization require additional research.
Source and verification
This article is an original editorial synthesis of the research or institutional report cited below; it is not a reproduction of the source.
NIH Research Matters · Original publication ↗