NeuroXess’ new BCI, implanted into a epileptic patient’s brain, can not only decipher complex Chinese language but also operate a robotic arm and interact with AI
Chinese startup NeuroXess has achieved two significant milestones in brain-computer interface (BCI) technology, benefiting a brain-damaged patient. These breakthroughs include decoding thoughts into speech in real-time and enabling thought-driven control of a robotic arm.
In an August 2024 experiment at Huashan Hospital, a 256-channel, high-throughput flexible BCI device was implanted into a 21-year-old woman with epilepsy and a motor area brain lesion. This interface allowed NeuroXess to analyse electrocorticogram (ECoG) signals from the high-gamma band (70-150 Hz), which are linked to complex cognition and motor functions.
Speech Decoding from Brain Signals
A key achievement was the BCI’s ability to decode speech signals directly from the brain. Unlike alphabetic languages, the tonal and logographic nature of Chinese requires extensive neural processing. NeuroXess developed specialised decoding methods, achieving 71% speech decoding accuracy for 142 Chinese syllables, with a latency under 100 milliseconds. This represents the highest real-time decoding accuracy for Chinese speech to date.
Enhancing Mobility and Interaction
The patient gained significant functionality, including control over smart home systems and a wheelchair. She also controlled robotic hands to perform complex tasks, such as grasping objects and using sign language. In addition, the BCI enabled her to interact with AI, train a neural network in real-time, and achieve system delays as low as 60 milliseconds. Within 48 hours, she could play table tennis and other computer games; within two weeks, she operated smartphone apps like WeChat using NeuroXess’ brain-computer operating system, XessOS.
These advancements highlight the potential for BCIs to revolutionise patient independence and mobility. NeuroXess’ integration of real-time decoding, AI interaction, and functional mapping offers a transformative tool for specialists aiming to enhance rehabilitation and quality of life for patients with neurological impairments.
