Our brain-to-voice synthesis brain-computer interface paper was published in nature today!
@Maitreyee_W1 B takipçi
58.775 görüntüleme
33 Yorum
Yorumlar X (Twitter) üzerindeki orijinal gönderiden alınmıştır

@Maitreyee_W
Spiking activity from 256 microelectrodes in speech motor cortex was translated into voice and played aloud continuously within 25 ms emulating a healthy speech-motor loop. His BCI-voice was ~60% intelligible – the highest to date for a voice synthesis BCI. 2/7
25 beğeni

@Maitreyee_W
Decoding prosodic features simultaneously with brain-to-voice enabled the participant to modulate his intonation in closed-loop to ask a question, emphasize words, and even ‘sing’ simple melodies by varying his pitch, making his BCI-voice more expressive. 3/7
11 beğeni

@Maitreyee_W
This BCI generalized to a variety of vocalizations including mimed speech, unseen words, self-initiated speech, interjections, made-up words, without training on these tasks. It allowed personalization of the BCI-voice to match the participant’s pre-ALS voice. 4/7
14 beğeni

@Maitreyee_W
Mapping neural activity directly to sounds at each timepoint (without a language model or a discrete speech representation) empowered the participant to decide what to speak and how – a step towards a “digital vocal tract” for restoring fully expressive speech. 5/7
10 beğeni

@Maitreyee_W
Special thanks to our study participant T15 for his invaluable contribution to this research. This study was conducted at @ucdavis @UCDneurosurgery as part of the BrainGate2 clinical trial @BrainGateTeam @MGH_CNTR. 6/7 #BCI #NeuroTech #ALS
11 beğeni

@Maitreyee_W
Finally, thanks to co-senior authors @SergeyStavisky, @DrDavidBrandman and co-authors @NS_Card, @neuroleigh, @ca_rrina, Tyler Singer-Clark, Xianda Hou, and Lee M. Miller. This study wouldn't have been possible without their help! 7/7
14 beğeni

@MiguelNicolelis
@Nature Congratulations for a great work! It is very rewarding to see brain-machine interfaces helping people as dreamed 25 years ago! My heartfelt congratulatiosn to all of you!
13 beğeni

@Maitreyee_W
@Nature Thank you for your kind words Dr. Nicolelis! The progress we’ve made has been built on the knowledge generated by the BCI research community over the past two decades.
2 beğeni

@NeuraPod
@Nature Nice work. Wild that this is really happening.
6 beğeni

@Maitreyee_W
@Nature Thank you!
4 beğeni

@lhcubillosg
@Nature Really cool work, congrats!!
5 beğeni

@astrodanish
@Nature amazing 👌🏽
4 beğeni

@GopalaSpeech
@Nature Congratulations ! @Maitreyee_W @SergeyStavisky @DrDavidBrandman
4 beğeni

@Maitreyee_W
@Nature @SergeyStavisky @DrDavidBrandman Thank you @GopalaSpeech !
1 beğeni

@WilliamLamkin
@Nature amazing work!
3 beğeni

@Neuroptimist23
@Nature What an amazing feat. So happy to learn this development.
3 beğeni

@sarah_wandelt
@Nature Congratulations! Super cool :)
3 beğeni

@Maitreyee_W
@Nature Thanks Sarah!

@matthew_willsey
@Nature Congrats @Maitreyee_W, super impressive!
3 beğeni

@Maitreyee_W
@Nature Thank you @matthew_willsey!
1 beğeni








