Gezinmeyi atla
Our brain-to-voice synthesis brain-computer interface paper was published in nature today!
0:00 / 1:04

Our brain-to-voice synthesis brain-computer interface paper was published in nature today!

Maitreyee Wairagkar

@Maitreyee_W1 B takipçi

X profili
577 beğeniİndirOrijinal gönderi

58.775 görüntüleme

Our brain-to-voice synthesis brain-computer interface paper was published in nature today! This neuroprosthesis synthesized the voice of a man with ALS instantaneously, enabling him to ‘speak’ flexibly and modulate the prosody of his BCI-voice. 1/7 Paper:

33 Yorum

Yorumlar X (Twitter) üzerindeki orijinal gönderiden alınmıştır

  • Maitreyee Wairagkar profil fotoğrafı

    @Maitreyee_W

    Spiking activity from 256 microelectrodes in speech motor cortex was translated into voice and played aloud continuously within 25 ms emulating a healthy speech-motor loop. His BCI-voice was ~60% intelligible – the highest to date for a voice synthesis BCI. 2/7

    25 beğeni

  • Maitreyee Wairagkar profil fotoğrafı

    @Maitreyee_W

    Decoding prosodic features simultaneously with brain-to-voice enabled the participant to modulate his intonation in closed-loop to ask a question, emphasize words, and even ‘sing’ simple melodies by varying his pitch, making his BCI-voice more expressive. 3/7

    11 beğeni

  • Maitreyee Wairagkar profil fotoğrafı

    @Maitreyee_W

    This BCI generalized to a variety of vocalizations including mimed speech, unseen words, self-initiated speech, interjections, made-up words, without training on these tasks. It allowed personalization of the BCI-voice to match the participant’s pre-ALS voice. 4/7

    14 beğeni

  • Maitreyee Wairagkar profil fotoğrafı

    @Maitreyee_W

    Mapping neural activity directly to sounds at each timepoint (without a language model or a discrete speech representation) empowered the participant to decide what to speak and how – a step towards a “digital vocal tract” for restoring fully expressive speech. 5/7

    10 beğeni

  • Maitreyee Wairagkar profil fotoğrafı

    @Maitreyee_W

    Special thanks to our study participant T15 for his invaluable contribution to this research. This study was conducted at @ucdavis @UCDneurosurgery as part of the BrainGate2 clinical trial @BrainGateTeam @MGH_CNTR. 6/7 #BCI #NeuroTech #ALS

    11 beğeni

  • Maitreyee Wairagkar profil fotoğrafı

    @Maitreyee_W

    Finally, thanks to co-senior authors @SergeyStavisky, @DrDavidBrandman and co-authors @NS_Card, @neuroleigh, @ca_rrina, Tyler Singer-Clark, Xianda Hou, and Lee M. Miller. This study wouldn't have been possible without their help! 7/7

    14 beğeni

  • Miguel Nicolelis profil fotoğrafı

    @MiguelNicolelis

    @Nature Congratulations for a great work! It is very rewarding to see brain-machine interfaces helping people as dreamed 25 years ago! My heartfelt congratulatiosn to all of you!

    13 beğeni

  • Maitreyee Wairagkar profil fotoğrafı

    @Maitreyee_W

    @Nature Thank you for your kind words Dr. Nicolelis! The progress we’ve made has been built on the knowledge generated by the BCI research community over the past two decades.

    2 beğeni

  • Neura Pod – Neuralink profil fotoğrafı

    @NeuraPod

    @Nature Nice work. Wild that this is really happening.

    6 beğeni

  • Maitreyee Wairagkar profil fotoğrafı

    @Maitreyee_W

    @Nature Thank you!

    4 beğeni

  • Luis Cubillos profil fotoğrafı

    @lhcubillosg

    @Nature Really cool work, congrats!!

    5 beğeni

  • Danish Hussain profil fotoğrafı

    @astrodanish

    @Nature amazing 👌🏽

    4 beğeni

  • Gopala Anumanchipalli profil fotoğrafı

    @GopalaSpeech

    @Nature Congratulations ! @Maitreyee_W @SergeyStavisky @DrDavidBrandman

    4 beğeni

  • Maitreyee Wairagkar profil fotoğrafı

    @Maitreyee_W

    @Nature @SergeyStavisky @DrDavidBrandman Thank you @GopalaSpeech !

    1 beğeni

  • William Lamkin profil fotoğrafı

    @WilliamLamkin

    @Nature amazing work!

    3 beğeni

  • Dr. Prabhudev M Hiremath MD 🧠 profil fotoğrafı

    @Neuroptimist23

    @Nature What an amazing feat. So happy to learn this development.

    3 beğeni

  • Sarah Wandelt profil fotoğrafı

    @sarah_wandelt

    @Nature Congratulations! Super cool :)

    3 beğeni

  • Maitreyee Wairagkar profil fotoğrafı

    @Maitreyee_W

    @Nature Thanks Sarah!

  • Matthew Willsey profil fotoğrafı

    @matthew_willsey

    @Nature Congrats @Maitreyee_W, super impressive!

    3 beğeni

  • Maitreyee Wairagkar profil fotoğrafı

    @Maitreyee_W

    @Nature Thank you @matthew_willsey!

    1 beğeni