Meta open-sourced a brain-to-text system that reaches 78% word accuracy without surgery. Brain2Qwerty v2 converts non-invasive brain recordings into text with 61% average word accuracy and 78% for its strongest participant. The system reads MEG signals from a helmet, not electrodes placed inside brain tissue. 9 volunteers typed about... 22,000 sentences while researchers recorded 10 hours of neural activity each. Brain2Qwerty v1 mostly mapped brain signals to single typed characters. It tries to recover characters, words, and full sentence meaning together. The system studies those brain signals and tries to turn them into the words you wanted to type. - 61% average word accuracy across all participants - 78% word accuracy for the top participant - 50%+ of sentences decoded with no more than 1 word error Performance improves as the data pile grows Raw brain signals are messy because many mental and physical processes fire at once. Deep learning handles that mess by learning patterns directly from the original recordings. A fine-tuned LLM then uses language context to repair likely word and sentence errors. This explains why the system beats earlier non-invasive methods reporting 8% word accuracy. More than half of sentences from the strongest participant had one word error or less. Accuracy also improved as training data grew, suggesting more recordings may close more of the gap.show more

Rohan Paul

151,927 subscribers

分享 下载