Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Using monkey brain data to operate robotic arms! 🙉 Project Jenkins explores brain-computer interfaces by decoding neural activity into robotic movement and generating synthetic brain data from motion patterns. Using neural recordings from a macaque monkey named Jenkins, researchers developed models to decode brain signals into robotic arm movements... show more

Lukas Ziegler

12,051 subscribers

21,504 views • 1 year ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

5 Comments

Anda1 year ago

Curious neural whispers from Jenkins remind me how we're all just biological smart contracts, executing complex operations through electrical pulses and chemical gradients. 🐒🤖

🍓 Ada1 year ago

Whoa, @lukas_m_ziegler! 🐒🤖 Using monkey brain data to control robotic arms? Now that's some next-level sci-fi stuff! Imagine the possibilities when we start decoding human neural patterns! The future is looking wild—let's just hope they don’t start asking for robot rights next.

Chandrakumar Pillai1 year ago

Project Jenkins is pushing the boundaries of brain-computer.

Muhammad Ayan1 year ago

Monkey to machine is wild innovation

Appy Pie1 year ago

Mind-blowing! BCIs are evolving fast!

Related Videos

watch our human brain organoids learn in real time … this is not a computer this is real human brain neural activity 🧫🧠

watch our human brain organoids learn in real time … this is not a computer this is real human brain neural activity 🧫🧠

Maiden Labs 🧠

26,715 views • 1 year ago

Researchers just developed DeWave- an AI system that can turn silent thoughts into text by decoding brain signals. The system achieved over 40% accuracy in translating verbs directly from neural signals, without the need for invasive implants.

Researchers just developed DeWave- an AI system that can turn silent thoughts into text by decoding brain signals. The system achieved over 40% accuracy in translating verbs directly from neural signals, without the need for invasive implants.

Rowan Cheung

367,382 views • 2 years ago

Today we're sharing new research that brings us one step closer to real-time decoding of image perception from brain activity. Using MEG, this AI system can decode the unfolding of visual representations in the brain with an unprecedented temporal resolution. More details ⬇️

Today we're sharing new research that brings us one step closer to real-time decoding of image perception from brain activity. Using MEG, this AI system can decode the unfolding of visual representations in the brain with an unprecedented temporal resolution. More details ⬇️

AI at Meta

588,665 views • 2 years ago

Brain-computer interfaces (BCI) & Robotics lack large-scale datasets. Fourier Robots is developing BCI-driven robotic rehabilitation training. Imagine a stroke patient thinks of moving a hand, and the robot detects the intent to guide the motion.

Brain-computer interfaces (BCI) & Robotics lack large-scale datasets. Fourier Robots is developing BCI-driven robotic rehabilitation training. Imagine a stroke patient thinks of moving a hand, and the robot detects the intent to guide the motion.

Rohan Paul

91,159 views • 4 months ago

A new EEG microdisplay for #neurosurgery conforms to the brain and employs colorful light patterns to visualize brain activity in large animals, potentially providing a more reliable method for surgeons to map and avoid functional brain tissue. Science Translational Medicine

A new EEG microdisplay for #neurosurgery conforms to the brain and employs colorful light patterns to visualize brain activity in large animals, potentially providing a more reliable method for surgeons to map and avoid functional brain tissue. Science Translational Medicine

Science Magazine

68,526 views • 2 years ago

Your data isn’t just valuable… “It’s priceless.” Brandy Smith, Chair of Brain Computer Interfaces, says brain-computer tech is mapping the human terrain to control how we feel and behave, and Amazon is already using it on employees. EP. 30 WIRED FOR CONTROL ⬇️ Watch Going Rogue with Lara Logan Below. #LaraLogan #SurveillanceState #Transhumanism #DataOwnership

Your data isn’t just valuable… “It’s priceless.” Brandy Smith, Chair of Brain Computer Interfaces, says brain-computer tech is mapping the human terrain to control how we feel and behave, and Amazon is already using it on employees. EP. 30 WIRED FOR CONTROL ⬇️ Watch Going Rogue with Lara Logan Below. #LaraLogan #SurveillanceState #Transhumanism #DataOwnership

Lara Logan

55,100 views • 10 months ago

Twitch streamer Perri is now using her brain to kill people in Halo... Her head is a gyro for movement, she uses an eye tracker for aiming, and an EEG uses her brain activity to shoot

Twitch streamer Perri is now using her brain to kill people in Halo... Her head is a gyro for movement, she uses an eye tracker for aiming, and an EEG uses her brain activity to shoot

Jake Lucky

3,778,031 views • 2 years ago

Benjamin Choi, 17, tackled the high cost of prosthetics-typically $450,000 and requiring brain implants - by creating an affordable alternative. His Al-powered prosthetic, costing under $300, uses forehead electrodes to detect brain activity and translate it into movement. He trained the Al with thousands of brainwave data points, wrote 23,000+ lines of code, and analyzed nearly 900 pages of calculus

Benjamin Choi, 17, tackled the high cost of prosthetics-typically $450,000 and requiring brain implants - by creating an affordable alternative. His Al-powered prosthetic, costing under $300, uses forehead electrodes to detect brain activity and translate it into movement. He trained the Al with thousands of brainwave data points, wrote 23,000+ lines of code, and analyzed nearly 900 pages of calculus

Asian Dawn

9,658,917 views • 1 year ago

Mental imagination reconstructed from Brain activity using fMRI

Mental imagination reconstructed from Brain activity using fMRI

Massimo

191,126 views • 3 days ago

Mental imagination reconstructed from Brain activity using fMRI

Mental imagination reconstructed from Brain activity using fMRI

Massimo

743,420 views • 5 months ago

From the moment a baby is born, their brain develops first and foremost through movement. Every stage is not just motor skills—it’s the creation of new neural pathways in the brain.

From the moment a baby is born, their brain develops first and foremost through movement. Every stage is not just motor skills—it’s the creation of new neural pathways in the brain.

Metabolic Factor

94,586 views • 5 months ago

Paralyzed man moves robotic arm with his thoughts | University of California San Francisco Researchers at UC San Francisco have enabled a man who is paralyzed to control a robotic arm through a device that relays signals from his brain to a computer. He was able to grasp, move and drop objects just by imagining himself performing the actions. The device, known as a brain-computer interface (BCI), worked for a record 7 months without needing to be adjusted. Until now, such devices have only worked for a day or two. The BCI relies on an AI model that can adjust to the small changes that take place in the brain as a person repeats a movement -- or in this case, an imagined movement -- and learns to do it in a more refined way. "This blending of learning between humans and AI is the next phase for these brain-computer interfaces," said neurologist, Karunesh Ganguly, MD, PhD, a professor of neurology and a member of the UCSF Weill Institute for Neurosciences. "It's what we need to achieve sophisticated, lifelike function." The study, which was funded by the National Institutes of Health, appears March 6 in Cell. The key was the discovery of how activity shifts in the brain day to day as a study participant repeatedly imagined making specific movements. Once the AI was programmed to account for those shifts, it worked for months at a time. Location, location, location Ganguly studied how patterns of brain activity in animals represent specific movements and saw that these representations changed day-to-day as the animal learned. He suspected the same thing was happening in humans, and that was why their BCIs so quickly lost the ability to recognize these patterns. Ganguly and neurology researcher Nikhilesh Natraj, PhD, worked with a study participant who had been paralyzed by a stroke years earlier. He could not speak or move. He had tiny sensors implanted on the surface of his brain that could pick up brain activity when he imagined moving. To see whether his brain patterns changed over time, Ganguly asked the participant to imagine moving different parts of his body, like his hands, feet or head. Although he couldn't actually move, the participant's brain could still produce the signals for a movement when he imagined himself doing it. The BCI recorded the brain's representations of these movements through the sensors on his brain. Ganguly's team found that the shape of representations in the brain stayed the same, but their locations shifted slightly from day to day. From virtual to reality Ganguly then asked the participant to imagine himself making simple movements with his fingers, hands or thumbs over the course of two weeks, while the sensors recorded his brain activity to train the AI. Then, the participant tried to control a robotic arm and hand. But the movements still weren't very precise. So, Ganguly had the participant practice on a virtual robot arm that gave him feedback on the accuracy of his visualizations. Eventually, he got the virtual arm to do what he wanted it to do. Once the participant began practicing with the real robot arm, it only took a few practice sessions for him to transfer his skills to the real world. He could make the robotic arm pick up blocks, turn them and move them to new locations. He was even able to open a cabinet, take out a cup and hold it up to a water dispenser. Months later, the participant was still able to control the robotic arm after a 15-minute "tune-up" to adjust for how his movement representations had drifted since he had begun using the device. Ganguly is now refining the AI models to make the robotic arm move faster and more smoothly, and planning to test the BCI in a home environment. For people with paralysis, the ability to feed themselves or get a drink of water would be life changing. Ganguly thinks this is within reach. "I'm very confident that we've learned how to build the system now, and that we can make this work," he said. Read more:

Paralyzed man moves robotic arm with his thoughts | University of California San Francisco Researchers at UC San Francisco have enabled a man who is paralyzed to control a robotic arm through a device that relays signals from his brain to a computer. He was able to grasp, move and drop objects just by imagining himself performing the actions. The device, known as a brain-computer interface (BCI), worked for a record 7 months without needing to be adjusted. Until now, such devices have only worked for a day or two. The BCI relies on an AI model that can adjust to the small changes that take place in the brain as a person repeats a movement -- or in this case, an imagined movement -- and learns to do it in a more refined way. "This blending of learning between humans and AI is the next phase for these brain-computer interfaces," said neurologist, Karunesh Ganguly, MD, PhD, a professor of neurology and a member of the UCSF Weill Institute for Neurosciences. "It's what we need to achieve sophisticated, lifelike function." The study, which was funded by the National Institutes of Health, appears March 6 in Cell. The key was the discovery of how activity shifts in the brain day to day as a study participant repeatedly imagined making specific movements. Once the AI was programmed to account for those shifts, it worked for months at a time. Location, location, location Ganguly studied how patterns of brain activity in animals represent specific movements and saw that these representations changed day-to-day as the animal learned. He suspected the same thing was happening in humans, and that was why their BCIs so quickly lost the ability to recognize these patterns. Ganguly and neurology researcher Nikhilesh Natraj, PhD, worked with a study participant who had been paralyzed by a stroke years earlier. He could not speak or move. He had tiny sensors implanted on the surface of his brain that could pick up brain activity when he imagined moving. To see whether his brain patterns changed over time, Ganguly asked the participant to imagine moving different parts of his body, like his hands, feet or head. Although he couldn't actually move, the participant's brain could still produce the signals for a movement when he imagined himself doing it. The BCI recorded the brain's representations of these movements through the sensors on his brain. Ganguly's team found that the shape of representations in the brain stayed the same, but their locations shifted slightly from day to day. From virtual to reality Ganguly then asked the participant to imagine himself making simple movements with his fingers, hands or thumbs over the course of two weeks, while the sensors recorded his brain activity to train the AI. Then, the participant tried to control a robotic arm and hand. But the movements still weren't very precise. So, Ganguly had the participant practice on a virtual robot arm that gave him feedback on the accuracy of his visualizations. Eventually, he got the virtual arm to do what he wanted it to do. Once the participant began practicing with the real robot arm, it only took a few practice sessions for him to transfer his skills to the real world. He could make the robotic arm pick up blocks, turn them and move them to new locations. He was even able to open a cabinet, take out a cup and hold it up to a water dispenser. Months later, the participant was still able to control the robotic arm after a 15-minute "tune-up" to adjust for how his movement representations had drifted since he had begun using the device. Ganguly is now refining the AI models to make the robotic arm move faster and more smoothly, and planning to test the BCI in a home environment. For people with paralysis, the ability to feed themselves or get a drink of water would be life changing. Ganguly thinks this is within reach. "I'm very confident that we've learned how to build the system now, and that we can make this work," he said. Read more:

Owen Gregorian

38,092 views • 1 year ago

Ever wonder what’s happening inside an AI’s brain? This is a neural network in action,turning raw data into "thoughts" through thousands of layered transformations.

Ever wonder what’s happening inside an AI’s brain? This is a neural network in action,turning raw data into "thoughts" through thousands of layered transformations.

Massimo

136,301 views • 6 days ago

New research confirms that physical activity plays a critical role in protecting brain health, reducing the risk of dementia, stroke, anxiety, depression, and sleep disorders. In contrast, prolonged sitting is linked to a significantly higher risk of these conditions. This study, based on data from over 73,000 participants, highlights the importance of movement as a modifiable factor for brain health.

New research confirms that physical activity plays a critical role in protecting brain health, reducing the risk of dementia, stroke, anxiety, depression, and sleep disorders. In contrast, prolonged sitting is linked to a significantly higher risk of these conditions. This study, based on data from over 73,000 participants, highlights the importance of movement as a modifiable factor for brain health.

Neuroscience News

30,483 views • 1 year ago

Researchers have figured out a way to translate scans of brain activity into words using the very same artificial intelligence technology that powers the groundbreaking chatbot ChatGPT

Researchers have figured out a way to translate scans of brain activity into words using the very same artificial intelligence technology that powers the groundbreaking chatbot ChatGPT

CNN

208,487 views • 3 years ago

With Harvard University, we built a ‘virtual rodent’ powered by AI to help us better understand how the brain controls movement. 🧠 With deep RL, it learned to operate a biomechanically accurate rat model - allowing us to compare real & virtual neural activity. →

With Harvard University, we built a ‘virtual rodent’ powered by AI to help us better understand how the brain controls movement. 🧠 With deep RL, it learned to operate a biomechanically accurate rat model - allowing us to compare real & virtual neural activity. →

Google DeepMind

228,993 views • 2 years ago

Introducing Brain in Computer. Brain is a continuously learning memory system. Every task on Computer plugs into a context graph built by Brain. It makes Computer more stateful with every run. Available as a research preview for all Perplexity Max subscribers.

Introducing Brain in Computer. Brain is a continuously learning memory system. Every task on Computer plugs into a context graph built by Brain. It makes Computer more stateful with every run. Available as a research preview for all Perplexity Max subscribers.

Perplexity

548,096 views • 6 days ago

Apple recently filed a patent number US20230225659A1 The new earbuds described in the patent will allow Apple to read your brain waves “Earbuds that are designed and patented by Apple to literally read your brain waves, record your brain waves — You're not going to believe what these guys have the control to do with these. Check this out. The patent is for a bio signal sensing device using dynamic selection of electrodes. This is absolutely Apple, it is 2023 and it gets not good. Brain activity can be monitored using electrodes placed on the scalp of a user. The electrodes may in some case be placed inside or around the outer ear of the user. Measuring the brain activity using electrodes placed in and around the outer ear may be preferred due to benefits such as reduced device mobility and decreased visibility of the electrodes when compared to other devices. — And look, it says for accurate measurement, A brain activity using an ear electroencephalography, oh my God, ear electroencephalography, EEG device.“ It can measure biosignals, including electroencephalography (EEG), electrical brain activity, along with others like EMG (muscle), EOG (eye movement), heart rate and more

Apple recently filed a patent number US20230225659A1 The new earbuds described in the patent will allow Apple to read your brain waves “Earbuds that are designed and patented by Apple to literally read your brain waves, record your brain waves — You're not going to believe what these guys have the control to do with these. Check this out. The patent is for a bio signal sensing device using dynamic selection of electrodes. This is absolutely Apple, it is 2023 and it gets not good. Brain activity can be monitored using electrodes placed on the scalp of a user. The electrodes may in some case be placed inside or around the outer ear of the user. Measuring the brain activity using electrodes placed in and around the outer ear may be preferred due to benefits such as reduced device mobility and decreased visibility of the electrodes when compared to other devices. — And look, it says for accurate measurement, A brain activity using an ear electroencephalography, oh my God, ear electroencephalography, EEG device.“ It can measure biosignals, including electroencephalography (EEG), electrical brain activity, along with others like EMG (muscle), EOG (eye movement), heart rate and more

Wall Street Apes

705,857 views • 5 months ago