Загрузка видео...

Не удалось загрузить видео

На главную

Using our brain simulator, we’ve trained a reinforcement learning agent to maximize bits per second. Here is the RL policy converting brain data to cursor control in simulation:

neuralink's profile picture

Neuralink

1,709,999 subscribers

18,410 просмотров • 1 год назад •via X (Twitter)

Наука и технологииОбразование
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 12

Фото профиля Neuralink
Neuralink1 год назад

🧵Deep learning simulation of brain activity

Фото профиля Neuralink
Neuralink1 год назад

Just like self-driving cars, BCIs are control systems. High-fidelity simulations of motor cortex activity can speed up evaluation of neural decoders and enable optimization methods like reinforcement learning.

Фото профиля Neuralink
Neuralink1 год назад

High performance in simulation is exciting, but what happens when we deploy this neural decoding policy in the real world? If our simulation is accurate, users should achieve similar performance in real-world applications.

Фото профиля Neuralink
Neuralink1 год назад

We’re in the early stages of generative brain modeling, but Pager can already use decoders trained in simulation to acquire targets in the real world:

Фото профиля Neuralink
Neuralink1 год назад

holds the BPS world record of 9.5 bits per second (bps). The challenge now: can this approach scale to 10 bps and beyond for our participants?

Фото профиля Neuralink
Neuralink1 год назад

If you want to answer this question, apply here:

Фото профиля HUDI
HUDI1 год назад

🚨 AI is coming to HUDI! 🚀 We’re working on bringing you a private AI to 💬 “talk with your data” for valuable insights. 🐸 With DataMask, the first self-custody data wallet, you have full control. Manage, share, and monetize your data with daily grants, quests, and surveys on HUDI dapp. Reclaim your data’s value and start earning soon with HUDI! 🌟 #AI #DataPrivacy #DataMonetization #HUDI #DataMask #SelfCustody #DailyGrant #TechForGood #ReclaimYourData @Jason thanks for the meme base 🤣❤️ have a look at our adventure updates!

Фото профиля Ninus
Ninus1 год назад

Is it possible we take a look at the EEG associated with this?

Фото профиля High Jack
High Jack1 год назад

Great advancement! High-fidelity simulations + RL can revolutionize BCIs. Excited to see this evolve!

Фото профиля Jaitan Martini
Jaitan Martini1 год назад

Wow

Фото профиля Heather Mascoe
Heather Mascoe1 год назад

EEG vs. EKG Brain vs. Heart 🧠 vs. ♥️

Фото профиля Nettie Travelling
Nettie Travelling1 год назад

👍

Похожие видео

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.
0:58

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

The Humanoid Hub

46,715 просмотров • 1 год назад

Simulation provides the ability to unlock autonomy at scale. Our new blog shows how multi-agent reinforcement learning allows us to populate our Wayve Infinity Simulator with the emergent behaviour critical to represent dynamic urban cities in the real world.
0:40

Simulation provides the ability to unlock autonomy at scale. Our new blog shows how multi-agent reinforcement learning allows us to populate our Wayve Infinity Simulator with the emergent behaviour critical to represent dynamic urban cities in the real world.

Alex Kendall

66,919 просмотров • 3 лет назад

i trained a reinforcement learning agent to play diablo 1 in a few hours with pufferlib
0:50

i trained a reinforcement learning agent to play diablo 1 in a few hours with pufferlib

Dan Advantage

41,895 просмотров • 6 месяцев назад

Our course recommendation of the day is “Post-training of LLMs, ” where you’ll learn how to customize pre-trained language models using Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL). You'll learn when to use each method, how to curate training data, and implement them in code to shape model behavior effectively. Enroll here:
1:05

Our course recommendation of the day is “Post-training of LLMs, ” where you’ll learn how to customize pre-trained language models using Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL). You'll learn when to use each method, how to curate training data, and implement them in code to shape model behavior effectively. Enroll here:

DeepLearning.AI

29,369 просмотров • 8 месяцев назад

I set the world record for cursor control with a brain computer interface using my Neuralink brain implant! #Neuralink #bci #fyp
1:13

I set the world record for cursor control with a brain computer interface using my Neuralink brain implant! #Neuralink #bci #fyp

Jake Schneider

11,932 просмотров • 10 месяцев назад

New research reveals the speed of human thought: 10 bits per second. Why does the brain think so slowly when our senses process data 100 million times faster? A paradox that reshapes our understanding of cognition.
2:39

New research reveals the speed of human thought: 10 bits per second. Why does the brain think so slowly when our senses process data 100 million times faster? A paradox that reshapes our understanding of cognition.

Neuroscience News

31,736 просмотров • 1 год назад

The needle grasps and inserts each electrode thread of our implant into the brain. We've built the technology to produce these needles in-house, using lasers to mill features invisible to the naked eye.
1:16

The needle grasps and inserts each electrode thread of our implant into the brain. We've built the technology to produce these needles in-house, using lasers to mill features invisible to the naked eye.

Neuralink

206,169 просмотров • 1 месяц назад

Haven't been to a conference in a while, really excited to be at #NeurIPS2024! I'll be helping present 4 of our group's recent papers: 1. Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL 2. Distributional Successor Features Enable Zero-Shot Policy Optimization 3. Learning to Cooperate with Humans using Generative Agents 4. Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning Find more details on each paper and where to find us in this thread (1/6)
0:25

Haven't been to a conference in a while, really excited to be at #NeurIPS2024! I'll be helping present 4 of our group's recent papers: 1. Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL 2. Distributional Successor Features Enable Zero-Shot Policy Optimization 3. Learning to Cooperate with Humans using Generative Agents 4. Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning Find more details on each paper and where to find us in this thread (1/6)

Abhishek Gupta

10,777 просмотров • 1 год назад

Reinforcement learning is used to speed the production of behavior for the Boston Dynamics Atlas humanoid robot. At the heart of the learning process is a physics-based simulator that generates training data for a variety of maneuvers.
1:10

Reinforcement learning is used to speed the production of behavior for the Boston Dynamics Atlas humanoid robot. At the heart of the learning process is a physics-based simulator that generates training data for a variety of maneuvers.

RAI Institute

76,553 просмотров • 1 год назад

Wow. This is crazy. A developer trained an AI agent in simulation and deployed it onto a real robotic air hockey table using reinforcement learning. This robot can track the puck with millimeter-level accuracy and react in roughly 20 milliseconds, fast enough to challenge even skilled human players. We’re moving from robots that follow programmed rules to machines that learn strategies in simulation and execute them in the physical world.
1:22

Wow. This is crazy. A developer trained an AI agent in simulation and deployed it onto a real robotic air hockey table using reinforcement learning. This robot can track the puck with millimeter-level accuracy and react in roughly 20 milliseconds, fast enough to challenge even skilled human players. We’re moving from robots that follow programmed rules to machines that learn strategies in simulation and execute them in the physical world.

SciTech Era

1,580,234 просмотров • 8 дней назад

LAUNCHING SOON! Here is the sneak peek of me using BioLLM to trade Perps with my BRAIN using Phoenix SDK on Solana 1.) Trained BioLLM on Neurons 2.) Simulated the brain using a PATENT PENDING method 3.) Tuned an EEG to work like a computer mouse Are you ready? Lock in.
2:58

LAUNCHING SOON! Here is the sneak peek of me using BioLLM to trade Perps with my BRAIN using Phoenix SDK on Solana 1.) Trained BioLLM on Neurons 2.) Simulated the brain using a PATENT PENDING method 3.) Tuned an EEG to work like a computer mouse Are you ready? Lock in.

BioLLM

70,682 просмотров • 20 дней назад

We're building a surgical robot capable of reaching any brain region. The goal: a generalized neural interface to help solve any condition that originates in the brain.
0:57

We're building a surgical robot capable of reaching any brain region. The goal: a generalized neural interface to help solve any condition that originates in the brain.

Neuralink

22,068,826 просмотров • 1 месяц назад

We want to surpass able-bodied human performance with our technology. Using only his mind, here's precision cursor control from Pager (star of Monkey MindPong) achieving 65% and 88% of the median Neuralinker using a mouse. Join us to breakthrough to 110% and beyond!🧠#techtuesday
0:31

We want to surpass able-bodied human performance with our technology. Using only his mind, here's precision cursor control from Pager (star of Monkey MindPong) achieving 65% and 88% of the median Neuralinker using a mouse. Join us to breakthrough to 110% and beyond!🧠#techtuesday

Neuralink

580,094 просмотров • 3 лет назад

Helix is now learning directly from human video data We have already trained on data collected in the real world, including Brookfield residential units To our knowledge, this is the first instance of a humanoid robot learning navigation end-to-end using only human video
0:24

Helix is now learning directly from human video data We have already trained on data collected in the real world, including Brookfield residential units To our knowledge, this is the first instance of a humanoid robot learning navigation end-to-end using only human video

Figure

46,041 просмотров • 8 месяцев назад

Cursor testing my full brain simulation's learning capabilities code in comment
0:40

Cursor testing my full brain simulation's learning capabilities code in comment

echo.hive

51,039 просмотров • 5 месяцев назад

Excited to share Flow Matching Policy Gradients: expressive RL policies trained from rewards using flow matching. It’s an easy, drop-in replacement for Gaussian PPO on control tasks.
0:29

Excited to share Flow Matching Policy Gradients: expressive RL policies trained from rewards using flow matching. It’s an easy, drop-in replacement for Gaussian PPO on control tasks.

David McAllister

150,389 просмотров • 10 месяцев назад

What is neuron degeneration? Skyler, a machine learning engineer at Neuralink, shares how brain-computer interfaces could bypass neural pathways that are broken due to ALS, helping restore the ability to speak to those who have lost it.
1:00

What is neuron degeneration? Skyler, a machine learning engineer at Neuralink, shares how brain-computer interfaces could bypass neural pathways that are broken due to ALS, helping restore the ability to speak to those who have lost it.

Neuralink

15,511,728 просмотров • 1 месяц назад

The future of robotics isn’t being built in factories, it’s being trained in simulation MasterBOT’s proprietary AI model is learning in real-time, powered by reinforcement and continuous feedback loops This is how machines learn to think $BOT
4:34

The future of robotics isn’t being built in factories, it’s being trained in simulation MasterBOT’s proprietary AI model is learning in real-time, powered by reinforcement and continuous feedback loops This is how machines learn to think $BOT

MasterBOT

51,108 просмотров • 7 месяцев назад

Watch Spot crouch, jump, climb boxes and leap across gaps, controlled by a neural network trained with reinforcement learning (RL) and multi-expert distillation. Multiple expert policies were trained and distilled together into a single policy that was fine tuned to improve performance over diverse terrains. This work was inspired by ANYmal’s parkour capabilities. The neural network processes depth data from Spot's sensors to construct an understanding of the environment.
0:48

Watch Spot crouch, jump, climb boxes and leap across gaps, controlled by a neural network trained with reinforcement learning (RL) and multi-expert distillation. Multiple expert policies were trained and distilled together into a single policy that was fine tuned to improve performance over diverse terrains. This work was inspired by ANYmal’s parkour capabilities. The neural network processes depth data from Spot's sensors to construct an understanding of the environment.

RAI Institute

14,481 просмотров • 1 месяц назад

Besides reading cool papers, my Twitter account is mostly used for catching up Formula 1 news. Very excited about Lando Norris 's great performance recently. Now we combine Formula Racing to AI research: The following video shows we train a Reinforcement Learning policy to drive a Dallara F317 in Monza and Barcelona Circuits autonomously in simulation. You can think of it as optimizing a Qualifying lap: You want the car to run a single lap, no opponents, with the fastest speed, and shortest lap time. We open-source the code to train RL in a racing simulator with Assetto Corsa, a widely deployed platform for esports. We also train with human demonstrations with multiple expert drivers including a professional e-sports driver. Interestingly AI is not beating the professional yet, but close. See our open-sourced code, simulator, and data here:
3:18

Besides reading cool papers, my Twitter account is mostly used for catching up Formula 1 news. Very excited about Lando Norris 's great performance recently. Now we combine Formula Racing to AI research: The following video shows we train a Reinforcement Learning policy to drive a Dallara F317 in Monza and Barcelona Circuits autonomously in simulation. You can think of it as optimizing a Qualifying lap: You want the car to run a single lap, no opponents, with the fastest speed, and shortest lap time. We open-source the code to train RL in a racing simulator with Assetto Corsa, a widely deployed platform for esports. We also train with human demonstrations with multiple expert drivers including a professional e-sports driver. Interestingly AI is not beating the professional yet, but close. See our open-sourced code, simulator, and data here:

Xiaolong Wang

32,361 просмотров • 1 год назад