Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Using our brain simulator, we’ve trained a reinforcement learning agent to maximize bits per second. Here is the RL policy converting brain data to cursor control in simulation:

neuralink's profile picture

Neuralink

1,709,999 subscribers

18,410 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & TeknolojiEğitim
LIVE

Anya Rossi• Live Now

Private livecam show

12 Yorum

Neuralink profil fotoğrafı
Neuralink1 yıl önce

🧵Deep learning simulation of brain activity

Neuralink profil fotoğrafı
Neuralink1 yıl önce

Just like self-driving cars, BCIs are control systems. High-fidelity simulations of motor cortex activity can speed up evaluation of neural decoders and enable optimization methods like reinforcement learning.

Neuralink profil fotoğrafı
Neuralink1 yıl önce

High performance in simulation is exciting, but what happens when we deploy this neural decoding policy in the real world? If our simulation is accurate, users should achieve similar performance in real-world applications.

Neuralink profil fotoğrafı
Neuralink1 yıl önce

We’re in the early stages of generative brain modeling, but Pager can already use decoders trained in simulation to acquire targets in the real world:

Neuralink profil fotoğrafı
Neuralink1 yıl önce

holds the BPS world record of 9.5 bits per second (bps). The challenge now: can this approach scale to 10 bps and beyond for our participants?

Neuralink profil fotoğrafı
Neuralink1 yıl önce

If you want to answer this question, apply here:

HUDI profil fotoğrafı
HUDI1 yıl önce

🚨 AI is coming to HUDI! 🚀 We’re working on bringing you a private AI to 💬 “talk with your data” for valuable insights. 🐸 With DataMask, the first self-custody data wallet, you have full control. Manage, share, and monetize your data with daily grants, quests, and surveys on HUDI dapp. Reclaim your data’s value and start earning soon with HUDI! 🌟 #AI #DataPrivacy #DataMonetization #HUDI #DataMask #SelfCustody #DailyGrant #TechForGood #ReclaimYourData @Jason thanks for the meme base 🤣❤️ have a look at our adventure updates!

Ninus profil fotoğrafı
Ninus1 yıl önce

Is it possible we take a look at the EEG associated with this?

High Jack profil fotoğrafı
High Jack1 yıl önce

Great advancement! High-fidelity simulations + RL can revolutionize BCIs. Excited to see this evolve!

Jaitan Martini profil fotoğrafı
Jaitan Martini1 yıl önce

Wow

Heather Mascoe profil fotoğrafı
Heather Mascoe1 yıl önce

EEG vs. EKG Brain vs. Heart 🧠 vs. ♥️

Nettie Travelling profil fotoğrafı
Nettie Travelling1 yıl önce

👍

Benzer Videolar

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.
0:58

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

The Humanoid Hub

46,715 görüntüleme • 1 yıl önce

Simulation provides the ability to unlock autonomy at scale. Our new blog shows how multi-agent reinforcement learning allows us to populate our Wayve Infinity Simulator with the emergent behaviour critical to represent dynamic urban cities in the real world.
0:40

Simulation provides the ability to unlock autonomy at scale. Our new blog shows how multi-agent reinforcement learning allows us to populate our Wayve Infinity Simulator with the emergent behaviour critical to represent dynamic urban cities in the real world.

Alex Kendall

66,919 görüntüleme • 3 yıl önce

i trained a reinforcement learning agent to play diablo 1 in a few hours with pufferlib
0:50

i trained a reinforcement learning agent to play diablo 1 in a few hours with pufferlib

Dan Advantage

41,895 görüntüleme • 6 ay önce

Our course recommendation of the day is “Post-training of LLMs, ” where you’ll learn how to customize pre-trained language models using Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL). You'll learn when to use each method, how to curate training data, and implement them in code to shape model behavior effectively. Enroll here:
1:05

Our course recommendation of the day is “Post-training of LLMs, ” where you’ll learn how to customize pre-trained language models using Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning (RL). You'll learn when to use each method, how to curate training data, and implement them in code to shape model behavior effectively. Enroll here:

DeepLearning.AI

29,369 görüntüleme • 8 ay önce

I set the world record for cursor control with a brain computer interface using my Neuralink brain implant! #Neuralink #bci #fyp
1:13

I set the world record for cursor control with a brain computer interface using my Neuralink brain implant! #Neuralink #bci #fyp

Jake Schneider

11,932 görüntüleme • 10 ay önce

New research reveals the speed of human thought: 10 bits per second. Why does the brain think so slowly when our senses process data 100 million times faster? A paradox that reshapes our understanding of cognition.
2:39

New research reveals the speed of human thought: 10 bits per second. Why does the brain think so slowly when our senses process data 100 million times faster? A paradox that reshapes our understanding of cognition.

Neuroscience News

31,736 görüntüleme • 1 yıl önce

The needle grasps and inserts each electrode thread of our implant into the brain. We've built the technology to produce these needles in-house, using lasers to mill features invisible to the naked eye.
1:16

The needle grasps and inserts each electrode thread of our implant into the brain. We've built the technology to produce these needles in-house, using lasers to mill features invisible to the naked eye.

Neuralink

206,169 görüntüleme • 1 ay önce

Haven't been to a conference in a while, really excited to be at #NeurIPS2024! I'll be helping present 4 of our group's recent papers: 1. Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL 2. Distributional Successor Features Enable Zero-Shot Policy Optimization 3. Learning to Cooperate with Humans using Generative Agents 4. Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning Find more details on each paper and where to find us in this thread (1/6)
0:25

Haven't been to a conference in a while, really excited to be at #NeurIPS2024! I'll be helping present 4 of our group's recent papers: 1. Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL 2. Distributional Successor Features Enable Zero-Shot Policy Optimization 3. Learning to Cooperate with Humans using Generative Agents 4. Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning Find more details on each paper and where to find us in this thread (1/6)

Abhishek Gupta

10,777 görüntüleme • 1 yıl önce

Reinforcement learning is used to speed the production of behavior for the Boston Dynamics Atlas humanoid robot. At the heart of the learning process is a physics-based simulator that generates training data for a variety of maneuvers.
1:10

Reinforcement learning is used to speed the production of behavior for the Boston Dynamics Atlas humanoid robot. At the heart of the learning process is a physics-based simulator that generates training data for a variety of maneuvers.

RAI Institute

76,553 görüntüleme • 1 yıl önce

Wow. This is crazy. A developer trained an AI agent in simulation and deployed it onto a real robotic air hockey table using reinforcement learning. This robot can track the puck with millimeter-level accuracy and react in roughly 20 milliseconds, fast enough to challenge even skilled human players. We’re moving from robots that follow programmed rules to machines that learn strategies in simulation and execute them in the physical world.
1:22

Wow. This is crazy. A developer trained an AI agent in simulation and deployed it onto a real robotic air hockey table using reinforcement learning. This robot can track the puck with millimeter-level accuracy and react in roughly 20 milliseconds, fast enough to challenge even skilled human players. We’re moving from robots that follow programmed rules to machines that learn strategies in simulation and execute them in the physical world.

SciTech Era

1,580,234 görüntüleme • 8 gün önce

LAUNCHING SOON! Here is the sneak peek of me using BioLLM to trade Perps with my BRAIN using Phoenix SDK on Solana 1.) Trained BioLLM on Neurons 2.) Simulated the brain using a PATENT PENDING method 3.) Tuned an EEG to work like a computer mouse Are you ready? Lock in.
2:58

LAUNCHING SOON! Here is the sneak peek of me using BioLLM to trade Perps with my BRAIN using Phoenix SDK on Solana 1.) Trained BioLLM on Neurons 2.) Simulated the brain using a PATENT PENDING method 3.) Tuned an EEG to work like a computer mouse Are you ready? Lock in.

BioLLM

70,682 görüntüleme • 20 gün önce

We're building a surgical robot capable of reaching any brain region. The goal: a generalized neural interface to help solve any condition that originates in the brain.
0:57

We're building a surgical robot capable of reaching any brain region. The goal: a generalized neural interface to help solve any condition that originates in the brain.

Neuralink

22,068,826 görüntüleme • 1 ay önce

We want to surpass able-bodied human performance with our technology. Using only his mind, here's precision cursor control from Pager (star of Monkey MindPong) achieving 65% and 88% of the median Neuralinker using a mouse. Join us to breakthrough to 110% and beyond!🧠#techtuesday
0:31

We want to surpass able-bodied human performance with our technology. Using only his mind, here's precision cursor control from Pager (star of Monkey MindPong) achieving 65% and 88% of the median Neuralinker using a mouse. Join us to breakthrough to 110% and beyond!🧠#techtuesday

Neuralink

580,094 görüntüleme • 3 yıl önce

Helix is now learning directly from human video data We have already trained on data collected in the real world, including Brookfield residential units To our knowledge, this is the first instance of a humanoid robot learning navigation end-to-end using only human video
0:24

Helix is now learning directly from human video data We have already trained on data collected in the real world, including Brookfield residential units To our knowledge, this is the first instance of a humanoid robot learning navigation end-to-end using only human video

Figure

46,041 görüntüleme • 8 ay önce

Cursor testing my full brain simulation's learning capabilities code in comment
0:40

Cursor testing my full brain simulation's learning capabilities code in comment

echo.hive

51,039 görüntüleme • 5 ay önce

Excited to share Flow Matching Policy Gradients: expressive RL policies trained from rewards using flow matching. It’s an easy, drop-in replacement for Gaussian PPO on control tasks.
0:29

Excited to share Flow Matching Policy Gradients: expressive RL policies trained from rewards using flow matching. It’s an easy, drop-in replacement for Gaussian PPO on control tasks.

David McAllister

150,389 görüntüleme • 10 ay önce

What is neuron degeneration? Skyler, a machine learning engineer at Neuralink, shares how brain-computer interfaces could bypass neural pathways that are broken due to ALS, helping restore the ability to speak to those who have lost it.
1:00

What is neuron degeneration? Skyler, a machine learning engineer at Neuralink, shares how brain-computer interfaces could bypass neural pathways that are broken due to ALS, helping restore the ability to speak to those who have lost it.

Neuralink

15,511,728 görüntüleme • 1 ay önce

The future of robotics isn’t being built in factories, it’s being trained in simulation MasterBOT’s proprietary AI model is learning in real-time, powered by reinforcement and continuous feedback loops This is how machines learn to think $BOT
4:34

The future of robotics isn’t being built in factories, it’s being trained in simulation MasterBOT’s proprietary AI model is learning in real-time, powered by reinforcement and continuous feedback loops This is how machines learn to think $BOT

MasterBOT

51,108 görüntüleme • 7 ay önce

Watch Spot crouch, jump, climb boxes and leap across gaps, controlled by a neural network trained with reinforcement learning (RL) and multi-expert distillation. Multiple expert policies were trained and distilled together into a single policy that was fine tuned to improve performance over diverse terrains. This work was inspired by ANYmal’s parkour capabilities. The neural network processes depth data from Spot's sensors to construct an understanding of the environment.
0:48

Watch Spot crouch, jump, climb boxes and leap across gaps, controlled by a neural network trained with reinforcement learning (RL) and multi-expert distillation. Multiple expert policies were trained and distilled together into a single policy that was fine tuned to improve performance over diverse terrains. This work was inspired by ANYmal’s parkour capabilities. The neural network processes depth data from Spot's sensors to construct an understanding of the environment.

RAI Institute

14,481 görüntüleme • 1 ay önce

Besides reading cool papers, my Twitter account is mostly used for catching up Formula 1 news. Very excited about Lando Norris 's great performance recently. Now we combine Formula Racing to AI research: The following video shows we train a Reinforcement Learning policy to drive a Dallara F317 in Monza and Barcelona Circuits autonomously in simulation. You can think of it as optimizing a Qualifying lap: You want the car to run a single lap, no opponents, with the fastest speed, and shortest lap time. We open-source the code to train RL in a racing simulator with Assetto Corsa, a widely deployed platform for esports. We also train with human demonstrations with multiple expert drivers including a professional e-sports driver. Interestingly AI is not beating the professional yet, but close. See our open-sourced code, simulator, and data here:
3:18

Besides reading cool papers, my Twitter account is mostly used for catching up Formula 1 news. Very excited about Lando Norris 's great performance recently. Now we combine Formula Racing to AI research: The following video shows we train a Reinforcement Learning policy to drive a Dallara F317 in Monza and Barcelona Circuits autonomously in simulation. You can think of it as optimizing a Qualifying lap: You want the car to run a single lap, no opponents, with the fastest speed, and shortest lap time. We open-source the code to train RL in a racing simulator with Assetto Corsa, a widely deployed platform for esports. We also train with human demonstrations with multiple expert drivers including a professional e-sports driver. Interestingly AI is not beating the professional yet, but close. See our open-sourced code, simulator, and data here:

Xiaolong Wang

32,361 görüntüleme • 1 yıl önce