Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

This is a vertically integrated end to end deep neural network performing forward pass inference real-time, controlling individual actuator's torque output for bidpedal gait generation in adverse, GPS denied, envs. ok its standard PPO rl trained in mjlab, strapped to a tractor.

Sentdex's profile picture

Harrison Kinsley

101,538 subscribers

34,118 Aufrufe • vor 5 Monaten •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Optimus can now sort objects autonomously 🤖 Its neural network is trained fully end-to-end: video in, controls out. Come join to help develop Optimus (& improve its yoga routine 🧘) →
1:17

Optimus can now sort objects autonomously 🤖 Its neural network is trained fully end-to-end: video in, controls out. Come join to help develop Optimus (& improve its yoga routine 🧘) →

Tesla Optimus

14,209,054 Aufrufe • vor 2 Jahren

🧠Model-Based RL shows promises but has seen limited success in real-world robotics. 🌎Introducing Robotic World Model, a black-box end-to-end neural dynamics model that bridges this gap, where policies are trained purely in imagination. NeurIPS Conference 🎯
2:39

🧠Model-Based RL shows promises but has seen limited success in real-world robotics. 🌎Introducing Robotic World Model, a black-box end-to-end neural dynamics model that bridges this gap, where policies are trained purely in imagination. NeurIPS Conference 🎯

Chenhao Li

101,635 Aufrufe • vor 6 Monaten

Implemented a visualization for the neural network today. This is a neural network being trained to learn the snake game in a terminal. It's built in Rust using Ratatui More input details in thread
1:00

Implemented a visualization for the neural network today. This is a neural network being trained to learn the snake game in a terminal. It's built in Rust using Ratatui More input details in thread

Bones

165,655 Aufrufe • vor 1 Jahr

Here's your Saturday Indian tech white pill. - Aexo Aerospace has flown their UAV, Aer Genesis, 500+ times - lucidml built a neural network to simulate worlds in real time - perceptyne is showing off their vertically integrated semi-humanoid stack at India AI Impact Summit
2:58

Here's your Saturday Indian tech white pill. - Aexo Aerospace has flown their UAV, Aer Genesis, 500+ times - lucidml built a neural network to simulate worlds in real time - perceptyne is showing off their vertically integrated semi-humanoid stack at India AI Impact Summit

Runtime

48,322 Aufrufe • vor 3 Monaten

Individual Neuron: Neural Network A neuron in a neural network performs a weighted sum of inputs, adds a bias, and applies an activation function like sigmoid, ReLU, or tanh, introducing non-linearity. This output helps the neuron learn and represent patterns in the data.
0:54

Individual Neuron: Neural Network A neuron in a neural network performs a weighted sum of inputs, adds a bias, and applies an activation function like sigmoid, ReLU, or tanh, introducing non-linearity. This output helps the neuron learn and represent patterns in the data.

ₕₐₘₚₜₒₙ — e/acc

47,467 Aufrufe • vor 1 Jahr

This is a comparison video between LI and Tesla's autonomous driving systems. LI once claimed in 2024 that it had developed an end-to-end neural network better than Tesla's, but what the truth is, we can see it in this video.
27:30

This is a comparison video between LI and Tesla's autonomous driving systems. LI once claimed in 2024 that it had developed an end-to-end neural network better than Tesla's, but what the truth is, we can see it in this video.

𝐶ℎ𝑎𝑟𝑙𝑒𝑠

35,248 Aufrufe • vor 1 Jahr

Want to scale RL with your shiny new GPU? 🚀 In our ICML24 Oral we find that RL algorithms hit a barrier when data is scaled up. Our new algorithm, SAPG, proposes a simple fix. It scales to 25k envs and solves hard tasks where PPO makes no progress. 1/n
1:24

Want to scale RL with your shiny new GPU? 🚀 In our ICML24 Oral we find that RL algorithms hit a barrier when data is scaled up. Our new algorithm, SAPG, proposes a simple fix. It scales to 25k envs and solves hard tasks where PPO makes no progress. 1/n

Ananye Agarwal

64,403 Aufrufe • vor 1 Jahr

Brett Adcock says the latest autonomous demo of Figure 02 is fully end-to-end and uses a single neural network – camera frames in, actions out. “You cannot code your way out of this problem.”
2:30

Brett Adcock says the latest autonomous demo of Figure 02 is fully end-to-end and uses a single neural network – camera frames in, actions out. “You cannot code your way out of this problem.”

The Humanoid Hub

56,268 Aufrufe • vor 1 Jahr

I trained a neural network to mimic a forest trail near my apartment (web demo in the post)
1:43

I trained a neural network to mimic a forest trail near my apartment (web demo in the post)

Ollin Boer Bohan

118,074 Aufrufe • vor 1 Jahr

In a world of PPO everything for reinforcement learning, I've been tinkering with SAC for training a quadruped gait. This gait is trained purely on CPU (training on one of the Dell GB10s) on a single environment. Training any particular run is obviously slower than PPO on an RTX Pro 6000 with 8092 envs, if you already know the exact hyperparams/rwd function for your PPO algo... but, if we're honest with ourselves, then we know we usually spend days tuning our PPO algo and fighting it to do what we want. In contrast, SAC has kind of been a breath of fresh air, very amenable to changing the reward function to tune behavior. So far, my first attempts to tune things have consistently just worked immediately rather than 15 different variations of reward hacking only to find previous tuned behaviors got lost in the process. There is also FastSAC, which I've not yet tried, but can speed things up potentially and introduce scale back into the equation. My main painpoint in getting SAC to work for gait was actually getting it to learn to step. It seems as though SAC is not as good as PPO at significant exploration on its own. I ended up starting with a sinusoidal gait (basically just a rule to make legs swing) as training wheels then blended it out through training as phase 1, then began working on smoothing things out after this. I think if we look at end to end dev time rather than any particular run that finally managed to work, SAC may actually be the "faster" algorithm to train. Quadruped gaits are inherently easier than bipedal and maybe there are areas where SAC falls short, but I'll definitely be spending more time with SAC.
1:02

In a world of PPO everything for reinforcement learning, I've been tinkering with SAC for training a quadruped gait. This gait is trained purely on CPU (training on one of the Dell GB10s) on a single environment. Training any particular run is obviously slower than PPO on an RTX Pro 6000 with 8092 envs, if you already know the exact hyperparams/rwd function for your PPO algo... but, if we're honest with ourselves, then we know we usually spend days tuning our PPO algo and fighting it to do what we want. In contrast, SAC has kind of been a breath of fresh air, very amenable to changing the reward function to tune behavior. So far, my first attempts to tune things have consistently just worked immediately rather than 15 different variations of reward hacking only to find previous tuned behaviors got lost in the process. There is also FastSAC, which I've not yet tried, but can speed things up potentially and introduce scale back into the equation. My main painpoint in getting SAC to work for gait was actually getting it to learn to step. It seems as though SAC is not as good as PPO at significant exploration on its own. I ended up starting with a sinusoidal gait (basically just a rule to make legs swing) as training wheels then blended it out through training as phase 1, then began working on smoothing things out after this. I think if we look at end to end dev time rather than any particular run that finally managed to work, SAC may actually be the "faster" algorithm to train. Quadruped gaits are inherently easier than bipedal and maybe there are areas where SAC falls short, but I'll definitely be spending more time with SAC.

Harrison Kinsley

26,726 Aufrufe • vor 3 Monaten

🌎World models can predict, but controlling real robots from imagination sees a long-standing failure due to hallucination. 🧠Introducing Uncertainty-Aware RWM: a black-box, end-to-end neural dynamics model with long-horizon uncertainty propagation. 🎯
2:18

🌎World models can predict, but controlling real robots from imagination sees a long-standing failure due to hallucination. 🧠Introducing Uncertainty-Aware RWM: a black-box, end-to-end neural dynamics model with long-horizon uncertainty propagation. 🎯

Chenhao Li

54,651 Aufrufe • vor 4 Monaten

Tesla is making a hugely ambitious leap with their upcoming Tesla FSD beta v12 which will use an end-to-end neural network approach for full self driving. Spoke with jimmah to discuss this game-changing move. (video released first on X and then on YouTube in a few hours)
2:01:10

Tesla is making a hugely ambitious leap with their upcoming Tesla FSD beta v12 which will use an end-to-end neural network approach for full self driving. Spoke with jimmah to discuss this game-changing move. (video released first on X and then on YouTube in a few hours)

Dave Lee

257,762 Aufrufe • vor 2 Jahren

This is what a real dad looks like. It’s not ok and this madness needs to end!
1:55

This is what a real dad looks like. It’s not ok and this madness needs to end!

katy 🌸

14,134 Aufrufe • vor 1 Jahr

Long video generation is a systems problem. Introducing LongLive-2.0 from NVIDIA Research: an end-to-end NVFP4 training and inference system for long video generation. Low-precision deployment often relies on post-training quantization, creating a gap between how models are trained and how they run. LongLive-2.0 aligns NVFP4-aware training, distillation, and W4A4 inference, maintaining strong benchmark quality while improving speed and memory efficiency.
0:59

Long video generation is a systems problem. Introducing LongLive-2.0 from NVIDIA Research: an end-to-end NVFP4 training and inference system for long video generation. Low-precision deployment often relies on post-training quantization, creating a gap between how models are trained and how they run. LongLive-2.0 aligns NVFP4-aware training, distillation, and W4A4 inference, maintaining strong benchmark quality while improving speed and memory efficiency.

NVIDIA AI

60,212 Aufrufe • vor 19 Tagen

Figure just released one of the most impressive humanoid demos yet. Figure 02 autonomously unloaded and reloaded a dishwasher, end to end. All powered by a single neural network controlling the entire robot. But here's ONE thing no one noticed behind the scenes:
3:36

Figure just released one of the most impressive humanoid demos yet. Figure 02 autonomously unloaded and reloaded a dishwasher, end to end. All powered by a single neural network controlling the entire robot. But here's ONE thing no one noticed behind the scenes:

Elad Inbar

233,876 Aufrufe • vor 4 Monaten

To end the Tanker Mafia in Delhi, Minister Sh. Parvesh Sahib Singh launched 1,111 GPS-enabled water tankers. A dedicated GPS tracking centre has also been set up at the Delhi Jal Board office to monitor every tanker in real time.
0:55

To end the Tanker Mafia in Delhi, Minister Sh. Parvesh Sahib Singh launched 1,111 GPS-enabled water tankers. A dedicated GPS tracking centre has also been set up at the Delhi Jal Board office to monitor every tanker in real time.

Tajinder Bagga

15,364 Aufrufe • vor 1 Jahr

For the first time in over 150 years, Louisville’s majority-Black West End has its own hospital — thanks to the vision of a Black woman, Corenza Townsend! This is what real investment in Black communities looks like!
3:00

For the first time in over 150 years, Louisville’s majority-Black West End has its own hospital — thanks to the vision of a Black woman, Corenza Townsend! This is what real investment in Black communities looks like!

Ben Crump

45,431 Aufrufe • vor 1 Jahr

San Mateo, California–based Generalist showcases their real-time, end-to-end neural network that controls robots at 100Hz for dexterous manipulation tasks. The model handles fine-motor control, bi-manual coordination, tool use, and generalization across arms and environments.
2:21

San Mateo, California–based Generalist showcases their real-time, end-to-end neural network that controls robots at 100Hz for dexterous manipulation tasks. The model handles fine-motor control, bi-manual coordination, tool use, and generalization across arms and environments.

The Humanoid Hub

42,524 Aufrufe • vor 11 Monaten

this is why Jason hires just Forward Deployed Engineer!! Palantir coined the term FDE to give customer, engineering, end to end ownership of the product now, this is industry standard haha!!
0:32

this is why Jason hires just Forward Deployed Engineer!! Palantir coined the term FDE to give customer, engineering, end to end ownership of the product now, this is industry standard haha!!

Harnoor Singh

29,347 Aufrufe • vor 1 Monat

Excited to share Flow Matching Policy Gradients: expressive RL policies trained from rewards using flow matching. It’s an easy, drop-in replacement for Gaussian PPO on control tasks.
0:29

Excited to share Flow Matching Policy Gradients: expressive RL policies trained from rewards using flow matching. It’s an easy, drop-in replacement for Gaussian PPO on control tasks.

David McAllister

150,389 Aufrufe • vor 10 Monaten