Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

just made it possible to evaluate generalist robotics models like Octo at 60-100x real world evaluation speeds via gpu simulation and rendering (~10x faster than original cpu sim code). All videos below are from our open source ManiSkill GPU sim!

Stone_Tao's profile picture

Stone Tao

7,030 subscribers

13,456 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieNachrichten & PolitikBildung
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch
0:11

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch

NVIDIA Robotics

18,568 Aufrufe • vor 4 Monaten

Building robots that can effectively operate alongside human workers is difficult. 🛠️ Advances in open-source physics, open foundation models, and frameworks are helping accelerate physical #AI deployment. ✔️ Newton Physics Engine, an open-source GPU-powered simulation built on OpenUSD, speeds up robot learning for advanced manipulation and mobility. ✔️ NVIDIA Cosmos Reason, an open reasoning vision language model, gives robots the ability to think like humans using prior knowledge, common sense and physics ✔️NVIDIA Isaac GR00T N1.6, an open robot foundation model, enables humanoids to understand ambiguous instructions Leading robotics developers including Agility Robotics, Lightwheel, Mentee Robotics, UniversalRobots, and Wandelbots are adopting simulation technologies and libraries to accelerate physical AI development and deployment. Omniverse Ambassador Dylan Tobin built an AI chatbot trained on Isaac Sim workflows, helping devs navigate Omniverse faster. Read the full blog 👉
0:13

Building robots that can effectively operate alongside human workers is difficult. 🛠️ Advances in open-source physics, open foundation models, and frameworks are helping accelerate physical #AI deployment. ✔️ Newton Physics Engine, an open-source GPU-powered simulation built on OpenUSD, speeds up robot learning for advanced manipulation and mobility. ✔️ NVIDIA Cosmos Reason, an open reasoning vision language model, gives robots the ability to think like humans using prior knowledge, common sense and physics ✔️NVIDIA Isaac GR00T N1.6, an open robot foundation model, enables humanoids to understand ambiguous instructions Leading robotics developers including Agility Robotics, Lightwheel, Mentee Robotics, UniversalRobots, and Wandelbots are adopting simulation technologies and libraries to accelerate physical AI development and deployment. Omniverse Ambassador Dylan Tobin built an AI chatbot trained on Isaac Sim workflows, helping devs navigate Omniverse faster. Read the full blog 👉

NVIDIA

48,500 Aufrufe • vor 9 Monaten

Sand simulation in Unreal using Niagara GPU particles that take their velocity from the smoke sim to give it the swirling / spinning motion. All real-time. This will be covered in Niagara Automotive. I just opened the waitlist here:
0:10

Sand simulation in Unreal using Niagara GPU particles that take their velocity from the smoke sim to give it the swirling / spinning motion. All real-time. This will be covered in Niagara Automotive. I just opened the waitlist here:

Jesse Pitela

17,804 Aufrufe • vor 4 Monaten

GR00T-VisualSim2Real is now open source! VIRAL and DoorMan are now available with training code, simulation assets, and the full recipe for bringing visual sim-to-real loco-manipulation skills to your own humanoids. Repo:
0:15

GR00T-VisualSim2Real is now open source! VIRAL and DoorMan are now available with training code, simulation assets, and the full recipe for bringing visual sim-to-real loco-manipulation skills to your own humanoids. Repo:

Tairan He

117,809 Aufrufe • vor 2 Monaten

Robora Sim: A PyBullet-Powered Environment for Learning Robotic Physical Intelligence We are currently building our Robora simulation environment setup for our sim based learning, leveraging PyBullet, an industry-standard physics engine widely used in AI-driven robotics research and development. The environment is optimized with GPU-accelerated learning algorithms, enabling high-speed imitation learning and reinforcement learning within a safe and controlled virtual setup before shipping out to real world. This simulation platform allows our models to learn, adapt, and generalize across different robot morphologies, terrain types and task objectives - all before deployment to the real world. At it's core, the system combines a VLA-powered high-level planner with low-level motion control algorithms, working cohesively to produce emergent, physically intelligent behaviors. This synergy between simulation, learning, and real-world transfer marks a major step forward in our pursuit of adaptive and intelligent robotic systems. Through advanced domain randomization and synthetic data generation, the Robora Simulation Environment ensures that policies trained in simulation transfer effectively to real-world robots, minimizing the sim-to-real gap. Moreover, users will be able to test and integrate their own hardware kits within selected simulation environments in the Robora Dapp, ensuring seamless compatibility and safer real-world implementation.
0:14

Robora Sim: A PyBullet-Powered Environment for Learning Robotic Physical Intelligence We are currently building our Robora simulation environment setup for our sim based learning, leveraging PyBullet, an industry-standard physics engine widely used in AI-driven robotics research and development. The environment is optimized with GPU-accelerated learning algorithms, enabling high-speed imitation learning and reinforcement learning within a safe and controlled virtual setup before shipping out to real world. This simulation platform allows our models to learn, adapt, and generalize across different robot morphologies, terrain types and task objectives - all before deployment to the real world. At it's core, the system combines a VLA-powered high-level planner with low-level motion control algorithms, working cohesively to produce emergent, physically intelligent behaviors. This synergy between simulation, learning, and real-world transfer marks a major step forward in our pursuit of adaptive and intelligent robotic systems. Through advanced domain randomization and synthetic data generation, the Robora Simulation Environment ensures that policies trained in simulation transfer effectively to real-world robots, minimizing the sim-to-real gap. Moreover, users will be able to test and integrate their own hardware kits within selected simulation environments in the Robora Dapp, ensuring seamless compatibility and safer real-world implementation.

Robora

23,489 Aufrufe • vor 8 Monaten

How does high-fidelity tactile simulation help robots nail the last millimeter? We’re releasing VT-Refine, accepted to CoRL: a real-to-sim-to-real visuo-tactile policy using a GPU-parallel tactile sim for our piezoresistive skin FlexiTac. Then fine-tuning a diffusion policy with large-scale RL in simulation. Website: #CoRL2025 #RobotLearning #Sim2Real
0:17

How does high-fidelity tactile simulation help robots nail the last millimeter? We’re releasing VT-Refine, accepted to CoRL: a real-to-sim-to-real visuo-tactile policy using a GPU-parallel tactile sim for our piezoresistive skin FlexiTac. Then fine-tuning a diffusion policy with large-scale RL in simulation. Website: #CoRL2025 #RobotLearning #Sim2Real

Binghao Huang

46,982 Aufrufe • vor 8 Monaten

Microsoft killed the GPU mafia 🤯 They finally open-sourced their 1-bit LLM inference framework called bitnet.cpp. It lets you run 100B parameter models on your local CPU without GPUs. - 6.17x faster inference - 82.2% less energy on CPUs 100% Open Source.
0:13

Microsoft killed the GPU mafia 🤯 They finally open-sourced their 1-bit LLM inference framework called bitnet.cpp. It lets you run 100B parameter models on your local CPU without GPUs. - 6.17x faster inference - 82.2% less energy on CPUs 100% Open Source.

Oliver Prompts

1,627,912 Aufrufe • vor 5 Monaten

NVIDIA just made Pandas 150x faster with zero code changes. All you have to do is: %load_ext cudf.pandas import pandas as pd Their RAPIDS library will automatically know if you're running on GPU or CPU and speed up your processing. You can try it here: Repo:
0:19

NVIDIA just made Pandas 150x faster with zero code changes. All you have to do is: %load_ext cudf.pandas import pandas as pd Their RAPIDS library will automatically know if you're running on GPU or CPU and speed up your processing. You can try it here: Repo:

Lior Alexander

194,204 Aufrufe • vor 2 Jahren

my old GPU is screaming, anyway is rendering this real time, respect to old GPU / artists :)
0:17

my old GPU is screaming, anyway is rendering this real time, respect to old GPU / artists :)

Water flowing | anbello.eth | anbello.tez

17,089 Aufrufe • vor 7 Monaten

Introducing MuJoCo 3.0: a major new release of our fast, powerful and open source tool for robotics research. 🤖 📈 GPU & TPU acceleration through #JAX 🖼️ Better simulation of more diverse objects - like clothes, screws, gears and donuts 💡 Find out more:
0:11

Introducing MuJoCo 3.0: a major new release of our fast, powerful and open source tool for robotics research. 🤖 📈 GPU & TPU acceleration through #JAX 🖼️ Better simulation of more diverse objects - like clothes, screws, gears and donuts 💡 Find out more:

Google DeepMind

280,568 Aufrufe • vor 2 Jahren

Nintendo Switch 2: today we can finally confirm full specifications, CPU/GPU clock speeds and how much in the way of system resources are available to game developers:
0:19

Nintendo Switch 2: today we can finally confirm full specifications, CPU/GPU clock speeds and how much in the way of system resources are available to game developers:

Digital Foundry

97,291 Aufrufe • vor 1 Jahr

Introducing: DeCloud GPU Marketplace Dear Cloudians, We are thrilled to introduce another robust addition to the DeCloud Ecosystem, furthering our commitment to promoting decentralization at its pinnacle. The DeCloud GPU Marketplace is a cutting-edge platform designed to revolutionize the way you access and utilize GPU resources for your diverse computational needs. Users can harness the power of GPU resources for a multitude of purposes, including but not limited to: ^Mining various cryptocurrencies ^Utilizing AI/ML learning datasets ^Rendering high-resolution videos and 3D models Decentralization, Safety, and Privacy: At DeCloud, we prioritize decentralization, safety, and privacy. By providing access to different GPU providers and private connections, we ensure a secure and privacy-oriented system for our users. Your data and computational tasks are safeguarded within our decentralized DeCloud ecosystem.
0:17

Introducing: DeCloud GPU Marketplace Dear Cloudians, We are thrilled to introduce another robust addition to the DeCloud Ecosystem, furthering our commitment to promoting decentralization at its pinnacle. The DeCloud GPU Marketplace is a cutting-edge platform designed to revolutionize the way you access and utilize GPU resources for your diverse computational needs. Users can harness the power of GPU resources for a multitude of purposes, including but not limited to: ^Mining various cryptocurrencies ^Utilizing AI/ML learning datasets ^Rendering high-resolution videos and 3D models Decentralization, Safety, and Privacy: At DeCloud, we prioritize decentralization, safety, and privacy. By providing access to different GPU providers and private connections, we ensure a secure and privacy-oriented system for our users. Your data and computational tasks are safeguarded within our decentralized DeCloud ecosystem.

De Cloud

17,403 Aufrufe • vor 2 Jahren

it's open source time, with a real leap for world models 🎉 NVIDIA's SANA-WM: a camera-conditioned world model that fits on one GPU. 60s of 720p in 34s on a single 5090 - 2.6B params and Apache 2.0!
0:20

it's open source time, with a real leap for world models 🎉 NVIDIA's SANA-WM: a camera-conditioned world model that fits on one GPU. 60s of 720p in 34s on a single 5090 - 2.6B params and Apache 2.0!

Victor M

34,386 Aufrufe • vor 1 Monat

ROBA Compute is our GPU execution layer for robotics. A distributed infrastructure layer for simulation, training, inference, and autonomous workflows — built for our stack first, then opened to external builders. GPU rental is already a category. The missing layer is robotics-native infrastructure: templates, allocation, benchmarking, and persistent execution for embodied AI. That’s the opportunity. ROBA Compute is designed to become the infrastructure layer where robotics workloads actually run.
0:14

ROBA Compute is our GPU execution layer for robotics. A distributed infrastructure layer for simulation, training, inference, and autonomous workflows — built for our stack first, then opened to external builders. GPU rental is already a category. The missing layer is robotics-native infrastructure: templates, allocation, benchmarking, and persistent execution for embodied AI. That’s the opportunity. ROBA Compute is designed to become the infrastructure layer where robotics workloads actually run.

Roba Labs

18,382 Aufrufe • vor 13 Tagen

It’s live. AxonDAO’s GPU fleet is installed and will soon be rentable on the open market via vast.ai. Premium GPU capacity - 8x NVIDIA B200 and 8x RTX Pro 6000 - built for large-scale AI training, inference, rendering, and research workloads. 🧵
0:14

It’s live. AxonDAO’s GPU fleet is installed and will soon be rentable on the open market via vast.ai. Premium GPU capacity - 8x NVIDIA B200 and 8x RTX Pro 6000 - built for large-scale AI training, inference, rendering, and research workloads. 🧵

AxonDAO

17,583 Aufrufe • vor 4 Monaten

Trained a simple world model for my robot arm. It predicts the future over 20000 times faster than real time on a single NVIDIA RTX 3090 GPU (128 batch -> 160x faster each).
0:11

Trained a simple world model for my robot arm. It predicts the future over 20000 times faster than real time on a single NVIDIA RTX 3090 GPU (128 batch -> 160x faster each).

Alexander Koch

39,700 Aufrufe • vor 2 Jahren

Mole just shipped v1.31.0 Makima with faster performance and more accurate system status reporting. Huge thanks to all contributors. Still fully open source and free, made possible by the community effort behind it.
0:19

Mole just shipped v1.31.0 Makima with faster performance and more accurate system status reporting. Huge thanks to all contributors. Still fully open source and free, made possible by the community effort behind it.

Tw93

22,588 Aufrufe • vor 3 Monaten

Someone just built a desktop app that that generates 3D models from images and runs 100% locally. It's called Modly. It runs entirely on your GPU, no cloud, no API bills. Just drop an image and get a 3D mesh. 100% Open Source.
0:11

Someone just built a desktop app that that generates 3D models from images and runs 100% locally. It's called Modly. It runs entirely on your GPU, no cloud, no API bills. Just drop an image and get a 3D mesh. 100% Open Source.

How To Prompt

222,893 Aufrufe • vor 2 Monaten

Celebrating the #robotics community during #NationalRoboticsWeek. 👏 University of Washington's Wheeled Lab project is bringing sim-2-real #robotics to low-cost, open-source platforms using NVIDIA Isaac Lab. Learn more about their work ➡️
0:10

Celebrating the #robotics community during #NationalRoboticsWeek. 👏 University of Washington's Wheeled Lab project is bringing sim-2-real #robotics to low-cost, open-source platforms using NVIDIA Isaac Lab. Learn more about their work ➡️

NVIDIA Robotics

21,366 Aufrufe • vor 1 Jahr

What if you could turn a single 360° photo into a production-ready Isaac Sim environment in minutes? That's exactly what we did here. Using World Labs' Marble and an Insta360 X5 capture (rotating on top), we generated a complete navigable 3D environment and populated it with Lightwheel Sim Ready assets (bottom view). The result? A fully interactive scene in Isaac Sim, ready for sim2real testing,. Navigation, manipulation, or any robotics task you need to validate. What used to take weeks of manual 3D modeling and asset placement now takes minutes. Capture once in the real world, simulate everywhere in your training pipeline. This is the future of robotics development with world models. NVIDIA Robotics NVIDIA Omniverse #Sim2Real #Robotics #Simulation
0:15

What if you could turn a single 360° photo into a production-ready Isaac Sim environment in minutes? That's exactly what we did here. Using World Labs' Marble and an Insta360 X5 capture (rotating on top), we generated a complete navigable 3D environment and populated it with Lightwheel Sim Ready assets (bottom view). The result? A fully interactive scene in Isaac Sim, ready for sim2real testing,. Navigation, manipulation, or any robotics task you need to validate. What used to take weeks of manual 3D modeling and asset placement now takes minutes. Capture once in the real world, simulate everywhere in your training pipeline. This is the future of robotics development with world models. NVIDIA Robotics NVIDIA Omniverse #Sim2Real #Robotics #Simulation

Jonathan Stephens

46,593 Aufrufe • vor 6 Monaten