Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Led by Google DeepMind, we present ALOHA 2 🤙: An Enhanced Low-Cost Hardware for Bimanual Teleoperation. ALOHA 2 🤙 significantly improves the durability of the original ALOHA 🏖️, enabling fleet-scale data collection on more complex tasks. As usual, everything is open-sourced!

tonyzzhao's profile picture

Tony Zhao

148,920 subscribers

144,185 görüntüleme • 2 yıl önce •via X (Twitter)

Bilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

10 Yorum

Tony Z. Zhao profil fotoğrafı
Tony Z. Zhao2 yıl önce

Before diving into the hardware, we also release a *proper* ALOHA sim model with SysID, thanks to @kevin_zakka @the_real_btaba @ayzwah. Even if you don’t have the hardware, there is now a way to perform complex tasks with ALOHA in Mujoco!

Tony Z. Zhao profil fotoğrafı
Tony Z. Zhao2 yıl önce

We start by improving the grippers: to make them grasp better and more robust. We use a low-friction rail design that transmits 2x more force to the gripper tips. We also change the grip tape layout to improve grasping of small objects. Led by @SpencerGoodric6 and Thinh Nguyen

Tony Z. Zhao profil fotoğrafı
Tony Z. Zhao2 yıl önce

We use the same rail design on the leader side. To further improve ergonomics, we replace the original servo with a lower gear ratio one that is easier to backdrive. This results in a 10x reduction in friction that the operator needs to overcome when opening grippers!

Tony Z. Zhao profil fotoğrafı
Tony Z. Zhao2 yıl önce

Next, we improve the gravity compensation of the leader arm. With a constant-force retractor and a spring-pulley system, the arm can "float" in most places. It is also much more durable than the original rubberbands!

Tony Z. Zhao profil fotoğrafı
Tony Z. Zhao2 yıl önce

Last but not least: we simplify the frame surrounding the workcell while maintaining the rigidity of the camera mounting points. This opens up the space for both human-robot collaborators and props for the robot to interact with.

Tony Z. Zhao profil fotoğrafı
Tony Z. Zhao2 yıl önce

To learn more, please visit our website: Paper: Tutorial: Designs: Sim:

Tony Z. Zhao profil fotoğrafı
Tony Z. Zhao2 yıl önce

Thanks to the core ALOHA 2 Team: @RandomRobotics @chelseabfinn @peteflorence @SpencerGoodric6 Thinh Nguyen @JonathanTompson @ayzwah @tonyzzhao and those who helped with hardware, software, data, simulation, and user studies: Jorge Aldaco, Robert Baruch, Jeff Bingham, Sanky Chan, Kenneth Draper, @debidatta, Wayne Gramlich, Torr Hage, @AlexHerzog00, Jonathan Hoech, Ian Storz, @the_real_btaba, @leilatakayama, Ted Wahrburg, Sichun Xu, Sergey Yaroshenko, and @kevin_zakka

Masato Kobayashi @るっと🐺 profil fotoğrafı
Masato Kobayashi @るっと🐺2 yıl önce

@GoogleDeepMind @tonyzzhao This is an incredibly fantastic achievement! I'm excited! Please look forward to our report on interesting research about imitation learning as well! This is part of that research.

Brett Adcock profil fotoğrafı
Brett Adcock2 yıl önce

@GoogleDeepMind good work Tony / team

Keerthana Gopalakrishnan profil fotoğrafı
Keerthana Gopalakrishnan2 yıl önce

@GoogleDeepMind lmfao @peteflorence and @andyzeng_ 🤣

Benzer Videolar

ALOHA is an open-source hardware System for bimanual teleoperation. With a $20k budget, it is capable of teleoperating precise dexterity tasks like these ones [source, read more:
0:57

ALOHA is an open-source hardware System for bimanual teleoperation. With a $20k budget, it is capable of teleoperating precise dexterity tasks like these ones [source, read more:

Massimo

193,754 görüntüleme • 3 yıl önce

For the past year we've been working on ALOHA Unleashed 🌋 Google DeepMind - pushing the scale and dexterity of tasks on our ALOHA 2 fleet. Here is a thread with some of the coolest videos! The first task is hanging a shirt on a hanger (autonomous 1x)
0:33

For the past year we've been working on ALOHA Unleashed 🌋 Google DeepMind - pushing the scale and dexterity of tasks on our ALOHA 2 fleet. Here is a thread with some of the coolest videos! The first task is hanging a shirt on a hanger (autonomous 1x)

Ayzaan Wahid

141,119 görüntüleme • 2 yıl önce

Robotics is still data starved. Collecting high-quality robot demonstrations remains brutally slow and expensive. Introducing COBALT: A cloud-native teleoperation platform designed for large-scale robot learning. We are democratizing data collection by leveraging the hardware everyone already owns: the smartphone All you need is to download an app (today)! Read on for more!
0:39

Robotics is still data starved. Collecting high-quality robot demonstrations remains brutally slow and expensive. Introducing COBALT: A cloud-native teleoperation platform designed for large-scale robot learning. We are democratizing data collection by leveraging the hardware everyone already owns: the smartphone All you need is to download an app (today)! Read on for more!

Animesh Garg

104,553 görüntüleme • 4 ay önce

Enough with LLMs - exciting things are happening in the world of atoms. This is Stanford ALOHA, a low-cost and agile robot platform. The whole system is open-source (!!): hardware design, CAD models for 3D printing, simulator, and training code. Time to graft a physical arm onto GPTs 🦾 Led by my friend Tony Zhao at Stanford, and advised by Chelsea Finn Sergey Levine Vikash Kumar ✈️IROS2026. Project page: If you don't want to 3D print your own components, you can buy the setup at
1:46

Enough with LLMs - exciting things are happening in the world of atoms. This is Stanford ALOHA, a low-cost and agile robot platform. The whole system is open-source (!!): hardware design, CAD models for 3D printing, simulator, and training code. Time to graft a physical arm onto GPTs 🦾 Led by my friend Tony Zhao at Stanford, and advised by Chelsea Finn Sergey Levine Vikash Kumar ✈️IROS2026. Project page: If you don't want to 3D print your own components, you can buy the setup at

Jim Fan

818,862 görüntüleme • 3 yıl önce

🎉Excited to share a fun little hardware project we’ve been working on. GELLO is an intuitive and low cost teleoperation device for robot arms that costs less than $300. We've seen the importance of data quality in imitation learning. Our goal is to make this more accessible 1/n
0:50

🎉Excited to share a fun little hardware project we’ve been working on. GELLO is an intuitive and low cost teleoperation device for robot arms that costs less than $300. We've seen the importance of data quality in imitation learning. Our goal is to make this more accessible 1/n

Philipp Wu

163,101 görüntüleme • 3 yıl önce

Gemini Robotics 2 by Google DeepMind uses sim-only post-training on a mixed-data base model to handle automotive kitting. Contact-rich tasks like these have long been considered one of the hardest challenges in Sim2Real. Gemini Robotics 2 shows simulation can work even here. General robot intelligence needs much more data than real-robot collection alone can provide. Simulation has proven to be an effective way to fill that gap.
2:31

Gemini Robotics 2 by Google DeepMind uses sim-only post-training on a mixed-data base model to handle automotive kitting. Contact-rich tasks like these have long been considered one of the hardest challenges in Sim2Real. Gemini Robotics 2 shows simulation can work even here. General robot intelligence needs much more data than real-robot collection alone can provide. Simulation has proven to be an effective way to fill that gap.

Axis Robotics

16,857 görüntüleme • 1 ay önce

Jensen Huang open-sourced NVIDIA's flagship AI model, its weights, its data, AND how they created it. "We open sourced the models," Huang says. "We open sourced the weights." "We open sourced the data." "We open sourced how we created it." Four layers of openness in one model release. "Open source is fundamentally necessary for many industries to join the AI revolution." "NVIDIA has the scale and the motivation to build and continue to build these AI models for as long as we shall live." The chip seller benefits when every model is open. NVIDIA is the chip seller. P.S. I made a playbook breaking down 100+ most powerful decision making mental models used by history's greatest thinkers. 5,000+ downloads. 113 five-star reviews. Grab a free copy here: If you're new here, follow GeniusThinking for content on the greatest minds in economics, psychology, and history. — Jensen Huang ( NVIDIA ), NVIDIA CEO, on Lex Fridman's ( Lex Fridman ) podcast
1:29

Jensen Huang open-sourced NVIDIA's flagship AI model, its weights, its data, AND how they created it. "We open sourced the models," Huang says. "We open sourced the weights." "We open sourced the data." "We open sourced how we created it." Four layers of openness in one model release. "Open source is fundamentally necessary for many industries to join the AI revolution." "NVIDIA has the scale and the motivation to build and continue to build these AI models for as long as we shall live." The chip seller benefits when every model is open. NVIDIA is the chip seller. P.S. I made a playbook breaking down 100+ most powerful decision making mental models used by history's greatest thinkers. 5,000+ downloads. 113 five-star reviews. Grab a free copy here: If you're new here, follow GeniusThinking for content on the greatest minds in economics, psychology, and history. — Jensen Huang ( NVIDIA ), NVIDIA CEO, on Lex Fridman's ( Lex Fridman ) podcast

GeniusThinking

14,769 görüntüleme • 3 ay önce

Meta presents Sapiens Foundation for Human Vision Models discuss: We present Sapiens, a family of models for four fundamental human-centric vision tasks - 2D pose estimation, body-part segmentation, depth estimation, and surface normal prediction. Our models natively support 1K high-resolution inference and are extremely easy to adapt for individual tasks by simply fine-tuning models pretrained on over 300 million in-the-wild human images. We observe that, given the same computational budget, self-supervised pretraining on a curated dataset of human images significantly boosts the performance for a diverse set of human-centric tasks. The resulting models exhibit remarkable generalization to in-the-wild data, even when labeled data is scarce or entirely synthetic. Our simple model design also brings scalability - model performance across tasks improves as we scale the number of parameters from 0.3 to 2 billion. Sapiens consistently surpasses existing baselines across various human-centric benchmarks. We achieve significant improvements over the prior state-of-the-art on Humans-5K (pose) by 7.6 mAP, Humans-2K (part-seg) by 17.1 mIoU, Hi4D (depth) by 22.4% relative RMSE, and THuman2 (normal) by 53.5% relative angular error.
2:00

Meta presents Sapiens Foundation for Human Vision Models discuss: We present Sapiens, a family of models for four fundamental human-centric vision tasks - 2D pose estimation, body-part segmentation, depth estimation, and surface normal prediction. Our models natively support 1K high-resolution inference and are extremely easy to adapt for individual tasks by simply fine-tuning models pretrained on over 300 million in-the-wild human images. We observe that, given the same computational budget, self-supervised pretraining on a curated dataset of human images significantly boosts the performance for a diverse set of human-centric tasks. The resulting models exhibit remarkable generalization to in-the-wild data, even when labeled data is scarce or entirely synthetic. Our simple model design also brings scalability - model performance across tasks improves as we scale the number of parameters from 0.3 to 2 billion. Sapiens consistently surpasses existing baselines across various human-centric benchmarks. We achieve significant improvements over the prior state-of-the-art on Humans-5K (pose) by 7.6 mAP, Humans-2K (part-seg) by 17.1 mIoU, Hi4D (depth) by 22.4% relative RMSE, and THuman2 (normal) by 53.5% relative angular error.

AK

151,614 görüntüleme • 2 yıl önce

This is how ALOHA's "teleoperation" system works - a fancy word for "remote control". Training robots will be more and more like playing games in the physical world. A human operates a "joystick++" to perform tasks and collect data, or intervene if there's any safety concern. There's actually a learning curve to master the controller, much like practicing gaming skills. Teleoperation can be done in many different ways. ALOHA is an impressive custom-built system with very low cost. Here're a few alternatives: (1) Motion Capture (MoCap): apply the MoCap systems used for Hollywood movies to capture the fine-grained motions of hand joints. There would be no "embodiment gap" if the robot hand has 5 fingers. For instance, a demonstrator can wear a CyberGlove ( and manipulate the objects. CyberGlove will capture the motion signals & haptic feedback in real-time, which can be re-targeted onto the humanoid. (2) Wearing gloves & markers can be clumsy. An alternative way to do MoCap is through computer vision. DexPilot from NVIDIA enables marker-less and glove-free data collection. The human operator simply uses their bare hands to perform the tasks. 4 Intel RealSense depth cameras and 2 NVIDIA Titan XP GPUs (yeah, 2019 work) translate the pixels to precise motion signals for robot learning. (3) VR Headset: turn the training room into a VR game and "role play" the robot. This has the advantage of scalable remote data collection - annotators from around the world can contribute without coming onsite. VR demonstration technique appeared in research projects like the iGibson home robot simulator, an initiative that I participated in at Stanford: Behind-the-scene video by Litian Liang
0:52

This is how ALOHA's "teleoperation" system works - a fancy word for "remote control". Training robots will be more and more like playing games in the physical world. A human operates a "joystick++" to perform tasks and collect data, or intervene if there's any safety concern. There's actually a learning curve to master the controller, much like practicing gaming skills. Teleoperation can be done in many different ways. ALOHA is an impressive custom-built system with very low cost. Here're a few alternatives: (1) Motion Capture (MoCap): apply the MoCap systems used for Hollywood movies to capture the fine-grained motions of hand joints. There would be no "embodiment gap" if the robot hand has 5 fingers. For instance, a demonstrator can wear a CyberGlove ( and manipulate the objects. CyberGlove will capture the motion signals & haptic feedback in real-time, which can be re-targeted onto the humanoid. (2) Wearing gloves & markers can be clumsy. An alternative way to do MoCap is through computer vision. DexPilot from NVIDIA enables marker-less and glove-free data collection. The human operator simply uses their bare hands to perform the tasks. 4 Intel RealSense depth cameras and 2 NVIDIA Titan XP GPUs (yeah, 2019 work) translate the pixels to precise motion signals for robot learning. (3) VR Headset: turn the training room into a VR game and "role play" the robot. This has the advantage of scalable remote data collection - annotators from around the world can contribute without coming onsite. VR demonstration technique appeared in research projects like the iGibson home robot simulator, an initiative that I participated in at Stanford: Behind-the-scene video by Litian Liang

Jim Fan

124,783 görüntüleme • 2 yıl önce

We might be solving the wrong problem in robotics. That’s what this makes clear. UMI → Universal Manipulation Interface A simple $400 gripper that lets you teach robots by demonstration. You hold it like a tool. Show the task. The robot learns. No teleoperation. No expensive hardware. No robot-specific data. Stanford open-sourced everything → hardware, code, datasets. What stands out to me is the bottleneck. Not algorithms. Data. Teleoperation → ~35 demos/hour UMI → ~111 demos/hour And the data transfers across robots → UR5, Franka, others. The design is surprisingly practical: → GoPro fisheye lens (155° FOV) + mirrors for depth → SLAM + IMU for precise 6DoF tracking → latency matching for dynamic tasks → diffusion policies for multimodal actions Then it scales. Cheng Chi takes this further with Sunday Robotics (with Tony Zhao). A $200 glove → deployed in 500+ homes → ~10 million real-world interactions. Not lab data. Real human behavior. Their robot learns dishes, laundry, espresso → with zero robot-specific data. This is where the shift becomes obvious. From training robots in controlled environments → to learning directly from humans at scale So here’s the real question: Will robotics be unlocked by better models… or by unlocking data? #ArtificialIntelligence #Robotics #AI #Innovation #FutureOfWork
0:20

We might be solving the wrong problem in robotics. That’s what this makes clear. UMI → Universal Manipulation Interface A simple $400 gripper that lets you teach robots by demonstration. You hold it like a tool. Show the task. The robot learns. No teleoperation. No expensive hardware. No robot-specific data. Stanford open-sourced everything → hardware, code, datasets. What stands out to me is the bottleneck. Not algorithms. Data. Teleoperation → ~35 demos/hour UMI → ~111 demos/hour And the data transfers across robots → UR5, Franka, others. The design is surprisingly practical: → GoPro fisheye lens (155° FOV) + mirrors for depth → SLAM + IMU for precise 6DoF tracking → latency matching for dynamic tasks → diffusion policies for multimodal actions Then it scales. Cheng Chi takes this further with Sunday Robotics (with Tony Zhao). A $200 glove → deployed in 500+ homes → ~10 million real-world interactions. Not lab data. Real human behavior. Their robot learns dishes, laundry, espresso → with zero robot-specific data. This is where the shift becomes obvious. From training robots in controlled environments → to learning directly from humans at scale So here’s the real question: Will robotics be unlocked by better models… or by unlocking data? #ArtificialIntelligence #Robotics #AI #Innovation #FutureOfWork

Pascal Bornet

186,783 görüntüleme • 5 ay önce

Announcing Mantis UMI, a pair of handheld data collection grippers for teams working on physical AI. Collect accurate bimanual manipulation data in the real world 10× faster than teleoperation. Mantis uses the exact same grippers as Axol, so you can feel what Axol feels. Data collected with Mantis transfers directly to Axol. Mantis runs on Open Source software and is modular so you can chose the tracker that works best you: Vive Tracker, Quest Controllers, and more. Collect it. Train it. Run it on Axol. Available Today 👇
0:29

Announcing Mantis UMI, a pair of handheld data collection grippers for teams working on physical AI. Collect accurate bimanual manipulation data in the real world 10× faster than teleoperation. Mantis uses the exact same grippers as Axol, so you can feel what Axol feels. Data collected with Mantis transfers directly to Axol. Mantis runs on Open Source software and is modular so you can chose the tracker that works best you: Vive Tracker, Quest Controllers, and more. Collect it. Train it. Run it on Axol. Available Today 👇

Almond Robotics

30,368 görüntüleme • 1 ay önce

Chamath Palihapitiya said Kimi K2.5 is going to save 90% of the cost, mentioning it as a winning moment for open-source models. Some notes from the latest All-In Podcast: > Natively supports video-to-code > 256K massive context windows > Open-sourced their "Agent Swarm" feature > Allows 100+ sub-agents to solve complex tasks by running 1,500 steps in parallel > Available to everyone, frontier-level reasoning (#1 on LLM Leaderboard, via OpenRouter) It is a major shift where open source is now challenging the dominance of closed-source models.
2:02

Chamath Palihapitiya said Kimi K2.5 is going to save 90% of the cost, mentioning it as a winning moment for open-source models. Some notes from the latest All-In Podcast: > Natively supports video-to-code > 256K massive context windows > Open-sourced their "Agent Swarm" feature > Allows 100+ sub-agents to solve complex tasks by running 1,500 steps in parallel > Available to everyone, frontier-level reasoning (#1 on LLM Leaderboard, via OpenRouter) It is a major shift where open source is now challenging the dominance of closed-source models.

Poonam Soni

56,165 görüntüleme • 7 ay önce

Today, we enable AutoResearch in the physical world for the first time! Introducing ENPIRE: we give 8 Codex agents a fleet of robots, an allocation of GPUs, and generous token budget. We set them free with a simple goal: solve the task as quickly as possible, keep the robots busy but stay safe, don't waste precious compute. Make no mistake. Then humans step aside and our watch begins. The robot fleet starts to come alive: they learn to look for visual clues, reset the scene, practice novel skills, tinker with control stack, read papers online, debate, reflect, get stuck, and try again directly on the hardware. All we did is to give Codex an API to the world of atoms, and the rest is emergence. ENPIRE is able to solve high-precision tasks like tying zip-ties, organizing fine pins, and installing GPUs all by itself. We also discovered a new type of "physical scaling": 8 robots exploring in parallel improves significantly faster than fewer ones. A part of our NVIDIA GEAR lab now self-improves tirelessly over night. We just read the reports in the morning. /goal: we all take a holiday and Jensen wouldn't even notice ;) We will be open-sourcing everything, so you can host your self-running robot lab at home too! Deep dive in the thread:
1:15

Today, we enable AutoResearch in the physical world for the first time! Introducing ENPIRE: we give 8 Codex agents a fleet of robots, an allocation of GPUs, and generous token budget. We set them free with a simple goal: solve the task as quickly as possible, keep the robots busy but stay safe, don't waste precious compute. Make no mistake. Then humans step aside and our watch begins. The robot fleet starts to come alive: they learn to look for visual clues, reset the scene, practice novel skills, tinker with control stack, read papers online, debate, reflect, get stuck, and try again directly on the hardware. All we did is to give Codex an API to the world of atoms, and the rest is emergence. ENPIRE is able to solve high-precision tasks like tying zip-ties, organizing fine pins, and installing GPUs all by itself. We also discovered a new type of "physical scaling": 8 robots exploring in parallel improves significantly faster than fewer ones. A part of our NVIDIA GEAR lab now self-improves tirelessly over night. We just read the reports in the morning. /goal: we all take a holiday and Jensen wouldn't even notice ;) We will be open-sourcing everything, so you can host your self-running robot lab at home too! Deep dive in the thread:

Jim Fan

681,561 görüntüleme • 3 ay önce

I was really impressed by the UMI gripper (Cheng Chi et al.), but a key limitation is that **force-related data wasn’t captured**: humans feel haptic feedback through the mechanical springs, but the robot couldn’t leverage that info, limiting the data’s value for fine-grained manipulation tasks. Led by my amazing students Yolanda Zhu and Binghao Huang, we designed a **portable visuo-tactile gripper** by integrating our dense, flexible tactile arrays with the UMI gripper to enable large-scale in-the-wild data collection. 🔗 We demonstrate **cross-modal representation learning** and **downstream policy learning** on tasks requiring in-hand state estimation (e.g., test tube reorientation) and fine-grained force sensing (e.g., pipette fluid transfer). Key takeaways: - Our flexible tactile arrays store the rich haptic information humans perceive as dense tactile signals. - Portability and robustness are key for in-the-wild data collection; our portable gripper is compact, lightweight, and durable. - Touch provides precise, robust measurements of in-hand object pose, invariant to lighting and viewpoint. - Cross-modal pretraining on large-scale in-the-wild data significantly improves policy robustness and sample efficiency (as shown many times before — and verified again here!). Also check out our previous investigations of dense, flexible tactile grids for understanding human-robot-environment interactions: - Dense tactile glove (Nature ’19): - 3D-ViTac (CoRL ’24):
5:35

I was really impressed by the UMI gripper (Cheng Chi et al.), but a key limitation is that **force-related data wasn’t captured**: humans feel haptic feedback through the mechanical springs, but the robot couldn’t leverage that info, limiting the data’s value for fine-grained manipulation tasks. Led by my amazing students Yolanda Zhu and Binghao Huang, we designed a **portable visuo-tactile gripper** by integrating our dense, flexible tactile arrays with the UMI gripper to enable large-scale in-the-wild data collection. 🔗 We demonstrate **cross-modal representation learning** and **downstream policy learning** on tasks requiring in-hand state estimation (e.g., test tube reorientation) and fine-grained force sensing (e.g., pipette fluid transfer). Key takeaways: - Our flexible tactile arrays store the rich haptic information humans perceive as dense tactile signals. - Portability and robustness are key for in-the-wild data collection; our portable gripper is compact, lightweight, and durable. - Touch provides precise, robust measurements of in-hand object pose, invariant to lighting and viewpoint. - Cross-modal pretraining on large-scale in-the-wild data significantly improves policy robustness and sample efficiency (as shown many times before — and verified again here!). Also check out our previous investigations of dense, flexible tactile grids for understanding human-robot-environment interactions: - Dense tactile glove (Nature ’19): - 3D-ViTac (CoRL ’24):

Yunzhu Li

13,510 görüntüleme • 1 yıl önce

1/5 🚀 Thrilled to open-source OSCAR 🤖 — an action-conditioned world model for robotics, led by the visiting student in my group Zhuoyuan Wu! It generalizes across different robot embodiments with precise action controllability. All trained on a single GH200 GPU, and outperforms existing open-sourced baselines, which have larger model capacity and need more compute. Everything is public, including training data. 📄 Paper: 🌐 Project: 💻 Code: 🤗 Robot data: 🤗 Human data: 🤗 Weights: #Robotics #WorldModels #AI #OpenSource
0:31

1/5 🚀 Thrilled to open-source OSCAR 🤖 — an action-conditioned world model for robotics, led by the visiting student in my group Zhuoyuan Wu! It generalizes across different robot embodiments with precise action controllability. All trained on a single GH200 GPU, and outperforms existing open-sourced baselines, which have larger model capacity and need more compute. Everything is public, including training data. 📄 Paper: 🌐 Project: 💻 Code: 🤗 Robot data: 🤗 Human data: 🤗 Weights: #Robotics #WorldModels #AI #OpenSource

Jun Gao

105,082 görüntüleme • 3 ay önce

Upstream Data has a new software initiative starting with our LoadSync™ industrial bitcoin mining controller. We converted from PLC controls to a much more scalable embedded Linux based architecture. This project is led by b_rowan and James Hilliard. Brett gives an overview of what it can do today, but there's so much more coming soon! LoadSync is just the beginning of our software plans, I can't wait to show you what we have in store. Our long term goal for LoadSync is to have a drop-in product for every bitcoin mine on the planet at any scale. A complete fleet management tool for everything associated with a bitcoin mining load. LoadSync is built upon an open source library also maintained by Brett, called PyASIC. More and more bitcoin miners are integrating PyASIC every day, you should too! Go find it on GitHub. At Upstream Data we intend to continue leading the industry in technology, product application and high performance bitcoin mining infrastructure.
10:36

Upstream Data has a new software initiative starting with our LoadSync™ industrial bitcoin mining controller. We converted from PLC controls to a much more scalable embedded Linux based architecture. This project is led by b_rowan and James Hilliard. Brett gives an overview of what it can do today, but there's so much more coming soon! LoadSync is just the beginning of our software plans, I can't wait to show you what we have in store. Our long term goal for LoadSync is to have a drop-in product for every bitcoin mine on the planet at any scale. A complete fleet management tool for everything associated with a bitcoin mining load. LoadSync is built upon an open source library also maintained by Brett, called PyASIC. More and more bitcoin miners are integrating PyASIC every day, you should too! Go find it on GitHub. At Upstream Data we intend to continue leading the industry in technology, product application and high performance bitcoin mining infrastructure.

Steve Barbour

27,049 görüntüleme • 2 yıl önce

Open-source robot arm meets hand tracking [📍GitHub below] It is designed with an industrial mindset but built as a 3D-printed desktop system. PAROL6 paired with a LEAP Motion controller is a nice example of how accessible robot teleoperation has become. • Hand motion is streamed to the robot at 100 Hz via UDP • A pneumatic gripper is controlled by simple fist open and close gestures • The entire robot stack is open source, from mechanics to control software Combine that with low-latency hand tracking and you get a very practical platform for learning manipulation, teleoperation, and human-robot interfaces. This kind of setup is great for experimentation, teleop, data collection, and teaching robots by demonstration All without proprietary hardware or locked software. Credit to SourceRobotics 📍Code: —— Weekly robotics and AI insights. Subscribe free:
0:35

Open-source robot arm meets hand tracking [📍GitHub below] It is designed with an industrial mindset but built as a 3D-printed desktop system. PAROL6 paired with a LEAP Motion controller is a nice example of how accessible robot teleoperation has become. • Hand motion is streamed to the robot at 100 Hz via UDP • A pneumatic gripper is controlled by simple fist open and close gestures • The entire robot stack is open source, from mechanics to control software Combine that with low-latency hand tracking and you get a very practical platform for learning manipulation, teleoperation, and human-robot interfaces. This kind of setup is great for experimentation, teleop, data collection, and teaching robots by demonstration All without proprietary hardware or locked software. Credit to SourceRobotics 📍Code: —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

32,803 görüntüleme • 11 gün önce

An interactive world model developed by NVIDIA in collaboration with academic partners. - DreamDojo turns egocentric human video data into physical intelligence. - Human data is more scalable than robotics data but lacks action labels. - To solve this, a dedicated action model extracts latent actions by identifying physics and motion deltas between frames. Training - A massive 44k hours of video data are used for pre-training. - Post-training on small-scale robot datasets maps human physics to specific robot embodiments. - An additional distillation stage converts the model into an autoregressive, few-step diffusion model, enabling real-time, action-controllable simulation. Primary Use Cases - Live Teleoperation: Controlling a robot inside a world simulation in real-time. - Model-based Planning: Previewing and curating the best actions for improved success. - Policy Evaluation: Testing robot policies in realistic, out-of-distribution scenarios. Everything that's open-sourced: weights, code, post-training dataset, eval set, and details to reproduce.
1:14

An interactive world model developed by NVIDIA in collaboration with academic partners. - DreamDojo turns egocentric human video data into physical intelligence. - Human data is more scalable than robotics data but lacks action labels. - To solve this, a dedicated action model extracts latent actions by identifying physics and motion deltas between frames. Training - A massive 44k hours of video data are used for pre-training. - Post-training on small-scale robot datasets maps human physics to specific robot embodiments. - An additional distillation stage converts the model into an autoregressive, few-step diffusion model, enabling real-time, action-controllable simulation. Primary Use Cases - Live Teleoperation: Controlling a robot inside a world simulation in real-time. - Model-based Planning: Previewing and curating the best actions for improved success. - Policy Evaluation: Testing robot policies in realistic, out-of-distribution scenarios. Everything that's open-sourced: weights, code, post-training dataset, eval set, and details to reproduce.

The Humanoid Hub

11,575 görüntüleme • 7 ay önce

Scaling vision-language-action (VLA) models to high-DoF dexterous hands has long been a "holy grail" challenge due to the high-dimensional action space and data scarcity. As a wrap up of the year 2025, we are releasing GR-Dexter, a holistic hardware-model-data framework for generalist manipulation on a bimanual dexterous-hand robot. This is the first VLA system to achieve: ✅ High-DoF Control: Managing a 56-DoF bimanual system (21-DoF per hand). ✅ Long-Horizon Tasks with tool use: Vacuuming, bread serving with tongs, and table decluttering. ✅ Open-World Generalization: Robust performance with unseen objects and abstract instructions. Project page: ArXiv:
3:52

Scaling vision-language-action (VLA) models to high-DoF dexterous hands has long been a "holy grail" challenge due to the high-dimensional action space and data scarcity. As a wrap up of the year 2025, we are releasing GR-Dexter, a holistic hardware-model-data framework for generalist manipulation on a bimanual dexterous-hand robot. This is the first VLA system to achieve: ✅ High-DoF Control: Managing a 56-DoF bimanual system (21-DoF per hand). ✅ Long-Horizon Tasks with tool use: Vacuuming, bread serving with tongs, and table decluttering. ✅ Open-World Generalization: Robust performance with unseen objects and abstract instructions. Project page: ArXiv:

Xiao Ma

94,149 görüntüleme • 9 ay önce