Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

We pushed MolmoAct 2 into a completely out-of-distribution studio setting to test its robustness under extreme environmental changes. Despite only 10 minutes of task-specific fine-tuning data collected elsewhere, it adapted surprisingly well to the new environment.

DJiafei's profile picture

Jiafei Duan

6,872 subscribers

11,493 Aufrufe • vor 5 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

LLM post-training used to mean fine-tuning to a downstream task Robotics has been stuck in this setting, needing task-specific fine-tuning for best performance π07 changes this: It works out of the box & outperforms fine-tuned specialists Details:
1:14

LLM post-training used to mean fine-tuning to a downstream task Robotics has been stuck in this setting, needing task-specific fine-tuning for best performance π07 changes this: It works out of the box & outperforms fine-tuned specialists Details:

Chelsea Finn

77,108 Aufrufe • vor 5 Monaten

MolmoAct 2 builds on MolmoAct, our first Action Reasoning Model (ARM). Like its predecessor, MolmoAct 2 reasons about the world in 3D before taking actions. It now runs up to 37x faster & handles two-armed tasks out of the box without per-task fine-tuning.
1:35

MolmoAct 2 builds on MolmoAct, our first Action Reasoning Model (ARM). Like its predecessor, MolmoAct 2 reasons about the world in 3D before taking actions. It now runs up to 37x faster & handles two-armed tasks out of the box without per-task fine-tuning.

Ai2

25,563 Aufrufe • vor 5 Monaten

Sharing some exciting DYNA-1 result: zero-shot environment generalization We put DYNA-1 under test in a completely different environment from our training distribution – with an entirely different background (Dyna Robotics banner) and metal table. The table has a reflective and smooth surface, creating a wildly different visual appearance as well as interaction dynamics. The model is able to proceed as usual, adeptly folding and recovering from its own mistakes. By focusing on task mastery, we achieve robust generalization out of the box
4:25

Sharing some exciting DYNA-1 result: zero-shot environment generalization We put DYNA-1 under test in a completely different environment from our training distribution – with an entirely different background (Dyna Robotics banner) and metal table. The table has a reflective and smooth surface, creating a wildly different visual appearance as well as interaction dynamics. The model is able to proceed as usual, adeptly folding and recovering from its own mistakes. By focusing on task mastery, we achieve robust generalization out of the box

Jason Ma

49,008 Aufrufe • vor 1 Jahr

🚨 Scandalous 🚨 Nearly 90% of the plastic collected under the Deposit Return Scheme is shipped out of Ireland despite there being a company in Monaghan that’s able to recycle it. This is ludicrous for what’s supposed to be an environmental scheme. This must be addressed!
1:36

🚨 Scandalous 🚨 Nearly 90% of the plastic collected under the Deposit Return Scheme is shipped out of Ireland despite there being a company in Monaghan that’s able to recycle it. This is ludicrous for what’s supposed to be an environmental scheme. This must be addressed!

Matt Carthy TD

102,036 Aufrufe • vor 1 Jahr

New short course on Fine-tuning LLMs! Many developers are moving beyond only prompting, to also fine-tuning LLMs - that is, taking a pre-trained model and training it further on your own data, which can deliver superior results inexpensively. In this course, Sharon Zhou, CEO of Lamini (disclosure: I’m a minor shareholder) shows you how to recognize when fine-tuning can be help, and how to train an open-source LLM on your own data. I hope you enjoy the course!
2:36

New short course on Fine-tuning LLMs! Many developers are moving beyond only prompting, to also fine-tuning LLMs - that is, taking a pre-trained model and training it further on your own data, which can deliver superior results inexpensively. In this course, Sharon Zhou, CEO of Lamini (disclosure: I’m a minor shareholder) shows you how to recognize when fine-tuning can be help, and how to train an open-source LLM on your own data. I hope you enjoy the course!

Andrew Ng

502,962 Aufrufe • vor 3 Jahren

OpenAI engineer explained every form of fine-tuning in 1 hour 46 minutes - better than $3000 fine-tuning bootcamps. pick your task -> try prompting first -> drop to SFT for style -> run DPO for preference -> run RFT for verifiable rewards -> ship a model 10x cheaper than GPT-5. That loop is why teams that fine-tune beat teams that only prompt on cost and speed. Prompting + SFT + DPO + RFT + OpenAI fine-tuning API - that's the stack. Watch and save it, then pick the right fine-tune for your task this week.
1:45:58

OpenAI engineer explained every form of fine-tuning in 1 hour 46 minutes - better than $3000 fine-tuning bootcamps. pick your task -> try prompting first -> drop to SFT for style -> run DPO for preference -> run RFT for verifiable rewards -> ship a model 10x cheaper than GPT-5. That loop is why teams that fine-tune beat teams that only prompt on cost and speed. Prompting + SFT + DPO + RFT + OpenAI fine-tuning API - that's the stack. Watch and save it, then pick the right fine-tune for your task this week.

h100envy

41,245 Aufrufe • vor 2 Monaten

UPDATE on our S1 test anomaly! Our first stage is gone – but we have collected a significant amount of data and film footage. After reviewing it, we want to share some insights into the technical analysis, preliminary conclusions and our next steps ⬇️
6:13

UPDATE on our S1 test anomaly! Our first stage is gone – but we have collected a significant amount of data and film footage. After reviewing it, we want to share some insights into the technical analysis, preliminary conclusions and our next steps ⬇️

Rocket Factory Augsburg

167,237 Aufrufe • vor 2 Jahren

The end of 2025 marks the conclusion of an incredible two-year run for Automobilista 2: from January 2024 to December 2025, we delivered 43 new cars, 14 new classes, and 10 new tracks along with many updates to existing content and a wide-ranging catalogue of core gameplay and simulation improvements. These developments have brought in hundreds of thousands of new players to the base as we continue to expand AMS2 into new motorsport disciplines and eras. Our shared passion for motorsport and sim racing is what drives us and is what we celebrate with this trailer, as well as the relentless efforts of our team and the unwavering support of our players, which allow us to keep pushing forward and setting ever-higher goals with each new year. It is in that spirit that we head into 2026: committed not only to build upon the incredible foundation already established, but to elevate it into something greater than the sum of its parts. We wish all of you a Very Happy New Year!
2:19

The end of 2025 marks the conclusion of an incredible two-year run for Automobilista 2: from January 2024 to December 2025, we delivered 43 new cars, 14 new classes, and 10 new tracks along with many updates to existing content and a wide-ranging catalogue of core gameplay and simulation improvements. These developments have brought in hundreds of thousands of new players to the base as we continue to expand AMS2 into new motorsport disciplines and eras. Our shared passion for motorsport and sim racing is what drives us and is what we celebrate with this trailer, as well as the relentless efforts of our team and the unwavering support of our players, which allow us to keep pushing forward and setting ever-higher goals with each new year. It is in that spirit that we head into 2026: committed not only to build upon the incredible foundation already established, but to elevate it into something greater than the sum of its parts. We wish all of you a Very Happy New Year!

Reiza Studios

19,858 Aufrufe • vor 9 Monaten

Every Prufrock that leaves the factory has over 1,000 changes from the one before it. Before it ships, we put it through a full Porpoise Test (PT) in Bastrop — a short test tunnel (typically under 200 rings) that lets both the design team and the test team gather real data on the new designs and on the specific Prufrock serial number. To date, we’ve completed six of these tests and Prufrock 5 is currently 200 rings into PT7. Once complete, the tunnels are put to use: • PT4 is now a vacuum tunnel for Hyperloop testing • PT5 is a live test bench for liner trucks and new belt systems • PT6 is a pedestrian tunnel connecting SpaceX to Hyperloop Plaza With porpoise testing, our engineers get to get hands on and stress-test every one of their designs in real world environments without ever leaving Bastrop. We are currently hiring Electrical, Mechanical, Test, and Software engineers. Link to apply in the comments below 👇
0:32

Every Prufrock that leaves the factory has over 1,000 changes from the one before it. Before it ships, we put it through a full Porpoise Test (PT) in Bastrop — a short test tunnel (typically under 200 rings) that lets both the design team and the test team gather real data on the new designs and on the specific Prufrock serial number. To date, we’ve completed six of these tests and Prufrock 5 is currently 200 rings into PT7. Once complete, the tunnels are put to use: • PT4 is now a vacuum tunnel for Hyperloop testing • PT5 is a live test bench for liner trucks and new belt systems • PT6 is a pedestrian tunnel connecting SpaceX to Hyperloop Plaza With porpoise testing, our engineers get to get hands on and stress-test every one of their designs in real world environments without ever leaving Bastrop. We are currently hiring Electrical, Mechanical, Test, and Software engineers. Link to apply in the comments below 👇

Mike Baier

82,985 Aufrufe • vor 2 Monaten

Take something familiar. Edit the meaning. Repair the story. A boxing glove is built to hit. Sara Shakeel gave it another purpose. With CapCut Design Studio, she turned impact into beauty, and an object of conflict into a symbol of healing. Because sometimes the strongest edit changes more than the image. It changes how we see it. What would you give a new meaning to? Get started at
1:25

Take something familiar. Edit the meaning. Repair the story. A boxing glove is built to hit. Sara Shakeel gave it another purpose. With CapCut Design Studio, she turned impact into beauty, and an object of conflict into a symbol of healing. Because sometimes the strongest edit changes more than the image. It changes how we see it. What would you give a new meaning to? Get started at

CapCut

510,191 Aufrufe • vor 1 Monat

The Pallas's cat, also known as the manul, is a small wild cat found in the grasslands and steppes of Central Asia. It was first discovered in 1776 by the naturalist Peter Simon Pallas, who named the cat after himself. The Pallas's cat is well adapted to its environment with its thick fur and stocky build, which help it survive in the harsh conditions of its high-altitude habitat. Despite being the size of a house cat, the Pallas's cat is often mistaken for a larger feline due to its thick fur. These cats are solitary creatures, only seeking out company during mating season, and they have a unique appearance with their flat ears and broad faces.
0:44

The Pallas's cat, also known as the manul, is a small wild cat found in the grasslands and steppes of Central Asia. It was first discovered in 1776 by the naturalist Peter Simon Pallas, who named the cat after himself. The Pallas's cat is well adapted to its environment with its thick fur and stocky build, which help it survive in the harsh conditions of its high-altitude habitat. Despite being the size of a house cat, the Pallas's cat is often mistaken for a larger feline due to its thick fur. These cats are solitary creatures, only seeking out company during mating season, and they have a unique appearance with their flat ears and broad faces.

Historic Vids

6,955,871 Aufrufe • vor 2 Jahren

I'm excited to share the new look of Agege Pen Cinema! Our team from the Ministry of the Environment and Water Resources has transformed this area into a model of environmental sustainability. I was delighted to be informed of a cool and calm atmosphere throughout the site - a direct result of our relentless efforts to maintain high standards of cleanliness and environmental management. A special shout-out to Comr. Olaide Oladeebo Okadigbo and his team, who have successfully zeroed-out the black spot along the railway track. Their dedication ensures we uphold a zero-tolerance policy for any practices that compromise our environment. Together, we’re making meaningful strides in enhancing public spaces and setting a benchmark for environmental excellence. I thank all our personnel for their hard work and commitment. Let’s continue working together to ensure that Lagos remains a beacon of cleanliness and sustainable development. #CleanerLagos #ZeroTolerance
0:21

I'm excited to share the new look of Agege Pen Cinema! Our team from the Ministry of the Environment and Water Resources has transformed this area into a model of environmental sustainability. I was delighted to be informed of a cool and calm atmosphere throughout the site - a direct result of our relentless efforts to maintain high standards of cleanliness and environmental management. A special shout-out to Comr. Olaide Oladeebo Okadigbo and his team, who have successfully zeroed-out the black spot along the railway track. Their dedication ensures we uphold a zero-tolerance policy for any practices that compromise our environment. Together, we’re making meaningful strides in enhancing public spaces and setting a benchmark for environmental excellence. I thank all our personnel for their hard work and commitment. Let’s continue working together to ensure that Lagos remains a beacon of cleanliness and sustainable development. #CleanerLagos #ZeroTolerance

Tokunbo Wahab

39,118 Aufrufe • vor 1 Jahr

Literally nobody in all of history has had a good time of it. Feminist are made because they couldn't vote until 10 minutes ago? Fine! Men couldn't vote until 20 minutes ago, and also we had to throw ourselves into the meat grinder. 🤨
0:26

Literally nobody in all of history has had a good time of it. Feminist are made because they couldn't vote until 10 minutes ago? Fine! Men couldn't vote until 20 minutes ago, and also we had to throw ourselves into the meat grinder. 🤨

Fight With Memes

185,640 Aufrufe • vor 10 Monaten

Training humanoid robots on teleoperation alone won’t scale, says Rhoda AI CEO Jagdeep Singh. Unlike self-driving cars - which basically have four actuators (left, right, speed up, and slow down) and operate in a single environment (the road) - humanoid robots are completely different: "You're dealing with the full dexterity of a human hand - 20 degrees of freedom per hand. Every object is different. Every type of task is different." The problem isn't just the quantity of data - the bigger issue is diversity in the data, and it's why many humanoid robot demos will struggle to adapt to the real world: "If all the data you have is data that you've intentionally collected, then you almost by definition haven't seen the corner cases. You haven't seen all those edge scenarios that cause failure." Jagdeep says teleoperation is useful for fine-tuning robot behavior, but for pretraining, it's completely inadequate.
2:46

Training humanoid robots on teleoperation alone won’t scale, says Rhoda AI CEO Jagdeep Singh. Unlike self-driving cars - which basically have four actuators (left, right, speed up, and slow down) and operate in a single environment (the road) - humanoid robots are completely different: "You're dealing with the full dexterity of a human hand - 20 degrees of freedom per hand. Every object is different. Every type of task is different." The problem isn't just the quantity of data - the bigger issue is diversity in the data, and it's why many humanoid robot demos will struggle to adapt to the real world: "If all the data you have is data that you've intentionally collected, then you almost by definition haven't seen the corner cases. You haven't seen all those edge scenarios that cause failure." Jagdeep says teleoperation is useful for fine-tuning robot behavior, but for pretraining, it's completely inadequate.

TBPN

19,218 Aufrufe • vor 6 Monaten

Most robot demos are scripted. Generalist's GEN-1 is not. > GEN-1 was doing a task > Mid-task, an extra object was thrown into the bin > GEN-1 quickly adapted to the new environment > Still completed the task smoothly This is the difference between a scripted policy (seen in viral launch videos) and a real foundation model. GEN-1 was trained on 500,000 hours of proprietary, real-world dexterous manipulation data. It has NEVER seen that exact scenario before. This was the coolest demo at Automate Show Generalist Flexiv Robotics
0:53

Most robot demos are scripted. Generalist's GEN-1 is not. > GEN-1 was doing a task > Mid-task, an extra object was thrown into the bin > GEN-1 quickly adapted to the new environment > Still completed the task smoothly This is the difference between a scripted policy (seen in viral launch videos) and a real foundation model. GEN-1 was trained on 500,000 hours of proprietary, real-world dexterous manipulation data. It has NEVER seen that exact scenario before. This was the coolest demo at Automate Show Generalist Flexiv Robotics

mete

11,651 Aufrufe • vor 3 Monaten

been building an agent-native, node-based, real-time environment. as a test, I gave gpt-5.6 sol a prompt to plan out its own setup and go into a loop of creative exploration until it felt that it was done. it invented every node, every data type, every connection and all of it comes out modular and human-readable. i could open any piece and steer while it built
0:27

been building an agent-native, node-based, real-time environment. as a test, I gave gpt-5.6 sol a prompt to plan out its own setup and go into a loop of creative exploration until it felt that it was done. it invented every node, every data type, every connection and all of it comes out modular and human-readable. i could open any piece and steer while it built

Spencer Sterling

22,838 Aufrufe • vor 2 Monaten

Show it a single human demonstration of a long-horizon task and the robot performs it right away. No fine-tuning, no retraining. Skild has released S1, a robot foundation model where you specify the task with a video demonstration instead of a language instruction. Why video, not language Language works for "hand me the mug." It falls apart for anything delicate or long-horizon. You don't learn to fold a fitted sheet from a sentence. So S1 takes a video demo into its context window and translates it to its own body and scene. What it does - Tasks up to 10 minutes, dozens of sequential steps - Unseen tasks: potting plants, pour-over coffee, kit assembly, pancakes. Skild says even the underlying primitives, like flipping a pancake, weren't in pre-training - Recovers from its own mistakes without being trained to - Improves on flawed demos. Demonstrator drops an egg, S1 doesn't make that mistake. It reads the demo as a goal, not a trajectory to copy.
3:54

Show it a single human demonstration of a long-horizon task and the robot performs it right away. No fine-tuning, no retraining. Skild has released S1, a robot foundation model where you specify the task with a video demonstration instead of a language instruction. Why video, not language Language works for "hand me the mug." It falls apart for anything delicate or long-horizon. You don't learn to fold a fitted sheet from a sentence. So S1 takes a video demo into its context window and translates it to its own body and scene. What it does - Tasks up to 10 minutes, dozens of sequential steps - Unseen tasks: potting plants, pour-over coffee, kit assembly, pancakes. Skild says even the underlying primitives, like flipping a pancake, weren't in pre-training - Recovers from its own mistakes without being trained to - Improves on flawed demos. Demonstrator drops an egg, S1 doesn't make that mistake. It reads the demo as a goal, not a trajectory to copy.

The Humanoid Hub

19,027 Aufrufe • vor 1 Monat

In my experience, robot 'generalists' are often jacks of all trades but masters of none. In training across multiple tasks and environments, robot policies fail to generalize robustly and effectively to each particular test setting. What if at test time, we non-parametrically *retrieved* “relevant” data from the training set and used it to significantly improve the performance of few-shot imitation learning to be robust to various test time scenes. Notably, we are *not* collecting lots of new data, just training more on sub-components of the same training data! Now, we’re certainly not the first to suggest retrieval, but in our new work - STRAP, we show how retrieving relevant *sub-trajectories* from offline datasets can significantly increase data reuse across tasks, when paired with an appropriate metric space. A 🧵 (1/7)
0:43

In my experience, robot 'generalists' are often jacks of all trades but masters of none. In training across multiple tasks and environments, robot policies fail to generalize robustly and effectively to each particular test setting. What if at test time, we non-parametrically *retrieved* “relevant” data from the training set and used it to significantly improve the performance of few-shot imitation learning to be robust to various test time scenes. Notably, we are *not* collecting lots of new data, just training more on sub-components of the same training data! Now, we’re certainly not the first to suggest retrieval, but in our new work - STRAP, we show how retrieving relevant *sub-trajectories* from offline datasets can significantly increase data reuse across tasks, when paired with an appropriate metric space. A 🧵 (1/7)

Abhishek Gupta

12,045 Aufrufe • vor 1 Jahr

WASHINGTON CAN MAKE ALL THE NOISE IT WANTS. THE FBI HAS A MISSION. Under President Trump’s leadership, and this administration we moved thousands of personnel into the field. Cut decades-old bureaucracy. Expanded our task force partnerships to record levels. And now we’ve taken down 10 out of 10 Top Ten Most Wanted fugitives. We are here to protect the American people. The personal attacks won’t stop the mission. And we’re only halfway done. -DKP🇺🇸
1:14

WASHINGTON CAN MAKE ALL THE NOISE IT WANTS. THE FBI HAS A MISSION. Under President Trump’s leadership, and this administration we moved thousands of personnel into the field. Cut decades-old bureaucracy. Expanded our task force partnerships to record levels. And now we’ve taken down 10 out of 10 Top Ten Most Wanted fugitives. We are here to protect the American people. The personal attacks won’t stop the mission. And we’re only halfway done. -DKP🇺🇸

FBI Director Kash Patel

101,971 Aufrufe • vor 18 Tagen

.Jason Ma on how Dyna-2 learned to untwist a real water bottle cap out of the box from just 13 minutes of dexterous hand data because the robot hand looks like a human's: "We got a new pair of dexterous hand. Most of our robots in the office have a gripper-like hand, so the gap between that versus human is actually quite large." "We thought, if we have a robot that has hands that look like human, wouldn't the transfer be greater? Right before the release, they were able to collect just 13 minutes of data." "They collected only 13 minutes of data and then post-trained the best Dyna model that trained on one million hours of data. The model is just able to, out of the box, start opening bottle caps on real water bottles." "This is very surprising because typically post-training a robot would take at least several hours of data. For a dexterous hand that's much more complex than a gripper, it would actually be much harder to train. But the experimental results we saw was the opposite. Perhaps because the hand looks more like the human, the transfer was easier." Dyna Robotics
1:16

.Jason Ma on how Dyna-2 learned to untwist a real water bottle cap out of the box from just 13 minutes of dexterous hand data because the robot hand looks like a human's: "We got a new pair of dexterous hand. Most of our robots in the office have a gripper-like hand, so the gap between that versus human is actually quite large." "We thought, if we have a robot that has hands that look like human, wouldn't the transfer be greater? Right before the release, they were able to collect just 13 minutes of data." "They collected only 13 minutes of data and then post-trained the best Dyna model that trained on one million hours of data. The model is just able to, out of the box, start opening bottle caps on real water bottles." "This is very surprising because typically post-training a robot would take at least several hours of data. For a dexterous hand that's much more complex than a gripper, it would actually be much harder to train. But the experimental results we saw was the opposite. Perhaps because the hand looks more like the human, the transfer was easier." Dyna Robotics

MTS

13,743 Aufrufe • vor 1 Monat