Загрузка видео...

Не удалось загрузить видео

На главную

We pushed MolmoAct 2 into a completely out-of-distribution studio setting to test its robustness under extreme environmental changes. Despite only 10 minutes of task-specific fine-tuning data collected elsewhere, it adapted surprisingly well to the new environment.

DJiafei's profile picture

Jiafei Duan

6,146 subscribers

11,381 просмотров • 2 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

LLM post-training used to mean fine-tuning to a downstream task Robotics has been stuck in this setting, needing task-specific fine-tuning for best performance π07 changes this: It works out of the box & outperforms fine-tuned specialists Details:
1:14

LLM post-training used to mean fine-tuning to a downstream task Robotics has been stuck in this setting, needing task-specific fine-tuning for best performance π07 changes this: It works out of the box & outperforms fine-tuned specialists Details:

Chelsea Finn

63,780 просмотров • 3 месяцев назад

MolmoAct 2 builds on MolmoAct, our first Action Reasoning Model (ARM). Like its predecessor, MolmoAct 2 reasons about the world in 3D before taking actions. It now runs up to 37x faster & handles two-armed tasks out of the box without per-task fine-tuning.
1:35

MolmoAct 2 builds on MolmoAct, our first Action Reasoning Model (ARM). Like its predecessor, MolmoAct 2 reasons about the world in 3D before taking actions. It now runs up to 37x faster & handles two-armed tasks out of the box without per-task fine-tuning.

Ai2

25,563 просмотров • 2 месяцев назад

Sharing some exciting DYNA-1 result: zero-shot environment generalization We put DYNA-1 under test in a completely different environment from our training distribution – with an entirely different background (Dyna Robotics banner) and metal table. The table has a reflective and smooth surface, creating a wildly different visual appearance as well as interaction dynamics. The model is able to proceed as usual, adeptly folding and recovering from its own mistakes. By focusing on task mastery, we achieve robust generalization out of the box
4:25

Sharing some exciting DYNA-1 result: zero-shot environment generalization We put DYNA-1 under test in a completely different environment from our training distribution – with an entirely different background (Dyna Robotics banner) and metal table. The table has a reflective and smooth surface, creating a wildly different visual appearance as well as interaction dynamics. The model is able to proceed as usual, adeptly folding and recovering from its own mistakes. By focusing on task mastery, we achieve robust generalization out of the box

Jason Ma

49,008 просмотров • 1 год назад

🚨 Scandalous 🚨 Nearly 90% of the plastic collected under the Deposit Return Scheme is shipped out of Ireland despite there being a company in Monaghan that’s able to recycle it. This is ludicrous for what’s supposed to be an environmental scheme. This must be addressed!
1:36

🚨 Scandalous 🚨 Nearly 90% of the plastic collected under the Deposit Return Scheme is shipped out of Ireland despite there being a company in Monaghan that’s able to recycle it. This is ludicrous for what’s supposed to be an environmental scheme. This must be addressed!

Matt Carthy TD

102,014 просмотров • 1 год назад

OpenAI engineer explained every form of fine-tuning in 1 hour 46 minutes - better than $3000 fine-tuning bootcamps. pick your task -> try prompting first -> drop to SFT for style -> run DPO for preference -> run RFT for verifiable rewards -> ship a model 10x cheaper than GPT-5. That loop is why teams that fine-tune beat teams that only prompt on cost and speed. Prompting + SFT + DPO + RFT + OpenAI fine-tuning API - that's the stack. Watch and save it, then pick the right fine-tune for your task this week.
1:45:58

OpenAI engineer explained every form of fine-tuning in 1 hour 46 minutes - better than $3000 fine-tuning bootcamps. pick your task -> try prompting first -> drop to SFT for style -> run DPO for preference -> run RFT for verifiable rewards -> ship a model 10x cheaper than GPT-5. That loop is why teams that fine-tune beat teams that only prompt on cost and speed. Prompting + SFT + DPO + RFT + OpenAI fine-tuning API - that's the stack. Watch and save it, then pick the right fine-tune for your task this week.

h100envy

40,047 просмотров • 11 дней назад

New short course on Fine-tuning LLMs! Many developers are moving beyond only prompting, to also fine-tuning LLMs - that is, taking a pre-trained model and training it further on your own data, which can deliver superior results inexpensively. In this course, Sharon Zhou, CEO of Lamini (disclosure: I’m a minor shareholder) shows you how to recognize when fine-tuning can be help, and how to train an open-source LLM on your own data. I hope you enjoy the course!
2:36

New short course on Fine-tuning LLMs! Many developers are moving beyond only prompting, to also fine-tuning LLMs - that is, taking a pre-trained model and training it further on your own data, which can deliver superior results inexpensively. In this course, Sharon Zhou, CEO of Lamini (disclosure: I’m a minor shareholder) shows you how to recognize when fine-tuning can be help, and how to train an open-source LLM on your own data. I hope you enjoy the course!

Andrew Ng

502,821 просмотров • 2 лет назад

UPDATE on our S1 test anomaly! Our first stage is gone – but we have collected a significant amount of data and film footage. After reviewing it, we want to share some insights into the technical analysis, preliminary conclusions and our next steps ⬇️
6:13

UPDATE on our S1 test anomaly! Our first stage is gone – but we have collected a significant amount of data and film footage. After reviewing it, we want to share some insights into the technical analysis, preliminary conclusions and our next steps ⬇️

Rocket Factory Augsburg

167,179 просмотров • 1 год назад

The end of 2025 marks the conclusion of an incredible two-year run for Automobilista 2: from January 2024 to December 2025, we delivered 43 new cars, 14 new classes, and 10 new tracks along with many updates to existing content and a wide-ranging catalogue of core gameplay and simulation improvements. These developments have brought in hundreds of thousands of new players to the base as we continue to expand AMS2 into new motorsport disciplines and eras. Our shared passion for motorsport and sim racing is what drives us and is what we celebrate with this trailer, as well as the relentless efforts of our team and the unwavering support of our players, which allow us to keep pushing forward and setting ever-higher goals with each new year. It is in that spirit that we head into 2026: committed not only to build upon the incredible foundation already established, but to elevate it into something greater than the sum of its parts. We wish all of you a Very Happy New Year!
2:19

The end of 2025 marks the conclusion of an incredible two-year run for Automobilista 2: from January 2024 to December 2025, we delivered 43 new cars, 14 new classes, and 10 new tracks along with many updates to existing content and a wide-ranging catalogue of core gameplay and simulation improvements. These developments have brought in hundreds of thousands of new players to the base as we continue to expand AMS2 into new motorsport disciplines and eras. Our shared passion for motorsport and sim racing is what drives us and is what we celebrate with this trailer, as well as the relentless efforts of our team and the unwavering support of our players, which allow us to keep pushing forward and setting ever-higher goals with each new year. It is in that spirit that we head into 2026: committed not only to build upon the incredible foundation already established, but to elevate it into something greater than the sum of its parts. We wish all of you a Very Happy New Year!

Reiza Studios

19,858 просмотров • 6 месяцев назад

I'm excited to share the new look of Agege Pen Cinema! Our team from the Ministry of the Environment and Water Resources has transformed this area into a model of environmental sustainability. I was delighted to be informed of a cool and calm atmosphere throughout the site - a direct result of our relentless efforts to maintain high standards of cleanliness and environmental management. A special shout-out to Comr. Olaide Oladeebo Okadigbo and his team, who have successfully zeroed-out the black spot along the railway track. Their dedication ensures we uphold a zero-tolerance policy for any practices that compromise our environment. Together, we’re making meaningful strides in enhancing public spaces and setting a benchmark for environmental excellence. I thank all our personnel for their hard work and commitment. Let’s continue working together to ensure that Lagos remains a beacon of cleanliness and sustainable development. #CleanerLagos #ZeroTolerance
0:21

I'm excited to share the new look of Agege Pen Cinema! Our team from the Ministry of the Environment and Water Resources has transformed this area into a model of environmental sustainability. I was delighted to be informed of a cool and calm atmosphere throughout the site - a direct result of our relentless efforts to maintain high standards of cleanliness and environmental management. A special shout-out to Comr. Olaide Oladeebo Okadigbo and his team, who have successfully zeroed-out the black spot along the railway track. Their dedication ensures we uphold a zero-tolerance policy for any practices that compromise our environment. Together, we’re making meaningful strides in enhancing public spaces and setting a benchmark for environmental excellence. I thank all our personnel for their hard work and commitment. Let’s continue working together to ensure that Lagos remains a beacon of cleanliness and sustainable development. #CleanerLagos #ZeroTolerance

Tokunbo Wahab

39,118 просмотров • 1 год назад

Literally nobody in all of history has had a good time of it. Feminist are made because they couldn't vote until 10 minutes ago? Fine! Men couldn't vote until 20 minutes ago, and also we had to throw ourselves into the meat grinder. 🤨
0:26

Literally nobody in all of history has had a good time of it. Feminist are made because they couldn't vote until 10 minutes ago? Fine! Men couldn't vote until 20 minutes ago, and also we had to throw ourselves into the meat grinder. 🤨

Fight With Memes

185,640 просмотров • 7 месяцев назад

been building an agent-native, node-based, real-time environment. as a test, I gave gpt-5.6 sol a prompt to plan out its own setup and go into a loop of creative exploration until it felt that it was done. it invented every node, every data type, every connection and all of it comes out modular and human-readable. i could open any piece and steer while it built
0:27

been building an agent-native, node-based, real-time environment. as a test, I gave gpt-5.6 sol a prompt to plan out its own setup and go into a loop of creative exploration until it felt that it was done. it invented every node, every data type, every connection and all of it comes out modular and human-readable. i could open any piece and steer while it built

Spencer Sterling

21,470 просмотров • 4 дней назад

Training humanoid robots on teleoperation alone won’t scale, says Rhoda AI CEO Jagdeep Singh. Unlike self-driving cars - which basically have four actuators (left, right, speed up, and slow down) and operate in a single environment (the road) - humanoid robots are completely different: "You're dealing with the full dexterity of a human hand - 20 degrees of freedom per hand. Every object is different. Every type of task is different." The problem isn't just the quantity of data - the bigger issue is diversity in the data, and it's why many humanoid robot demos will struggle to adapt to the real world: "If all the data you have is data that you've intentionally collected, then you almost by definition haven't seen the corner cases. You haven't seen all those edge scenarios that cause failure." Jagdeep says teleoperation is useful for fine-tuning robot behavior, but for pretraining, it's completely inadequate.
2:46

Training humanoid robots on teleoperation alone won’t scale, says Rhoda AI CEO Jagdeep Singh. Unlike self-driving cars - which basically have four actuators (left, right, speed up, and slow down) and operate in a single environment (the road) - humanoid robots are completely different: "You're dealing with the full dexterity of a human hand - 20 degrees of freedom per hand. Every object is different. Every type of task is different." The problem isn't just the quantity of data - the bigger issue is diversity in the data, and it's why many humanoid robot demos will struggle to adapt to the real world: "If all the data you have is data that you've intentionally collected, then you almost by definition haven't seen the corner cases. You haven't seen all those edge scenarios that cause failure." Jagdeep says teleoperation is useful for fine-tuning robot behavior, but for pretraining, it's completely inadequate.

TBPN

19,218 просмотров • 4 месяцев назад

In my experience, robot 'generalists' are often jacks of all trades but masters of none. In training across multiple tasks and environments, robot policies fail to generalize robustly and effectively to each particular test setting. What if at test time, we non-parametrically *retrieved* “relevant” data from the training set and used it to significantly improve the performance of few-shot imitation learning to be robust to various test time scenes. Notably, we are *not* collecting lots of new data, just training more on sub-components of the same training data! Now, we’re certainly not the first to suggest retrieval, but in our new work - STRAP, we show how retrieving relevant *sub-trajectories* from offline datasets can significantly increase data reuse across tasks, when paired with an appropriate metric space. A 🧵 (1/7)
0:43

In my experience, robot 'generalists' are often jacks of all trades but masters of none. In training across multiple tasks and environments, robot policies fail to generalize robustly and effectively to each particular test setting. What if at test time, we non-parametrically *retrieved* “relevant” data from the training set and used it to significantly improve the performance of few-shot imitation learning to be robust to various test time scenes. Notably, we are *not* collecting lots of new data, just training more on sub-components of the same training data! Now, we’re certainly not the first to suggest retrieval, but in our new work - STRAP, we show how retrieving relevant *sub-trajectories* from offline datasets can significantly increase data reuse across tasks, when paired with an appropriate metric space. A 🧵 (1/7)

Abhishek Gupta

12,045 просмотров • 1 год назад

Learned visuomotor policies are notoriously fragile, they break with changes in conditions like lighting, clutter, or object variations amongst other things. In Yunchu @ CoRL2025's latest work, we asked whether we could get these policies to be robust and generalizable with a clever choice of visual representation! The argument we made was - we want a choice of visual representation that specifically adapts to be sufficient, yet minimal for the task at hand. We thought about it from the perspective of flexible, key-point based representations. The key question becomes - how do we choose a sufficient, task-specific, yet minimal set of keypoints as a representation for policy learning. Yunchu proposes a neat way of automatically selecting task-relevant keypoints using a standard supervised learning objective, and using this for robust policy learning. This is largely under the same assumptions as behavior cloning, but with huge gains on robustness. Let’s understand how, 🧵 (1/8)
0:39

Learned visuomotor policies are notoriously fragile, they break with changes in conditions like lighting, clutter, or object variations amongst other things. In Yunchu @ CoRL2025's latest work, we asked whether we could get these policies to be robust and generalizable with a clever choice of visual representation! The argument we made was - we want a choice of visual representation that specifically adapts to be sufficient, yet minimal for the task at hand. We thought about it from the perspective of flexible, key-point based representations. The key question becomes - how do we choose a sufficient, task-specific, yet minimal set of keypoints as a representation for policy learning. Yunchu proposes a neat way of automatically selecting task-relevant keypoints using a standard supervised learning objective, and using this for robust policy learning. This is largely under the same assumptions as behavior cloning, but with huge gains on robustness. Let’s understand how, 🧵 (1/8)

Abhishek Gupta

11,355 просмотров • 1 год назад

In our situation at the U.S. Agency for Global Media, we're trying to streamline, modernize, & return it to its actual mission. But we have a federal judge intervening to dictate personnel & how we operate. It's completely out of control. These judges are not only usurping the power of the President but subverting the will of the people.
2:02

In our situation at the U.S. Agency for Global Media, we're trying to streamline, modernize, & return it to its actual mission. But we have a federal judge intervening to dictate personnel & how we operate. It's completely out of control. These judges are not only usurping the power of the President but subverting the will of the people.

Kari Lake

110,876 просмотров • 1 год назад

Can a dexterous hand still function after being run over by a 2-ton car? The dexterous hand is the most expensive component of a humanoid robot, and if it breaks, the task is interrupted. Hangzhou BrainCo conducted a rigorous test on its latest dexterous hand, Revo2: it was run over by a nearly 2-ton Volvo car, dropped from a height of 5m, dropped 30m, and subjected to forceful impacts from a Unitree G1 robot. It still managed to maintain a stable grip and continue operating. Revo2 is BrainCo's next-generation dexterous/bionic hand, released last year. yes, a human-robot hybrid hand. It's very light, only 383g, 20kg payload,capable of precision manipulation down to 0.1mm (such as threading a needle), and possesses multi-dimensional tactile perception (hardness, texture, direction, proximity, etc.). This test also demonstrates that after achieving breakthroughs in performance, a dexterous hand also needs to be extremely durable and able to function under extreme environmental pressures.
1:17

Can a dexterous hand still function after being run over by a 2-ton car? The dexterous hand is the most expensive component of a humanoid robot, and if it breaks, the task is interrupted. Hangzhou BrainCo conducted a rigorous test on its latest dexterous hand, Revo2: it was run over by a nearly 2-ton Volvo car, dropped from a height of 5m, dropped 30m, and subjected to forceful impacts from a Unitree G1 robot. It still managed to maintain a stable grip and continue operating. Revo2 is BrainCo's next-generation dexterous/bionic hand, released last year. yes, a human-robot hybrid hand. It's very light, only 383g, 20kg payload,capable of precision manipulation down to 0.1mm (such as threading a needle), and possesses multi-dimensional tactile perception (hardness, texture, direction, proximity, etc.). This test also demonstrates that after achieving breakthroughs in performance, a dexterous hand also needs to be extremely durable and able to function under extreme environmental pressures.

CyberRobo

45,434 просмотров • 5 месяцев назад

another 100% AI podcast > one prompt > 2 minutes from zero to final video > no time limit - make it as long as you need > can be adapted to any script, character, and environment you need a lot of you have been asking how we automated all these videos, we’re launching the beta very soon the real UGC industry isn't dying, it already died
0:46

another 100% AI podcast > one prompt > 2 minutes from zero to final video > no time limit - make it as long as you need > can be adapted to any script, character, and environment you need a lot of you have been asking how we automated all these videos, we’re launching the beta very soon the real UGC industry isn't dying, it already died

MAX

30,603 просмотров • 3 месяцев назад

Excited to finally share the first teaser for our new feature! We shot “Disappearing Boy” over the course of a year, in shooting blocks of 2-3 days. Months off in between shoot dates were spent editing and writing new scenes for the next block. It was produced with no crew and on a budget of just $6000, which was almost entirely paid to the actors. And despite the very small scope (or perhaps because of it), we were able to shoot in 30+ locations around the LA area. Now it’s off to festivals and will premiere in the coming months. We also have a very unconventional distribution strategy I’m excited to test out, and will share more on that front when I can…
1:00

Excited to finally share the first teaser for our new feature! We shot “Disappearing Boy” over the course of a year, in shooting blocks of 2-3 days. Months off in between shoot dates were spent editing and writing new scenes for the next block. It was produced with no crew and on a budget of just $6000, which was almost entirely paid to the actors. And despite the very small scope (or perhaps because of it), we were able to shoot in 30+ locations around the LA area. Now it’s off to festivals and will premiere in the coming months. We also have a very unconventional distribution strategy I’m excited to test out, and will share more on that front when I can…

Noam Kroll

82,050 просмотров • 3 лет назад

Today, we’re pushing a major update to Edison Analysis, our data analysis agent, which is tuned for scientific research and SOTA across data analysis benchmarks. In contrast to Kosmos, which runs for 6-12 hours and produces tens of thousands of lines of code, Edison Analysis runs for seconds to minutes and is best for specific, well-defined computational tasks. It is available both on our platform under the Analysis tab, and via API, and costs only one credit per run, so it is available to users on both free and paid tiers. Edison Analysis is a modified version of the data analysis agent Kosmos uses in its trajectories. Try it out! One of the most important improvements over our previous data analysis agents has been the addition of a specialized data retrieval tool. Edison Analysis can either use this tool to access data, or can pull data down directly via API. To evaluate this tool, we ranked the most commonly used public data repositories across recent papers from BioRxiv, and created a new benchmark that measures the ability of a language agent system to retrieve raw data from those sources. Edison Analysis gets 71% on this benchmark, and we’ll be working to increase this over time. You can read more about our benchmarks in the our blog post, link below. Some features worth highlighting: 1. Edison Analysis produces a report on the analysis it runs, along with a Jupyter notebook that you can download to reproduce the analysis yourself. Every figure it produces is linked back to the specific lines of code used to produce the figure, to make it easy to reproduce. 2. It works well with both Python and R. 3. One of the best uses for Edison Analysis is to use it to retrieve datasets that you can then analyze with Kosmos. We have a bunch of major improvements to Edison Analysis coming in the next few months that we’re excited to share. In the meantime, congratulations to the team, especially Ludovico Mitchener, Jon Laurent, Conor Igoe , Alex Andonian, and many more.
1:12

Today, we’re pushing a major update to Edison Analysis, our data analysis agent, which is tuned for scientific research and SOTA across data analysis benchmarks. In contrast to Kosmos, which runs for 6-12 hours and produces tens of thousands of lines of code, Edison Analysis runs for seconds to minutes and is best for specific, well-defined computational tasks. It is available both on our platform under the Analysis tab, and via API, and costs only one credit per run, so it is available to users on both free and paid tiers. Edison Analysis is a modified version of the data analysis agent Kosmos uses in its trajectories. Try it out! One of the most important improvements over our previous data analysis agents has been the addition of a specialized data retrieval tool. Edison Analysis can either use this tool to access data, or can pull data down directly via API. To evaluate this tool, we ranked the most commonly used public data repositories across recent papers from BioRxiv, and created a new benchmark that measures the ability of a language agent system to retrieve raw data from those sources. Edison Analysis gets 71% on this benchmark, and we’ll be working to increase this over time. You can read more about our benchmarks in the our blog post, link below. Some features worth highlighting: 1. Edison Analysis produces a report on the analysis it runs, along with a Jupyter notebook that you can download to reproduce the analysis yourself. Every figure it produces is linked back to the specific lines of code used to produce the figure, to make it easy to reproduce. 2. It works well with both Python and R. 3. One of the best uses for Edison Analysis is to use it to retrieve datasets that you can then analyze with Kosmos. We have a bunch of major improvements to Edison Analysis coming in the next few months that we’re excited to share. In the meantime, congratulations to the team, especially Ludovico Mitchener, Jon Laurent, Conor Igoe , Alex Andonian, and many more.

Sam Rodriques

61,895 просмотров • 8 месяцев назад