Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

Today we present Morpheus, a persistent enterprise simulation platform designed to make Continual Learning a reality. Morpheus is the world’s first real world Reinforcement Learning environment. Every Reinforcement Learning environment operates in the game world. Benchmarks like Atari, OpenAI Gym, MuJoCo, and Procgen are all small, game-like worlds that... show more

Skyfall AI

1,230 subscribers

268,132 просмотров • 1 месяц назад •via X (Twitter)

Наука и технологии Образование

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Robot policies must be both reliable and highly capable to be useful; the best way to achieve this level of performance is with reinforcement learning. However, for reinforcement learning you are usually stuck between two difficult options: reinforcement in the real world is often risky and expensive, while reinforcement learning in a traditional simulator takes a lot of engineering work and has a persistent sim-to-real gap. What if instead you could train your robot purely in a world model? RISE by Jiazhi Yang et al. uses a compositional world model to predict the future and evaluate progress. This allows for a self-improving pipeline, which learns a world model from real data and then learns how the robot should perform different tasks. This pipeline results in a data-driven way to improve policy performance from real data but without real-world reinforcement learning. Watch Episode #86 of RoboPapers, with Chris Paxton and Jiafei Duan, to learn more!

Robot policies must be both reliable and highly capable to be useful; the best way to achieve this level of performance is with reinforcement learning. However, for reinforcement learning you are usually stuck between two difficult options: reinforcement in the real world is often risky and expensive, while reinforcement learning in a traditional simulator takes a lot of engineering work and has a persistent sim-to-real gap. What if instead you could train your robot purely in a world model? RISE by Jiazhi Yang et al. uses a compositional world model to predict the future and evaluate progress. This allows for a self-improving pipeline, which learns a world model from real data and then learns how the robot should perform different tasks. This pipeline results in a data-driven way to improve policy performance from real data but without real-world reinforcement learning. Watch Episode #86 of RoboPapers, with Chris Paxton and Jiafei Duan, to learn more!

RoboPapers

38,772 просмотров • 2 месяцев назад

.Richard Sutton, father of reinforcement learning, doesn’t think LLMs are bitter-lesson-pilled. My steel man of Richard’s position: we need some new architecture to enable continual (on-the-job) learning. And if we have continual learning, we don't need a special training phase - the agent just learns on-the-fly - like all humans, and indeed, like all animals. This new paradigm will render our current approach with LLMs obsolete. I did my best to represent the view that LLMs will function as the foundation on which this experiential learning can happen. Some sparks flew. 0:00:00 – Are LLMs a dead-end? 0:13:51 – Do humans do imitation learning? 0:23:57 – The Era of Experience 0:34:25 – Current architectures generalize poorly out of distribution 0:42:17 – Surprises in the AI field 0:47:28 – Will The Bitter Lesson still apply after AGI? 0:54:35 – Succession to AI

.Richard Sutton, father of reinforcement learning, doesn’t think LLMs are bitter-lesson-pilled. My steel man of Richard’s position: we need some new architecture to enable continual (on-the-job) learning. And if we have continual learning, we don't need a special training phase - the agent just learns on-the-fly - like all humans, and indeed, like all animals. This new paradigm will render our current approach with LLMs obsolete. I did my best to represent the view that LLMs will function as the foundation on which this experiential learning can happen. Some sparks flew. 0:00:00 – Are LLMs a dead-end? 0:13:51 – Do humans do imitation learning? 0:23:57 – The Era of Experience 0:34:25 – Current architectures generalize poorly out of distribution 0:42:17 – Surprises in the AI field 0:47:28 – Will The Bitter Lesson still apply after AGI? 0:54:35 – Succession to AI

Dwarkesh Patel

3,086,965 просмотров • 11 месяцев назад

capability != learning new benchtalks with Parth Asawa on continual learning, where we discuss teaching models to learn from experience, measuring learning ability, the bet on parametric models, and more 01:06 What is continual learning? 04:10 Why capability and learning are different 06:13 Why build a benchmark? 08:07 Continual Learning Bench launch and reception 09:13 Anthropic's Fable release and Continual Learning Bench 11:02 How to design tasks for continual learning 18:41 The gain metric 24:01 What good looks like on the leaderboard 29:13 Failure modes: why models can't update their beliefs 31:12 Parametric systems and future architectures 34:30 Open science and AI safety 45:42 Lightning round 49:08 How to contribute to Continual Learning Bench

capability != learning new benchtalks with Parth Asawa on continual learning, where we discuss teaching models to learn from experience, measuring learning ability, the bet on parametric models, and more 01:06 What is continual learning? 04:10 Why capability and learning are different 06:13 Why build a benchmark? 08:07 Continual Learning Bench launch and reception 09:13 Anthropic's Fable release and Continual Learning Bench 11:02 How to design tasks for continual learning 18:41 The gain metric 24:01 What good looks like on the leaderboard 29:13 Failure modes: why models can't update their beliefs 31:12 Parametric systems and future architectures 34:30 Open science and AI safety 45:42 Lightning round 49:08 How to contribute to Continual Learning Bench

vincent sunn chen

41,143 просмотров • 2 месяцев назад

Reinforcement learning is mind-blowing! Here's a reinforcement learning agent that mastered Breakout and is playing at a superhuman level (score 350+). The crazy part: We didn't write the code or the pipeline. NEO, the first autonomous AI Engineer, did it. From a prompt! It trained over 24 million steps. Evaluated itself. Iterated. Everything under 50 minutes. NEO designed the environment, the reward function, and the entire pipeline. Agentic AI is here!

Reinforcement learning is mind-blowing! Here's a reinforcement learning agent that mastered Breakout and is playing at a superhuman level (score 350+). The crazy part: We didn't write the code or the pipeline. NEO, the first autonomous AI Engineer, did it. From a prompt! It trained over 24 million steps. Evaluated itself. Iterated. Everything under 50 minutes. NEO designed the environment, the reward function, and the entire pipeline. Agentic AI is here!

Santiago

21,701 просмотров • 8 месяцев назад

Mondo's Beni ( may look cute, but there is a serious learning stack inside. It can perform flips, navigate autonomously, and track moving subjects. The secret is reinforcement learning: Beni practices at massive scale in simulation, optimizing its controller through millions of virtual trials before entering the real world. Here is a thread on some of the research ideas and tools used by Beni: 🧵

Mondo's Beni ( may look cute, but there is a serious learning stack inside. It can perform flips, navigate autonomously, and track moving subjects. The secret is reinforcement learning: Beni practices at massive scale in simulation, optimizing its controller through millions of virtual trials before entering the real world. Here is a thread on some of the research ideas and tools used by Beni: 🧵

Shuo Yang

30,698 просмотров • 1 месяц назад

notes on my reinforcement learning for rocket league side quest so far: i’m in awe that — we live in a time where i can train a reinforcement learning model that is learning to play rocket league and at the same time, test community made rocket league models. where, both processes can run in parallel & locally on my hardware. in the game window — i’m playing against a reinforcement learning ppo model that’s running locally. and in the vscode window — i’m training my own reinforcement learning model (just a dummy example script for now). also, the rocket league botting ecosystem has incredible tooling where you can test out different reinforcement learning ideas against other algorithms + it has great documentation for linux and windows. it’s honestly a beautiful hidden gem of a rabbit hole :)

notes on my reinforcement learning for rocket league side quest so far: i’m in awe that — we live in a time where i can train a reinforcement learning model that is learning to play rocket league and at the same time, test community made rocket league models. where, both processes can run in parallel & locally on my hardware. in the game window — i’m playing against a reinforcement learning ppo model that’s running locally. and in the vscode window — i’m training my own reinforcement learning model (just a dummy example script for now). also, the rocket league botting ecosystem has incredible tooling where you can test out different reinforcement learning ideas against other algorithms + it has great documentation for linux and windows. it’s honestly a beautiful hidden gem of a rabbit hole :)

naklecha

46,795 просмотров • 1 год назад

Today, Michael Elabd, Arjun Karanam, and I are excited to announce Trajectory. We are a research lab and product company building the platform for Continual Learning. Our platform unlocks the signal already sitting in product usage, so companies can continuously post-train large-scale agentic models that outperform the frontier. Trajectory We’ve raised $15M from Conviction, Bessemer, Radical Ventures, Jeff Dean, Fei-Fei Li and more. We’re partnering with some of the best AI-native companies: @ClayRunHQ Harvey, Decagon, , Rogo to power their agentic systems, some of which we are already in production with. We’ve brought together a world class research team from DeepMind, OpenAI, Apple, Meta Superintelligence, Amazon AGI, Scale AI, and an elite product team from Stripe and Figma. AI will never again start on day one. Every correction, every retry, every edit will make products smarter. This is Continual Learning.

Today, Michael Elabd, Arjun Karanam, and I are excited to announce Trajectory. We are a research lab and product company building the platform for Continual Learning. Our platform unlocks the signal already sitting in product usage, so companies can continuously post-train large-scale agentic models that outperform the frontier. Trajectory We’ve raised $15M from Conviction, Bessemer, Radical Ventures, Jeff Dean, Fei-Fei Li and more. We’re partnering with some of the best AI-native companies: @ClayRunHQ Harvey, Decagon, , Rogo to power their agentic systems, some of which we are already in production with. We’ve brought together a world class research team from DeepMind, OpenAI, Apple, Meta Superintelligence, Amazon AGI, Scale AI, and an elite product team from Stripe and Figma. AI will never again start on day one. Every correction, every retry, every edit will make products smarter. This is Continual Learning.

Ronak Malde

1,836,790 просмотров • 3 месяцев назад

This may be a hard pill to swallow but it is becoming clearer to me every single day that The Matrix was in fact a documentary. 📺 We live in a programmed, simulated world. We ARE AI. We ARE the players and this Earth is the game. 🎲

This may be a hard pill to swallow but it is becoming clearer to me every single day that The Matrix was in fact a documentary. 📺 We live in a programmed, simulated world. We ARE AI. We ARE the players and this Earth is the game. 🎲

𝒦𝑒𝓁𝓁𝓎࿎☽

29,668 просмотров • 9 месяцев назад

I really want to show off the cutting edge tech the team is building and how we're turning AI image generation into real living environments using gaussian splats and at the :19 mark of this video you can see how we're blending splats together to create a real world. What this looks like from a gaming perspective is this all happens behind the players view to simulate a real world environment. As you move through the space, distance becomes a variable to consider on how images update and are experienced. We are creating a new reality in real time.

I really want to show off the cutting edge tech the team is building and how we're turning AI image generation into real living environments using gaussian splats and at the :19 mark of this video you can see how we're blending splats together to create a real world. What this looks like from a gaming perspective is this all happens behind the players view to simulate a real world environment. As you move through the space, distance becomes a variable to consider on how images update and are experienced. We are creating a new reality in real time.

𝔹𝕃𝕍ℂ𝕂𝕃!𝔾ℍ𝕋

25,084 просмотров • 2 месяцев назад

How did we sign 46 of the top 50 grossing filmmakers in the world? I was in a competitive environment, in a competitive business, in a competitive arena. The entertainment business is dog-eat-dog and it’s been like that since it started. It has never changed. I read everything I could get my hands on about the golden years of the movie business and I used it to start CAA. I made up a reading list and gave it to everyone we were working with. Our group knew history. The reason that was important is because when you started talking to filmmakers and they start talking about Frank Capra, or David Lean, or Howard Hawks, or Willy Wyler, or Michael Curtiz — who all made some of the great movies. If you don’t know what they did how can you talk to a filmmaker? How? You can’t. How did we sign every director in the business? We spoke their language.

How did we sign 46 of the top 50 grossing filmmakers in the world? I was in a competitive environment, in a competitive business, in a competitive arena. The entertainment business is dog-eat-dog and it’s been like that since it started. It has never changed. I read everything I could get my hands on about the golden years of the movie business and I used it to start CAA. I made up a reading list and gave it to everyone we were working with. Our group knew history. The reason that was important is because when you started talking to filmmakers and they start talking about Frank Capra, or David Lean, or Howard Hawks, or Willy Wyler, or Michael Curtiz — who all made some of the great movies. If you don’t know what they did how can you talk to a filmmaker? How? You can’t. How did we sign every director in the business? We spoke their language.

David Senra

47,220 просмотров • 9 месяцев назад

Continual Learning in 2026. And AGI with it? In July, Dario said he believes Continual Learning will turn out to be not as difficult as it seems. Sholto Douglas, Anthropic and former Deepmind researcher, predicted Continual Learning gets solved in a satisfying way in 2026. Sholto said that last week. Considering how capable AI models have become in 2025, it is unwise to dismiss this as fundraising or hype. It is much wiser to assume AGI is coming. That it will change the world. And that you can benefit from it... ...than it is to assume the opposite. "Not enough people are ready for AI to not be a bubble." - roon Choose wisely my friends.

Continual Learning in 2026. And AGI with it? In July, Dario said he believes Continual Learning will turn out to be not as difficult as it seems. Sholto Douglas, Anthropic and former Deepmind researcher, predicted Continual Learning gets solved in a satisfying way in 2026. Sholto said that last week. Considering how capable AI models have become in 2025, it is unwise to dismiss this as fundraising or hype. It is much wiser to assume AGI is coming. That it will change the world. And that you can benefit from it... ...than it is to assume the opposite. "Not enough people are ready for AI to not be a bubble." - roon Choose wisely my friends.

Dan McAteer

69,496 просмотров • 8 месяцев назад

Today, we publicly released RoboCasa365, a large-scale simulation benchmark for training and systematically evaluating generalist robot models. Built upon our original RoboCasa framework, it offers: • 2,500 realistic kitchen environments; • 365 everyday tasks (basic skills + long-horizon mobile manipulation); • Over 3,200 objects with many articulated fixtures/appliances. All are designed for fully controlled, reproducible benchmarking of robotic policies. Progress in robotic foundation models is real. But it’s still hard to answer basic questions like: How close are we to general-purpose autonomy? What factors drive generalization? What are the model/data scaling curves like? Real-world eval is slow and noisy, and existing sims (like LIBERO, which we built 3 years ago) often lack sufficient task and scene diversity. This benchmark comes with 2,200+ hours of demonstrations and 500K+ trajectories to support studies of multi-task training, pretraining, and continual learning at scale. Check it out at

Today, we publicly released RoboCasa365, a large-scale simulation benchmark for training and systematically evaluating generalist robot models. Built upon our original RoboCasa framework, it offers: • 2,500 realistic kitchen environments; • 365 everyday tasks (basic skills + long-horizon mobile manipulation); • Over 3,200 objects with many articulated fixtures/appliances. All are designed for fully controlled, reproducible benchmarking of robotic policies. Progress in robotic foundation models is real. But it’s still hard to answer basic questions like: How close are we to general-purpose autonomy? What factors drive generalization? What are the model/data scaling curves like? Real-world eval is slow and noisy, and existing sims (like LIBERO, which we built 3 years ago) often lack sufficient task and scene diversity. This benchmark comes with 2,200+ hours of demonstrations and 500K+ trajectories to support studies of multi-task training, pretraining, and continual learning at scale. Check it out at

Yuke Zhu

24,027 просмотров • 6 месяцев назад

SITUATION EXPLAINED: A new generation of AI labs are betting that world models are the path to general intelligence that can interact with the real world. We had General Intuition CEO Pim de Witte on MTS to explain what world models are, and why intuitively world models offer a clearer path towards general intelligence than LLMs. For humans, text is a technology for compressing information about the unfolding, three-dimensional world around us and communicating it to other people. When LLMs reason about the world, they do so by reconstructing the world through text. World models work by modeling the three-dimensional world at the architecture level and then allowing agents to interact with that world. Unlike an LLM, which understands space and time through text, world models perform spatial and temporal reasoning natively. General Intuition hopes to use world models to create embodied AI—machines that can reason and act in the real world. But other companies are also pushing the frontier in this space. Odyssey ML today announced a multi-agent world model, Agora-1. Their launch video shows four participants interacting with a real-time world model simulation of GoldenEye, a first-person shooter for the N64. A playable preview of the GoldenEye simulation is available on their site.

SITUATION EXPLAINED: A new generation of AI labs are betting that world models are the path to general intelligence that can interact with the real world. We had General Intuition CEO Pim de Witte on MTS to explain what world models are, and why intuitively world models offer a clearer path towards general intelligence than LLMs. For humans, text is a technology for compressing information about the unfolding, three-dimensional world around us and communicating it to other people. When LLMs reason about the world, they do so by reconstructing the world through text. World models work by modeling the three-dimensional world at the architecture level and then allowing agents to interact with that world. Unlike an LLM, which understands space and time through text, world models perform spatial and temporal reasoning natively. General Intuition hopes to use world models to create embodied AI—machines that can reason and act in the real world. But other companies are also pushing the frontier in this space. Odyssey ML today announced a multi-agent world model, Agora-1. Their launch video shows four participants interacting with a real-time world model simulation of GoldenEye, a first-person shooter for the N64. A playable preview of the GoldenEye simulation is available on their site.

MTS

11,676 просмотров • 3 месяцев назад

In order for robots to be deployed in the real world, performing tasks of real value, they must be reliable. Unfortunately, even more, most robotic demos work maybe 70-80% of the time at best. The way to get better reliability is to do real-world reinforcement learning: having the robot teach itself how to perform the task up to a high level of success. The key to doing this is to start with a core of expert human data, use that to train a policy then iteratively improve it, until finally finishing with on-policy reinforcement learning. Kun Lei talks through a unified framework for imitation and reinforcement learning based on PPO, which enables this improvement process. In this episode, Kun Lei explains the theory behind his reinforcement learning method and how it allowed his robot to run in a shopping mall juicing oranges for seven hours at a time, among experiments on a wide variety of tasks and embodiments. Watch episode 58 of RoboPapers now, hosted by Michael Cho - Rbt/Acc and Chris Paxton!

In order for robots to be deployed in the real world, performing tasks of real value, they must be reliable. Unfortunately, even more, most robotic demos work maybe 70-80% of the time at best. The way to get better reliability is to do real-world reinforcement learning: having the robot teach itself how to perform the task up to a high level of success. The key to doing this is to start with a core of expert human data, use that to train a policy then iteratively improve it, until finally finishing with on-policy reinforcement learning. Kun Lei talks through a unified framework for imitation and reinforcement learning based on PPO, which enables this improvement process. In this episode, Kun Lei explains the theory behind his reinforcement learning method and how it allowed his robot to run in a shopping mall juicing oranges for seven hours at a time, among experiments on a wide variety of tasks and embodiments. Watch episode 58 of RoboPapers now, hosted by Michael Cho - Rbt/Acc and Chris Paxton!

RoboPapers

18,813 просмотров • 7 месяцев назад

Today, we're joined by Nikita Rudin, co-founder and CEO of Flexion to discuss the gap between current robotic capabilities and what’s required to deploy fully autonomous robots in the real world. Nikita explains how reinforcement learning and simulation have driven rapid progress in robot locomotion—and why locomotion is still far from “solved.” We dig into the sim2real gap, and how adding visual inputs introduces noise and significantly complicates sim-to-real transfer. We also explore the debate between end-to-end models and modular approaches, and why separating locomotion, planning, and semantics remains a pragmatic approach today. Nikita also introduces the concept of "real-to-sim", which uses real-world data to refine simulation parameters for higher fidelity training, discusses how reinforcement learning, imitation learning, and teleoperation data are combined to train robust policies for both quadruped and humanoid robots, and introduces Flexion's hierarchical approach that utilizes pre-trained Vision-Language Models (VLMs) for high-level task orchestration with Vision-Language-Action (VLA) models and low-level whole-body trackers. Finally, Nikita shares the behind-the-scenes in humanoid robot demos, his take on reinforcement learning in simulation versus the real world, the nuances of reward tuning, and offers practical advice for researchers and practitioners looking to get started in robotics today. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 04:07 - Is robot locomotion solved? 06:04 - Sim-to-real gap 08:58 - Adding semantics to policies 09:42 - Modular vs end-to-end architectures 10:29 - Planner model 12:21 - Adapting RL techniques from quadrupeds to humanoids 15:39 - Behind robot demos 18:09 - Humanoid robots in home environments 22:03 - Training approach 23:56 - VLA models 27:59 - Closing the sim-to-real gap 32:55 - Task orchestration using VLMs 36:38 - Tool use 38:10 - Model hierarchy 43:37 - Simulator versus simulation environment 44:57 - Combining imitation learning and reinforcement learning 46:42 - RL in real world versus RL in simulation 52:58 - Reward tuning and value functions in robotics 56:38 - Predictions 1:00:10 - Humanoids, quadropeds, and wheeled platforms 1:02:45 - Advice, recommended robot kits, and community pla

Today, we're joined by Nikita Rudin, co-founder and CEO of Flexion to discuss the gap between current robotic capabilities and what’s required to deploy fully autonomous robots in the real world. Nikita explains how reinforcement learning and simulation have driven rapid progress in robot locomotion—and why locomotion is still far from “solved.” We dig into the sim2real gap, and how adding visual inputs introduces noise and significantly complicates sim-to-real transfer. We also explore the debate between end-to-end models and modular approaches, and why separating locomotion, planning, and semantics remains a pragmatic approach today. Nikita also introduces the concept of "real-to-sim", which uses real-world data to refine simulation parameters for higher fidelity training, discusses how reinforcement learning, imitation learning, and teleoperation data are combined to train robust policies for both quadruped and humanoid robots, and introduces Flexion's hierarchical approach that utilizes pre-trained Vision-Language Models (VLMs) for high-level task orchestration with Vision-Language-Action (VLA) models and low-level whole-body trackers. Finally, Nikita shares the behind-the-scenes in humanoid robot demos, his take on reinforcement learning in simulation versus the real world, the nuances of reward tuning, and offers practical advice for researchers and practitioners looking to get started in robotics today. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 04:07 - Is robot locomotion solved? 06:04 - Sim-to-real gap 08:58 - Adding semantics to policies 09:42 - Modular vs end-to-end architectures 10:29 - Planner model 12:21 - Adapting RL techniques from quadrupeds to humanoids 15:39 - Behind robot demos 18:09 - Humanoid robots in home environments 22:03 - Training approach 23:56 - VLA models 27:59 - Closing the sim-to-real gap 32:55 - Task orchestration using VLMs 36:38 - Tool use 38:10 - Model hierarchy 43:37 - Simulator versus simulation environment 44:57 - Combining imitation learning and reinforcement learning 46:42 - RL in real world versus RL in simulation 52:58 - Reward tuning and value functions in robotics 56:38 - Predictions 1:00:10 - Humanoids, quadropeds, and wheeled platforms 1:02:45 - Advice, recommended robot kits, and community pla

The TWIML AI Podcast

22,592 просмотров • 7 месяцев назад

The billionaire founder of Aviator reveals how he built the world's biggest crash game in just six years "We came into the business six years ago. We knew nothing about the industry. Imagine, nothing. Now we're the No. 1 company in the world. No. 1. Imagine that. We did it in six years, and I knew nothing. I was Googling words to understand what a platform was and what an aggregator was." "The funny part is, the crash game existed before. We didn't invent it, but we made it popular."

The billionaire founder of Aviator reveals how he built the world's biggest crash game in just six years "We came into the business six years ago. We knew nothing about the industry. Imagine, nothing. Now we're the No. 1 company in the world. No. 1. Imagine that. We did it in six years, and I knew nothing. I was Googling words to understand what a platform was and what an aggregator was." "The funny part is, the crash game existed before. We didn't invent it, but we made it popular."

Mikli

116,493 просмотров • 2 месяцев назад

“We create a pretend world.” “We are a global production company. We write the screenplay, we're the directors, we're the producers, we're the main actors, and the world is our stage." The words of a Mossad agent on 60 minutes. Everyone is wondering why they would not only do the interview, but say these words. In a world where people are screaming that Israel runs politicians, USA and the world this seems like a weird interview doesn’t it? It’s threatening, intimidating and dark. Why would they do this? What’s the angle? Why? They you do the research and realize the producer of 60 minutes is Israeli Shachar Bar-On. All part of the game. 🤯

“We create a pretend world.” “We are a global production company. We write the screenplay, we're the directors, we're the producers, we're the main actors, and the world is our stage." The words of a Mossad agent on 60 minutes. Everyone is wondering why they would not only do the interview, but say these words. In a world where people are screaming that Israel runs politicians, USA and the world this seems like a weird interview doesn’t it? It’s threatening, intimidating and dark. Why would they do this? What’s the angle? Why? They you do the research and realize the producer of 60 minutes is Israeli Shachar Bar-On. All part of the game. 🤯

Peter B

213,746 просмотров • 1 год назад

🚨If President Trump walked to the Podium to say these 7 words, "We are Not ALONE in the Universe", with an Alien beside him. How would the World react? And how would we know it was a Real Alien??

🚨If President Trump walked to the Podium to say these 7 words, "We are Not ALONE in the Universe", with an Alien beside him. How would the World react? And how would we know it was a Real Alien??

UAPWixy

46,893 просмотров • 5 месяцев назад

The coolest part of Microduck might not be the robot. It's how it learns to move. This repo shows the full reinforcement learning pipeline behind Microduck. The robot learns in simulation using MuJoCo, PPO and GPU-based training, then the trained policy is exported to ONNX and deployed on the real robot. But the real challenge is sim-to-real. The simulation models things like actuator behavior, battery voltage, command delays, friction and even gear backlash. That helps make the learned policy work when it moves from simulation to the physical robot. The repo includes policies for walking, fall recovery, sitting, standing, kicking, ground picking and even roller skating. Train in simulation. Test the behavior. Export the policy. Run it on a real robot.

The coolest part of Microduck might not be the robot. It's how it learns to move. This repo shows the full reinforcement learning pipeline behind Microduck. The robot learns in simulation using MuJoCo, PPO and GPU-based training, then the trained policy is exported to ONNX and deployed on the real robot. But the real challenge is sim-to-real. The simulation models things like actuator behavior, battery voltage, command delays, friction and even gear backlash. That helps make the learned policy work when it moves from simulation to the physical robot. The repo includes policies for walking, fall recovery, sitting, standing, kicking, ground picking and even roller skating. Train in simulation. Test the behavior. Export the policy. Run it on a real robot.

Praveen Kumar Verma

125,238 просмотров • 4 дней назад