Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

I just trained cartpole in mujoco at 18 million steps per second. This policy learned in less than 3 seconds rollout policy batch size was 8192 agents

kache

318,956 subscribers

68,441 views • 3 months ago •via X (Twitter)

Gaming Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

MuJoCo 3.1.6 has just been released! MJX now comes with out-of-the-box support for height fields. Check out this joystick policy that Baruch Tabanpour trained (~2M steps per second on an A100). Colab to reproduce:

MuJoCo 3.1.6 has just been released! MJX now comes with out-of-the-box support for height fields. Check out this joystick policy that Baruch Tabanpour trained (~2M steps per second on an A100). Colab to reproduce:

Kevin Zakka

30,943 views • 2 years ago

WOW 🚨 I just fact checked this and it’s true “California has 40 million people in it. Of those 40 million people, 17.5 million pay taxes, less than half” This is why California is Blue California has become a welfare state. This is why the people who do pay taxes in California pay some of the highest taxes in the nation The 200 billionaires in California’s pay $3-6 billion per year in taxes

WOW 🚨 I just fact checked this and it’s true “California has 40 million people in it. Of those 40 million people, 17.5 million pay taxes, less than half” This is why California is Blue California has become a welfare state. This is why the people who do pay taxes in California pay some of the highest taxes in the nation The 200 billionaires in California’s pay $3-6 billion per year in taxes

Wall Street Apes

228,122 views • 5 months ago

🚨JUST IN: TRUMP'S $WLFI DUMPS MILLIONS IN $BTC The Donald J. Trump-associated WLFI has just now sold 73 $WBTC worth more than $5 million. The sale was made at a price of $69,000 per wrapped-Bitcoin according to lookonchain. Is this just the start?!

🚨JUST IN: TRUMP'S $WLFI DUMPS MILLIONS IN $BTC The Donald J. Trump-associated WLFI has just now sold 73 $WBTC worth more than $5 million. The sale was made at a price of $69,000 per wrapped-Bitcoin according to lookonchain. Is this just the start?!

BSCN

451,944 views • 6 months ago

Marketplace drama aside, agents in Framer have become ridiculously good (and efficient). I made this whole page fully responsive in one pass and it took me less than 3 mins and cost 74 credits. Insane.

Marketplace drama aside, agents in Framer have become ridiculously good (and efficient). I made this whole page fully responsive in one pass and it took me less than 3 mins and cost 74 credits. Insane.

Hamza Ehsan

26,939 views • 15 days ago

Three underground Shenzhen Metro Lines that meet at this station were all built for less than 300 million INT$ per km. Each Shenzhen Metro Line here is capable of moving over 50,000 people per hour per direction in massive 8 car Type A trains. Meanwhile below is what spending over 450 million INT$ per km gets you in Toronto, an unventilated half underground tramway.

Three underground Shenzhen Metro Lines that meet at this station were all built for less than 300 million INT$ per km. Each Shenzhen Metro Line here is capable of moving over 50,000 people per hour per direction in massive 8 car Type A trains. Meanwhile below is what spending over 450 million INT$ per km gets you in Toronto, an unventilated half underground tramway.

JR Urbane Network

33,215 views • 2 months ago

Why Political Advertisers should choose X? • This year, 𝕏 had 1,000 likes per second, 5 million impressions per minute, and more than 9 billion total engagements on posts covering News & Politics. • 84% of US policy and opinion leaders actively engage with voters across 𝕏's diverse user base of over 90 million in the US. • 98% of 𝕏's US audience is of voting age. • 250 million people use 𝕏 every day. 550 million people visit the global town square every month. 𝕏 serves as the global town square, where the public gathers to experience their lives in real-time.

Why Political Advertisers should choose X? • This year, 𝕏 had 1,000 likes per second, 5 million impressions per minute, and more than 9 billion total engagements on posts covering News & Politics. • 84% of US policy and opinion leaders actively engage with voters across 𝕏's diverse user base of over 90 million in the US. • 98% of 𝕏's US audience is of voting age. • 250 million people use 𝕏 every day. 550 million people visit the global town square every month. 𝕏 serves as the global town square, where the public gathers to experience their lives in real-time.

DogeDesigner

5,557,217 views • 2 years ago

Switzerland's obsession with bunkers stems from the Cold War and the looming threat of nuclear war. Since 1963, at the height of the Cold War, Switzerland has maintained a unique 'shelters for all' policy. According to this policy, every person in the country must have a designated spot in a bunker in case of any kind of catastrophe. The current population of Switzerland is just over 8.7 million.

Switzerland's obsession with bunkers stems from the Cold War and the looming threat of nuclear war. Since 1963, at the height of the Cold War, Switzerland has maintained a unique 'shelters for all' policy. According to this policy, every person in the country must have a designated spot in a bunker in case of any kind of catastrophe. The current population of Switzerland is just over 8.7 million.

Historic Vids

3,056,821 views • 3 years ago

Derrick White was THE INBOUNDER on this play! In less than 3 seconds, he: 1) Inbounded the ball. 2) Spaced to the corner for a potential kick-back pass. 3) Read Smart's shot and crashed the glass. 4) Tipped in the game-winner. Just an absurd basketball IQ and high-effort play.

Derrick White was THE INBOUNDER on this play! In less than 3 seconds, he: 1) Inbounded the ball. 2) Spaced to the corner for a potential kick-back pass. 3) Read Smart's shot and crashed the glass. 4) Tipped in the game-winner. Just an absurd basketball IQ and high-effort play.

Marc D'Amico

1,193,890 views • 3 years ago

Who can name this band in less than 18 seconds. This is a song from the late 90s. It was a hit for them. The song was basically a social and racial battle cry. It was a sort of "Can't we all get along?" song for the time when it was written.

Who can name this band in less than 18 seconds. This is a song from the late 90s. It was a hit for them. The song was basically a social and racial battle cry. It was a sort of "Can't we all get along?" song for the time when it was written.

🇺🇸Hot Pepper

36,502 views • 7 months ago

I just looked this up and it’s 100% true “Canned mushrooms contain 20 maggots per can. The FDA allows this. They allow 20 per can per 100 grams” The FDA in America is completely paid off and useless ‘The FDA’s Compliance Policy Guide allows canned mushrooms to contain an average of up to 20 maggots of any size per 100 grams of drained mushrooms and proportionate liquid, or an average of 5 or more maggots that are 2 mm or longer per 100 grams’

I just looked this up and it’s 100% true “Canned mushrooms contain 20 maggots per can. The FDA allows this. They allow 20 per can per 100 grams” The FDA in America is completely paid off and useless ‘The FDA’s Compliance Policy Guide allows canned mushrooms to contain an average of up to 20 maggots of any size per 100 grams of drained mushrooms and proportionate liquid, or an average of 5 or more maggots that are 2 mm or longer per 100 grams’

Wall Street Apes

1,338,291 views • 1 year ago

I just saw this post on IG. I tried sending the shelter money to save his life. Then I tried to pay a no kill shelter to take him. They said the only thing I could do was adopt him but he’s going to be put down in less than 3 hours. Tweeting in case anyone in LA can save him. 😭

I just saw this post on IG. I tried sending the shelter money to save his life. Then I tried to pay a no kill shelter to take him. They said the only thing I could do was adopt him but he’s going to be put down in less than 3 hours. Tweeting in case anyone in LA can save him. 😭

Johnnie VIBES

310,903 views • 3 years ago

System identification (sysid) is the process of finding the physical parameters that make a simulation match reality. If you're training an RL locomotion policy in simulation, the accuracy of your motor model directly affects how well the policy transfers to the real robot. A recent git commit by Kevin Zakka added a sysid toolbox to MuJoCo which automates this process: you provide recorded motor data and a MuJoCo model, and it optimizes the model parameters to minimize the difference between simulated and real trajectories. For my RobStride Dynamics RS02 QDD motors (17 Nm peak, 7.75:1 gear), I built a Rust tool that sends multi-sine torque excitation at 1 kHz and records position/velocity feedback. I then feed this data into MuJoCo's sysid optimizer.

System identification (sysid) is the process of finding the physical parameters that make a simulation match reality. If you're training an RL locomotion policy in simulation, the accuracy of your motor model directly affects how well the policy transfers to the real robot. A recent git commit by Kevin Zakka added a sysid toolbox to MuJoCo which automates this process: you provide recorded motor data and a MuJoCo model, and it optimizes the model parameters to minimize the difference between simulated and real trajectories. For my RobStride Dynamics RS02 QDD motors (17 Nm peak, 7.75:1 gear), I built a Rust tool that sends multi-sine torque excitation at 1 kHz and records position/velocity feedback. I then feed this data into MuJoCo's sysid optimizer.

David Bar

48,347 views • 4 months ago

Kid with a knife at Central High in Omaha today. Just last week OPS & parents fought to ban less-lethal options and limit what SROs can do. Teacher left helpless. No telling how this ends. This is exactly why I won’t work in OPS, having to step between kids and violent students carrying weapons while the school board and leftists strip away tools that could stop it. Policy has consequences.

Kid with a knife at Central High in Omaha today. Just last week OPS & parents fought to ban less-lethal options and limit what SROs can do. Teacher left helpless. No telling how this ends. This is exactly why I won’t work in OPS, having to step between kids and violent students carrying weapons while the school board and leftists strip away tools that could stop it. Policy has consequences.

Robert Anthony Sr.

100,981 views • 6 days ago

It's over. OpenAI just crushed it. We have their o3-level open-source model running on Groq Inc at 500 tokens per second. Watch it build an entire SaaS app in just a few seconds. This is the new standard. Why the hell would you use anything else??

It's over. OpenAI just crushed it. We have their o3-level open-source model running on Groq Inc at 500 tokens per second. Watch it build an entire SaaS app in just a few seconds. This is the new standard. Why the hell would you use anything else??

Matt Shumer

498,727 views • 1 year ago

Mercury in motion... One of the #BepiColombo selfie-cameras captured Mercury today as the spacecraft rushed by the planet at almost 3 km per second. 🛰️💨 This time-lapse of unprocessed images was captured during 10:26-11:18 UTC today (11:26-12:18 CET), between 53700 and 48000 km from the planet's surface. 📸

Mercury in motion... One of the #BepiColombo selfie-cameras captured Mercury today as the spacecraft rushed by the planet at almost 3 km per second. 🛰️💨 This time-lapse of unprocessed images was captured during 10:26-11:18 UTC today (11:26-12:18 CET), between 53700 and 48000 km from the planet's surface. 📸

BepiColombo

166,911 views • 1 year ago

Parents In This Generation Are More Childish Than The Kids At This Point😭 Bossman Dlow said “I was never broke, I was just fcked up” if you got no money in your pockets but you got motion, just go and go get it.” 💯

Parents In This Generation Are More Childish Than The Kids At This Point😭 Bossman Dlow said “I was never broke, I was just fcked up” if you got no money in your pockets but you got motion, just go and go get it.” 💯

Raphouse TV (RHTV)

253,646 views • 2 years ago

🚨 JUST IN: 🇺🇸 U.S. Vice President JD Vance said: "Iran is further away from producing a nuclear weapon than at any point in the last 20–30 years." 🇫🇷 Reports also claim that French President Emmanuel Macron questioned the consistency of U.S. policy, asking: "If Iran's nuclear capability was completely destroyed, why was the conflict restarted eight months later?"

🚨 JUST IN: 🇺🇸 U.S. Vice President JD Vance said: "Iran is further away from producing a nuclear weapon than at any point in the last 20–30 years." 🇫🇷 Reports also claim that French President Emmanuel Macron questioned the consistency of U.S. policy, asking: "If Iran's nuclear capability was completely destroyed, why was the conflict restarted eight months later?"

Levant News

247,326 views • 1 month ago