Loading video...

Video Failed to Load

Go Home

This is not for people who build World Models. I get an exclusive look inside one of the best AI labs in the world in Silicon Valley, Institute of Foundation Models, and talk with Hector Liu, Hector Liu, who leads World Model research there. These will be the “brains”...

34,135 views • 3 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Autonomous farming at Reservoir Farms in Salinas. When I got here joined a bunch of farmers from Florida who were visiting. But during the talks Bonsai Robotics caught my attention. One of the first to use world models to drive autonomous farm equipment. Here's their CEO, Tyler Niday, talking to me about what's going on in farming around the world. And of course we talk about world models. My favorite topic lately. They have robots farming in Australia and here in America in a variety of places. He ran autonomous tractors for John Deere USA for years. Reservoir Farms is an incubator—think of it like Y Combinator or Founders Inc., but for people who are making autonomous, AI-driven tractors and other farm equipment. It's a remarkable place. Worth telling anyone in farming about. @bernsteind, who runs it, used to work at Google in high tech and got the bug to help startups hit the farming market. He has a fairly big plot of land to do all sorts of testing, demos, and development work here in Salinas, with about 40 acres of a variety of different crops. That is something you can't do in Silicon Valley anymore. It takes me back to my childhood when Silicon Valley used to be all farms. It was a lot of fun hanging out with the farmers. They'll be doing some events and hackathons down here. If you're from Silicon Valley, it's only an hour south, and I highly recommend coming down to see what's going on. The AI part of farming is very similar to building an autonomous car or truck, so the kinds of jobs are very similar. The market is just very different, and the kinds of things a robot needs to figure out are different. You might be picking apples or spraying crops. You don't have pedestrian traffic, maybe, but you have other kinds of things you need to train and model on to work around. Anyways, I had a beautiful day hanging out here.

Robert Scoble

35,880 views • 2 months ago

I am stocked to announce that I won the OpenAI Developers Codex x Mollie Hacka Worldwide Hackathon in Paris. 60+ builders, every one of us working solo, one day to ship. I built mine around a single question: who gets to own intelligence? The default answer is scary. You hand your data to a handful of labs, they train the model, they own it, and you rent back a thin slice of what your own data made possible. That is the bargain on the table today. I do not accept it. So I built Lensemble: a Tapestry like distributed training platform for JEPA based World Models. What does it enable: World Models that a community improves together, keeps sovereign, and co-owns. Two bets sit underneath it. First, the paradigm. Language models predict the next token. Powerful for text, a dead end for the physical world. A robot does not need to autocomplete sentences, it needs to predict what happens next in the world. That is what JEPA does: it learns by predicting representations instead of pixels or tokens. I am convinced world models are the most underrated paradigm in AI right now, and the closest thing we have to a ChatGPT moment for robotics. Second, the politics. Your raw trajectories never leave your machine. Each participant trains locally against a shared protocol and ships only an update, never the data. A federated round folds those updates into one shared world model, a LeWorldModel based model, and the gain is measured, not claimed: a 12k-parameter adapter on a frozen backbone, held-out prediction error down about 12 percent, the model measurably less surprised by the world. Then the upside is split by contribution weight, so the people who improved the model own a share of what it earns. This is the thesis behind Project Tapestry, the AI Alliance and Yann LeCun's push for federated, sovereign frontier AI, carried into world models and robotics. Call it Tapestry for the physical world. All of it built solo, in a single day, with Codex as my pair the whole way. Thank you to OpenAI Codex and Mollie for backing builders who ship real things, and to Boris and the organizing crew for the room and the standard you set. Intelligence the world improves, and the world owns. That is the future I want for my kids, and the one I will keep building.

abdel

20,257 views • 3 months ago