Loading video...

Video Failed to Load

Go Home

AI can now turn a single image into an explorable physical world. For engineering, this means we can interact with, stress-test, and build intuition about failure in systems that do not yet exist. We can rapidly generate, interrogate, and learn from these worlds to understand how complex physical behavior...

ProfBuehlerMIT's profile picture

Markus J. Buehler

20,643 subscribers

11,713 views • 3 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Astra is an incredible world builder and explorer, and can invent its own scientific instruments - crossing a game-changing threshold: it turned a few images of a biological microstructure into a full-blown metamaterials lab, then used its own creation to discover a design with ~2.1x the reference work-to-failure/peak-strength ratio. Metamaterials are some of the most complex materials we can engineer. Their properties come from deep architectural complexity - struts, cells, disorder, and hierarchy arranged across multiple length scales determine how the material deforms, absorbs energy, and fails. Designing them means searching a geometric space far too large for "intuition" alone. In this experiment we handed an AI agent that entire problem end-to-end, from image, to simulating the physics, to fabrication-ready geometry. We started with an image of hierarchical, biological architecture; Astra then built a complete 3D metamaterial studio: editable geometries, multiple levels of hierarchy, disorder, gradients, a complete physics simulator featuring linear and nonlinear material responses, deformation and fracture experiments (with replay), and STL export for 3D printing. Then we asked the agent to use the app it created to search for a high work-to-failure/peak-strength ratio. Among the candidates, the leading design reached approximately 2.1x the reference ratio. The movie follows the structures through deformation and fracture, connects their designs to the property map, and shows the finalist assembled geometrically into a connected multi-scale material. Image ➡️ executable world ➡️ experiments ➡️ design search ➡️ candidate discovery ➡️ geometry for fabrication ➡️ manufacturing
2:09

Astra is an incredible world builder and explorer, and can invent its own scientific instruments - crossing a game-changing threshold: it turned a few images of a biological microstructure into a full-blown metamaterials lab, then used its own creation to discover a design with ~2.1x the reference work-to-failure/peak-strength ratio. Metamaterials are some of the most complex materials we can engineer. Their properties come from deep architectural complexity - struts, cells, disorder, and hierarchy arranged across multiple length scales determine how the material deforms, absorbs energy, and fails. Designing them means searching a geometric space far too large for "intuition" alone. In this experiment we handed an AI agent that entire problem end-to-end, from image, to simulating the physics, to fabrication-ready geometry. We started with an image of hierarchical, biological architecture; Astra then built a complete 3D metamaterial studio: editable geometries, multiple levels of hierarchy, disorder, gradients, a complete physics simulator featuring linear and nonlinear material responses, deformation and fracture experiments (with replay), and STL export for 3D printing. Then we asked the agent to use the app it created to search for a high work-to-failure/peak-strength ratio. Among the candidates, the leading design reached approximately 2.1x the reference ratio. The movie follows the structures through deformation and fracture, connects their designs to the property map, and shows the finalist assembled geometrically into a connected multi-scale material. Image ➡️ executable world ➡️ experiments ➡️ design search ➡️ candidate discovery ➡️ geometry for fabrication ➡️ manufacturing

Markus J. Buehler

21,343 views • 19 days ago

This is THE moment of Physical AI! We are officially announcing Cosmos 3: Omnimodal World Models for Physical AI 🚀 - Cosmos 3 is an omnimodal world model: within a unified architecture, it can understand and generate language, images, video, audio, and actions. - It is not just a VLM, not just a video generator, not just an audio-visual generative model, and not just a physics simulator / world-action model. It can understand images and videos, generate images, videos, and audio, simulate future worlds, predict actions, and generate robot policies—enabling models to truly begin to “touch the world.” - Cosmos 3 is the #1 open-weight reasoner / T2I / I2V / robot policy across many benchmarks. Huge thanks to every teammate who fought side by side on this journey—from architecture, data, training, infra, serving, and evaluation to post-training. Every part of this project carries an incredible amount of hard work. This was my first time leading a project as Tech Lead, and I feel truly fortunate. The future of Physical AI needs models that can not only “see” and “describe” the world, but also “imagine,” “simulate,” and “act”—and eventually close the loop with the real world. I hope Cosmos 3 can become an important starting point for this direction, and I’m excited to push Physical AI into its next stage together with the open-source community. Welcome to the era of Physical AI. HuggingFace: Project Website: Code:
0:44

This is THE moment of Physical AI! We are officially announcing Cosmos 3: Omnimodal World Models for Physical AI 🚀 - Cosmos 3 is an omnimodal world model: within a unified architecture, it can understand and generate language, images, video, audio, and actions. - It is not just a VLM, not just a video generator, not just an audio-visual generative model, and not just a physics simulator / world-action model. It can understand images and videos, generate images, videos, and audio, simulate future worlds, predict actions, and generate robot policies—enabling models to truly begin to “touch the world.” - Cosmos 3 is the #1 open-weight reasoner / T2I / I2V / robot policy across many benchmarks. Huge thanks to every teammate who fought side by side on this journey—from architecture, data, training, infra, serving, and evaluation to post-training. Every part of this project carries an incredible amount of hard work. This was my first time leading a project as Tech Lead, and I feel truly fortunate. The future of Physical AI needs models that can not only “see” and “describe” the world, but also “imagine,” “simulate,” and “act”—and eventually close the loop with the real world. I hope Cosmos 3 can become an important starting point for this direction, and I’m excited to push Physical AI into its next stage together with the open-source community. Welcome to the era of Physical AI. HuggingFace: Project Website: Code:

Max Zhaoshuo Li 李赵硕

1,080,061 views • 3 months ago

Grok Grok Bot is incredible - and they can even manufacture real physical objects! Here is a little experiment I did last night: I created a team of bots and asked them to solve a complex engineering problem end to end - starting from four images as design cues, inferring transferable structural principles from the pixels, synthesizing an executable interactive physics simulator, running and reasoning over experiments, optimizing the design & finally manufacturing the best designs. The entire loop worked remarkably well - and I was even able to communicate with the agents from my Apple Watch. (Do we live in the future yet?) Team of agents 1⃣ Chief of Staff coordinates the workflow: watches the other agents, pulls results into the main chat, transfers files between them, and keeps the job moving. 2⃣ Physics Experimenter is the scientist-coder. It interprets the design cues and images, writes the simulator, runs experiments, analyzes the results, and produces a detailed LaTeX scientific report. 3⃣ 3D Printing Bot operates the fabrication workflow: prepares and slices the models, generates manufacturing code, sends the job, and monitors the printer. The workflow I provided an initial task based on four unregistered reference photographs containing different objects at different scales (pinnate leaf venation, a Voronoi-like areole mesh, a stochastic fibrous lattice, and a radial/circumferential web). The prompt asked the agents to infer transferable design principles - hierarchy, branching, interfaces, redundancy, disorder, load paths - and use them to build an interactive laboratory for hierarchical materials and fracture. The scientific question was: at fixed material budget, how do hierarchy depth, redundancy, disorder, and interlevel strength change stiffness, peak load, energy absorption, and the brittle-to-progressive transition? In ~20 minutes, the Physics Experimenter produced a 2D hierarchical Euler–Bernoulli beam-network laboratory. Coarse veins persist and remain thicker; finer infill is added inside cells; members connecting levels are treated as interfaces with relative strength κ; and total material volume is conserved. The four source photographs remain visible in an editable interpretation panel. The app generates geometry, steps or runs the network to failure, compares A/B/C designs, and exports JSON, CSV, PNG, and STL geometry for fabrication. After validation the Physics Experimenter used the app and conducted 47 simulation experiments, including six holdouts. It found something scientifically interesting: extra hierarchy is not "free" toughness. At fixed volume, initial stiffness changed by only about 20%, while work-to-failure varied by several-fold. Infill steals cross-section from the main axial veins, so deeper and more redundant networks often absorbed less energy than a simple depth-1 grid. Weak interfaces behaved as distributed fuses, producing more progressive failure and reducing localization. The specific H2 hypothesis - that hierarchy becomes detrimental primarily because interfaces form a mechanical bottleneck - was rejected; the dominant effect instead came from redistribution of a fixed material budget across structural levels. The Physics Experimenter then assembled the methods, tests, results, hypothesis evaluation, and conclusions into a detailed scientific report. The best designs were passed to the 3D Printing Bot. It opened Bambu Studio and brought the Bambu Lab H2D online. Both STLs were placed on one build plate at the same 50x scale and sliced using a 0.20 mm PLA process. The prints completed within less than an hour. The loop images → structural abstraction → executable physics → autonomous experiments → hypothesis testing → design selection → STL → slicing/manufacturing code → physical object That last transition is what I find especially interesting: AI is beginning to operate across the entire scientific and physical workflow - converting observations into models, models into experiments, experimental evidence into revised designs, and those designs into manufactured matter by directly operating machines. This starts to blur the boundary between AI that reasons about the physical world and AI that can actually act on it. Shoutout to the Grok Bot team - you are building something very special here! The way these agents can move naturally from reasoning, to experiments, to operating machines in the physical world feels like an important step.
3:01

Grok Grok Bot is incredible - and they can even manufacture real physical objects! Here is a little experiment I did last night: I created a team of bots and asked them to solve a complex engineering problem end to end - starting from four images as design cues, inferring transferable structural principles from the pixels, synthesizing an executable interactive physics simulator, running and reasoning over experiments, optimizing the design & finally manufacturing the best designs. The entire loop worked remarkably well - and I was even able to communicate with the agents from my Apple Watch. (Do we live in the future yet?) Team of agents 1⃣ Chief of Staff coordinates the workflow: watches the other agents, pulls results into the main chat, transfers files between them, and keeps the job moving. 2⃣ Physics Experimenter is the scientist-coder. It interprets the design cues and images, writes the simulator, runs experiments, analyzes the results, and produces a detailed LaTeX scientific report. 3⃣ 3D Printing Bot operates the fabrication workflow: prepares and slices the models, generates manufacturing code, sends the job, and monitors the printer. The workflow I provided an initial task based on four unregistered reference photographs containing different objects at different scales (pinnate leaf venation, a Voronoi-like areole mesh, a stochastic fibrous lattice, and a radial/circumferential web). The prompt asked the agents to infer transferable design principles - hierarchy, branching, interfaces, redundancy, disorder, load paths - and use them to build an interactive laboratory for hierarchical materials and fracture. The scientific question was: at fixed material budget, how do hierarchy depth, redundancy, disorder, and interlevel strength change stiffness, peak load, energy absorption, and the brittle-to-progressive transition? In ~20 minutes, the Physics Experimenter produced a 2D hierarchical Euler–Bernoulli beam-network laboratory. Coarse veins persist and remain thicker; finer infill is added inside cells; members connecting levels are treated as interfaces with relative strength κ; and total material volume is conserved. The four source photographs remain visible in an editable interpretation panel. The app generates geometry, steps or runs the network to failure, compares A/B/C designs, and exports JSON, CSV, PNG, and STL geometry for fabrication. After validation the Physics Experimenter used the app and conducted 47 simulation experiments, including six holdouts. It found something scientifically interesting: extra hierarchy is not "free" toughness. At fixed volume, initial stiffness changed by only about 20%, while work-to-failure varied by several-fold. Infill steals cross-section from the main axial veins, so deeper and more redundant networks often absorbed less energy than a simple depth-1 grid. Weak interfaces behaved as distributed fuses, producing more progressive failure and reducing localization. The specific H2 hypothesis - that hierarchy becomes detrimental primarily because interfaces form a mechanical bottleneck - was rejected; the dominant effect instead came from redistribution of a fixed material budget across structural levels. The Physics Experimenter then assembled the methods, tests, results, hypothesis evaluation, and conclusions into a detailed scientific report. The best designs were passed to the 3D Printing Bot. It opened Bambu Studio and brought the Bambu Lab H2D online. Both STLs were placed on one build plate at the same 50x scale and sliced using a 0.20 mm PLA process. The prints completed within less than an hour. The loop images → structural abstraction → executable physics → autonomous experiments → hypothesis testing → design selection → STL → slicing/manufacturing code → physical object That last transition is what I find especially interesting: AI is beginning to operate across the entire scientific and physical workflow - converting observations into models, models into experiments, experimental evidence into revised designs, and those designs into manufactured matter by directly operating machines. This starts to blur the boundary between AI that reasons about the physical world and AI that can actually act on it. Shoutout to the Grok Bot team - you are building something very special here! The way these agents can move naturally from reasoning, to experiments, to operating machines in the physical world feels like an important step.

Markus J. Buehler

1,128,269 views • 1 month ago

We built recursive meta-intelligence, an AI that creates its own scientific instruments, turns them into persistent worlds that an agent ecology with hundreds of AIs inhabits, and uses those worlds to discover mechanistic principles in one of the hardest classes of physical problems: how complex hierarchical materials (nested structures of matter that give rise to new function through organization) evolve and fail. The AI reasons across enormous spaces of possible physical trajectories, where every rupture changes what can happen next, and compresses those histories into principles (which humans can understand and design with) - complex chains of causal events, highly nonlinear, and intricate. Scientific superintelligence is tangible here - machine-scale exploration opening cognitive channels into complexity that has been extremely difficult for humans to traverse directly. AI builds the spaces in which its next level of reasoning becomes possible; a representation becomes an instrument, the instrument becomes an executable world, and that world becomes the substrate for further intelligence. Intelligence then grows by constructing new spaces to think in. The task we explored started from a seemingly simple prompt to explore a biological material system - the AI then chose the representation, mechanics and experiments, built a fracture laboratory to push materials to their limit, tested hypotheses and generated scientific conclusions. The swarm explored a combinatorial universe in which architecture controls function and every rupture changes the future state of the material. The AI discovered a compact principle that defines how multiscale material architecture can program the evolution of failure. Material placement and geometric order determine how forces redistribute, whether damage cascades or remains distributed, and whether function survives substantial flaws. For this discovery to happen the AI had to reason across long path-dependent histories, simulate alternative futures and compress them into generative invariants (model-based causal reasoning, counterfactual simulation and temporal abstraction applied to an evolving physical world). It is incredible to witness this transition to a new form of intelligence and capability through scaling swarms. A lot of positive will come out of this because it expands the human epistemic horizon as AI can traverse thousands of possible histories and return mechanisms compact enough for us to understand, test and build from. Intelligence compounds through its artifacts! A few lessons we learned: ▶️ Learning and discovery are flows through spaces of possibility. Early work has shown how backpropagation flows through parameters, reinforcement learning through action and consequence, and autonomous swarms through representations, instruments and executable worlds, bringing it all together. Flows create structure; structure redirects future flows in the recursive instrument. ▶️ Nonlinear physics actually defines a larger principle, where high-dimensional dynamics generate stable invariants; invariants become effective variables; those variables become the substrate for a new level of cognition. ▶️ Recursion then becomes level creation - one possibility space compresses into a principle, and that principle opens a larger space above it.
2:37

We built recursive meta-intelligence, an AI that creates its own scientific instruments, turns them into persistent worlds that an agent ecology with hundreds of AIs inhabits, and uses those worlds to discover mechanistic principles in one of the hardest classes of physical problems: how complex hierarchical materials (nested structures of matter that give rise to new function through organization) evolve and fail. The AI reasons across enormous spaces of possible physical trajectories, where every rupture changes what can happen next, and compresses those histories into principles (which humans can understand and design with) - complex chains of causal events, highly nonlinear, and intricate. Scientific superintelligence is tangible here - machine-scale exploration opening cognitive channels into complexity that has been extremely difficult for humans to traverse directly. AI builds the spaces in which its next level of reasoning becomes possible; a representation becomes an instrument, the instrument becomes an executable world, and that world becomes the substrate for further intelligence. Intelligence then grows by constructing new spaces to think in. The task we explored started from a seemingly simple prompt to explore a biological material system - the AI then chose the representation, mechanics and experiments, built a fracture laboratory to push materials to their limit, tested hypotheses and generated scientific conclusions. The swarm explored a combinatorial universe in which architecture controls function and every rupture changes the future state of the material. The AI discovered a compact principle that defines how multiscale material architecture can program the evolution of failure. Material placement and geometric order determine how forces redistribute, whether damage cascades or remains distributed, and whether function survives substantial flaws. For this discovery to happen the AI had to reason across long path-dependent histories, simulate alternative futures and compress them into generative invariants (model-based causal reasoning, counterfactual simulation and temporal abstraction applied to an evolving physical world). It is incredible to witness this transition to a new form of intelligence and capability through scaling swarms. A lot of positive will come out of this because it expands the human epistemic horizon as AI can traverse thousands of possible histories and return mechanisms compact enough for us to understand, test and build from. Intelligence compounds through its artifacts! A few lessons we learned: ▶️ Learning and discovery are flows through spaces of possibility. Early work has shown how backpropagation flows through parameters, reinforcement learning through action and consequence, and autonomous swarms through representations, instruments and executable worlds, bringing it all together. Flows create structure; structure redirects future flows in the recursive instrument. ▶️ Nonlinear physics actually defines a larger principle, where high-dimensional dynamics generate stable invariants; invariants become effective variables; those variables become the substrate for a new level of cognition. ▶️ Recursion then becomes level creation - one possibility space compresses into a principle, and that principle opens a larger space above it.

Markus J. Buehler

586,929 views • 11 days ago

In the era of 10T-parameter foundation models 😈, can we still build next-generation world representations using 🦥 a single RTX 3090 GPU? We introduce WorldString (a name inspired by string theory), a tiny neural network representation for reconstructing dynamic world instances, ranging from articulated motion and skeletal skinning to soft-body deformation. 🔥 We view object representation as the core primitive of world modeling: the basic executable unit from which perception, interaction, simulation, and generation can be built. With a compact neural basis, WorldString aims to connect dynamic object modeling with neural simulation and foundation models, enabling a scalable path toward richer representations of the physical world.
0:29

In the era of 10T-parameter foundation models 😈, can we still build next-generation world representations using 🦥 a single RTX 3090 GPU? We introduce WorldString (a name inspired by string theory), a tiny neural network representation for reconstructing dynamic world instances, ranging from articulated motion and skeletal skinning to soft-body deformation. 🔥 We view object representation as the core primitive of world modeling: the basic executable unit from which perception, interaction, simulation, and generation can be built. With a compact neural basis, WorldString aims to connect dynamic object modeling with neural simulation and foundation models, enabling a scalable path toward richer representations of the physical world.

Xueyan Zou

39,394 views • 3 months ago

Can we compile matter - for instance, a pine cone - and derive new active materials, end-to-end from observation to manufacturing? If physical systems can be formalized as composable mathematics, we can point AI that has been shown to resolve long-open mathematical problems at matter itself. Our new work turns bioinspired engineering from analogy into formal compilation: biology and mechanics become explicit, checkable, and executable, so AI reasoning can produce physical designs. This is the first end-to-end demonstration in which a formally compositional multiscale model is carried from a biological hierarchy, through engineered design and fabrication specification, to executable manufacturing code - and then to a physically tested artifact. Background: Humans have long been inspired by biology to advance technology, but this has usually been an ad hoc process rather than a mathematically rigorous one. Natural materials such as pinecones achieve adaptive behavior through mechanisms organized across many scales. Engineering typically translates those mechanisms by analogy: identify a biological principle, build something inspired by it, and validate each new design as a separate case. This can produce remarkable results, but the knowledge does not readily compound. Instead, we represent each scale as a dynamical module with explicit states, stimuli, governing laws, and interfaces. Every scale-to-scale map must preserve the stimulus - response dynamics: evolve the fine-scale system and then map upward, or map upward first and then evolve. The two paths must agree. Because this condition is preserved under composition, locally valid interfaces remain consistent when assembled into the full hierarchy. We then carry that structure into an engineered system, translate the target behavior into a verified fabrication specification, and compile it into G-code: the toolpaths, deposition sequence, temperatures, speeds, and other commands executed by a 3D printer. The intermediate translations are explicit, checkable, and executable rather than completed through an ad hoc handoff. The formal guarantee is that given valid local models and interfaces, their composition remains valid. Whether those models and manufacturing assumptions accurately capture physical reality remains an empirical question. That is why we fabricated and tested the results. We generated four actuator classes by crossing two stimuli - humidity and heat - with two responses: bending and twisting. The fourth, thermal twisting, required no new pipeline and no separate derivation within the framework. It emerged by composing a thermal stimulus module already validated in one case with a twisting module validated in another. The generated G-code produced the intended motion without manual redesign, and all four predictions fell within one experimental standard deviation of the measured response. Why this matters: 1⃣For AI in science, this provides a physics-aware type system against which generative proposals can be checked - and rejected at the interface - before expensive simulation, fabrication, or experiment. It is roughly analogous to proof checking, but for the composition of physical mechanisms. 2⃣For engineering, the accessible design space can scale with a library of validated components rather than with the number of individually derived cases. 3⃣The mathematics, category theory, carries all the way into a physical object on a print bed. This points toward scientific knowledge as executable infrastructure: models that are not only described in papers, but typed, composable, verifiable, and able to compile into experiments. Excellent work led by my student Lee Marom with Skylar Tibbits & Gioele Zardini. Paper published in J. Mech. Phys. Solids along with code, Grasshopper scripts, and manufacturing G-code below.
1:21

Can we compile matter - for instance, a pine cone - and derive new active materials, end-to-end from observation to manufacturing? If physical systems can be formalized as composable mathematics, we can point AI that has been shown to resolve long-open mathematical problems at matter itself. Our new work turns bioinspired engineering from analogy into formal compilation: biology and mechanics become explicit, checkable, and executable, so AI reasoning can produce physical designs. This is the first end-to-end demonstration in which a formally compositional multiscale model is carried from a biological hierarchy, through engineered design and fabrication specification, to executable manufacturing code - and then to a physically tested artifact. Background: Humans have long been inspired by biology to advance technology, but this has usually been an ad hoc process rather than a mathematically rigorous one. Natural materials such as pinecones achieve adaptive behavior through mechanisms organized across many scales. Engineering typically translates those mechanisms by analogy: identify a biological principle, build something inspired by it, and validate each new design as a separate case. This can produce remarkable results, but the knowledge does not readily compound. Instead, we represent each scale as a dynamical module with explicit states, stimuli, governing laws, and interfaces. Every scale-to-scale map must preserve the stimulus - response dynamics: evolve the fine-scale system and then map upward, or map upward first and then evolve. The two paths must agree. Because this condition is preserved under composition, locally valid interfaces remain consistent when assembled into the full hierarchy. We then carry that structure into an engineered system, translate the target behavior into a verified fabrication specification, and compile it into G-code: the toolpaths, deposition sequence, temperatures, speeds, and other commands executed by a 3D printer. The intermediate translations are explicit, checkable, and executable rather than completed through an ad hoc handoff. The formal guarantee is that given valid local models and interfaces, their composition remains valid. Whether those models and manufacturing assumptions accurately capture physical reality remains an empirical question. That is why we fabricated and tested the results. We generated four actuator classes by crossing two stimuli - humidity and heat - with two responses: bending and twisting. The fourth, thermal twisting, required no new pipeline and no separate derivation within the framework. It emerged by composing a thermal stimulus module already validated in one case with a twisting module validated in another. The generated G-code produced the intended motion without manual redesign, and all four predictions fell within one experimental standard deviation of the measured response. Why this matters: 1⃣For AI in science, this provides a physics-aware type system against which generative proposals can be checked - and rejected at the interface - before expensive simulation, fabrication, or experiment. It is roughly analogous to proof checking, but for the composition of physical mechanisms. 2⃣For engineering, the accessible design space can scale with a library of validated components rather than with the number of individually derived cases. 3⃣The mathematics, category theory, carries all the way into a physical object on a print bed. This points toward scientific knowledge as executable infrastructure: models that are not only described in papers, but typed, composable, verifiable, and able to compile into experiments. Excellent work led by my student Lee Marom with Skylar Tibbits & Gioele Zardini. Paper published in J. Mech. Phys. Solids along with code, Grasshopper scripts, and manufacturing G-code below.

Markus J. Buehler

128,895 views • 1 month ago

SimCity on AI with Grok Grok Bot: do you remember playing SimCity? It was one of the first games on my 80386 and it intrigued me because it explored emergence as a goal. Grok Bot built an AI-native version: City Bots, whose citizens are AI agents that you can collaborate with. Grok Bot did the entire build and pushed the app via Cloudflare (link to play below). You can chat with agents, direct the civilization, ask questions. You can partake in building…co-build and co-create…(how engineers of the future will work!). And you can generate entirely new worlds on the fly. This turned out to be a layered experiment about human-AI collaboration, swarm behavior, and generative intelligence. First, City Bots splits cognition from consequence - agents emit claims, and physics decides what happens, and both evolve as the game proceeds. Second, beyond the original goal of accelerating software development, Grok Bot became part of the experiment and turned a research system into a participatory world; conducting experiments on on its own, and forming a deep recursive layer: An agentic system built a world inhabited by AI agents. City Bots makes world-building a continuous process experienced by humans and AI agents: Worlds not seen, tiles not laid, paths not yet taken... What I love about this is how easy and FUN it was to convert our research-grade swarm code into a playable app via Grok Bot. Next we’ll wire up physical artifacts into the world to create deeper integration between in silico and reality! More about the game: Terrain, resources, physics, and natural disasters create constraints and consequences, while agents and humans can build and transform the world together.…they wander and explore, make decisions, build, interact with each other. AI bots become co-inhabitants and co-creators whose micro-decisions cumulatively alter the macro-environment. This is a preview of a forthcoming paper where we explore world building and scientific discovery with swarms at scale… stay tuned...
3:58

SimCity on AI with Grok Grok Bot: do you remember playing SimCity? It was one of the first games on my 80386 and it intrigued me because it explored emergence as a goal. Grok Bot built an AI-native version: City Bots, whose citizens are AI agents that you can collaborate with. Grok Bot did the entire build and pushed the app via Cloudflare (link to play below). You can chat with agents, direct the civilization, ask questions. You can partake in building…co-build and co-create…(how engineers of the future will work!). And you can generate entirely new worlds on the fly. This turned out to be a layered experiment about human-AI collaboration, swarm behavior, and generative intelligence. First, City Bots splits cognition from consequence - agents emit claims, and physics decides what happens, and both evolve as the game proceeds. Second, beyond the original goal of accelerating software development, Grok Bot became part of the experiment and turned a research system into a participatory world; conducting experiments on on its own, and forming a deep recursive layer: An agentic system built a world inhabited by AI agents. City Bots makes world-building a continuous process experienced by humans and AI agents: Worlds not seen, tiles not laid, paths not yet taken... What I love about this is how easy and FUN it was to convert our research-grade swarm code into a playable app via Grok Bot. Next we’ll wire up physical artifacts into the world to create deeper integration between in silico and reality! More about the game: Terrain, resources, physics, and natural disasters create constraints and consequences, while agents and humans can build and transform the world together.…they wander and explore, make decisions, build, interact with each other. AI bots become co-inhabitants and co-creators whose micro-decisions cumulatively alter the macro-environment. This is a preview of a forthcoming paper where we explore world building and scientific discovery with swarms at scale… stay tuned...

Markus J. Buehler

14,579 views • 1 month ago

Reinforcement learning has unlocked tremendous gains in broader AI and humanoid robot whole body control, but still has yet to deliver strong results for robot manipulation due to the difficulty of capturing tasks in an accurate simulation; one way to fix this is to create complex environments with learned world models. But learning fully within world models is often intractable as powerful world models are computationally too expensive. Instead, Joseph Amigo and Rooholla Khorrambakht propose to break the problem down: into a large-scale world model that can generate forward trajectories, and a lightweight, low-dimensional latent-space model which can approximate local dynamics of a problem, without needing to back-propagate through a heavy global model. What this means: you can do reinforcement learning in this coupled local-global world model, and learn contact rich skills for a robot. To learn more, watch Episode #101 of RoboPapers, with Michael Cho - Rbt/Acc and Jiafei Duan!
51:25

Reinforcement learning has unlocked tremendous gains in broader AI and humanoid robot whole body control, but still has yet to deliver strong results for robot manipulation due to the difficulty of capturing tasks in an accurate simulation; one way to fix this is to create complex environments with learned world models. But learning fully within world models is often intractable as powerful world models are computationally too expensive. Instead, Joseph Amigo and Rooholla Khorrambakht propose to break the problem down: into a large-scale world model that can generate forward trajectories, and a lightweight, low-dimensional latent-space model which can approximate local dynamics of a problem, without needing to back-propagate through a heavy global model. What this means: you can do reinforcement learning in this coupled local-global world model, and learn contact rich skills for a robot. To learn more, watch Episode #101 of RoboPapers, with Michael Cho - Rbt/Acc and Jiafei Duan!

RoboPapers

16,760 views • 22 days ago

Roger Ebert on Louis Malle's "Damage" (1992): "Watching 'Damage' (1992) is like watching an emotional traffic accident as it unfolds. The film is based on the best seller by Josephine Hart, which had a certain undeniable power, but the right place for this material is the screen, I think, because it can show exactly how the two look at one another. This is a movie about sight; from the first moment the two meet, it is filled with what is seen and what is not seen, as Stephen [Jeremy Irons] suffers though a dinner party with his wife, his son, Anna [Juliette Binoche] and her mother – and some observe, and some do not, what has happened. (...) 'Damage' is one of those rare movies that is about s*xuality, not s*x; about the tension between people, not “relationships”; about how physical love is meaningless without a psychic engine behind it. Stephen and Anna are wrong to do what they do in 'Damage' but they cannot help themselves. We know they are careening toward disaster. We cannot look away." ("Damage", Roger Ebert, 1993)
1:47

Roger Ebert on Louis Malle's "Damage" (1992): "Watching 'Damage' (1992) is like watching an emotional traffic accident as it unfolds. The film is based on the best seller by Josephine Hart, which had a certain undeniable power, but the right place for this material is the screen, I think, because it can show exactly how the two look at one another. This is a movie about sight; from the first moment the two meet, it is filled with what is seen and what is not seen, as Stephen [Jeremy Irons] suffers though a dinner party with his wife, his son, Anna [Juliette Binoche] and her mother – and some observe, and some do not, what has happened. (...) 'Damage' is one of those rare movies that is about s*xuality, not s*x; about the tension between people, not “relationships”; about how physical love is meaningless without a psychic engine behind it. Stephen and Anna are wrong to do what they do in 'Damage' but they cannot help themselves. We know they are careening toward disaster. We cannot look away." ("Damage", Roger Ebert, 1993)

DepressedBergman

40,321 views • 3 months ago

Automating the lab bench is the best thing we can do for AI in biology. Most experiments are still run by hand. Every biologist's handiwork is unique and every lab is a little different. So, biology faces widespread reproducibility issues. But, AI will demand more reproducible data than we can produce, and generate more ideas than we can test. Experiments must be communicated and executed in a standardized way to generate reproducible data. So, Tetsuwan is building a lab where users specify experiments in an exact syntax. These experiments are executed by an automated platform to generate transparent, reproducible output. The user never needs physical access to a lab. This is a biology lab you can use like a computer. Our platform, built and tested with pilot labs over the past two years, lets users configure automated workflows rapidly & precisely. Later this year, we will bring our first services online, focusing on functional screens for protein design. Alex and I met at Caltech, where she was one year my senior. We're building this company because we were little kids who wanted to be biologists that grew up into adults who resented the lab bench. We want biology to be about asking questions, not the painful and frustrating manual process of asking them. For those looking to receive updates on our pilot services, looking for a meaningful job, or just to learn more about our work, see the links in the comments!
0:59

Automating the lab bench is the best thing we can do for AI in biology. Most experiments are still run by hand. Every biologist's handiwork is unique and every lab is a little different. So, biology faces widespread reproducibility issues. But, AI will demand more reproducible data than we can produce, and generate more ideas than we can test. Experiments must be communicated and executed in a standardized way to generate reproducible data. So, Tetsuwan is building a lab where users specify experiments in an exact syntax. These experiments are executed by an automated platform to generate transparent, reproducible output. The user never needs physical access to a lab. This is a biology lab you can use like a computer. Our platform, built and tested with pilot labs over the past two years, lets users configure automated workflows rapidly & precisely. Later this year, we will bring our first services online, focusing on functional screens for protein design. Alex and I met at Caltech, where she was one year my senior. We're building this company because we were little kids who wanted to be biologists that grew up into adults who resented the lab bench. We want biology to be about asking questions, not the painful and frustrating manual process of asking them. For those looking to receive updates on our pilot services, looking for a meaningful job, or just to learn more about our work, see the links in the comments!

Cristian Ponce

1,140,918 views • 3 months ago

.Applied Intuition wants to make robotics as easy as building an iPhone app: "Dana is our new agentic platform for physical AI. This really is the culmination of pretty much everything we've worked on now over the last decade." "Building physical AI is extremely complicated... We know how to make the chips. We know how to make the hardware for these systems. It's more so actually developing all of this technology and getting it to work that is very, very difficult." "With modern AI and with this new Dana platform, we're really drastically reducing the barrier to entry to building physical AI and deploying it in the real world." "If you're building an app for an iPhone, high school kids can do that now because there's all of these things that exist and that make it easy... It's very hard to do that in terms of robotics." "The thing that Peter's really emphasizing and thing that we really wanna do is just lower the bar. So anybody really out there, starting with engineers, but ultimately really anybody can develop robots." Applied Intuition Co-founders Peter Ludwig and Qasar Younis on Business Breakdowns
2:24

.Applied Intuition wants to make robotics as easy as building an iPhone app: "Dana is our new agentic platform for physical AI. This really is the culmination of pretty much everything we've worked on now over the last decade." "Building physical AI is extremely complicated... We know how to make the chips. We know how to make the hardware for these systems. It's more so actually developing all of this technology and getting it to work that is very, very difficult." "With modern AI and with this new Dana platform, we're really drastically reducing the barrier to entry to building physical AI and deploying it in the real world." "If you're building an app for an iPhone, high school kids can do that now because there's all of these things that exist and that make it easy... It's very hard to do that in terms of robotics." "The thing that Peter's really emphasizing and thing that we really wanna do is just lower the bar. So anybody really out there, starting with engineers, but ultimately really anybody can develop robots." Applied Intuition Co-founders Peter Ludwig and Qasar Younis on Business Breakdowns

a16z

34,900 views • 2 months ago

I believe safety is important, but we must distinguish between two very different narratives: The "Sci-Fi" Narrative: Stories about AI controlling the world, having "feelings," or possessing secret intelligence designed to fool us. Too often, the research in this narrative is used for PR or as an excuse to stifle open-source research. The Engineering Reality: How do we build systems that are robust and hard to break? As Yann points out, current LLMs rely on post-training for safety, which is inherently fragile and can always be jailbroken. He argues for "Objective-Driven AI, which means systems that satisfy safety constraints by construction, similar to how a jet engine is engineered to handle stress. I agree with Yann that patching models with fine-tuning isn't the long-term solution. However, the practical path to embedding these hard "guardrails" into a reasoning agent is still a massive open question. We know what we need, but we haven't figured out how to build it effectively in practice.
4:50

I believe safety is important, but we must distinguish between two very different narratives: The "Sci-Fi" Narrative: Stories about AI controlling the world, having "feelings," or possessing secret intelligence designed to fool us. Too often, the research in this narrative is used for PR or as an excuse to stifle open-source research. The Engineering Reality: How do we build systems that are robust and hard to break? As Yann points out, current LLMs rely on post-training for safety, which is inherently fragile and can always be jailbroken. He argues for "Objective-Driven AI, which means systems that satisfy safety constraints by construction, similar to how a jet engine is engineered to handle stress. I agree with Yann that patching models with fine-tuning isn't the long-term solution. However, the practical path to embedding these hard "guardrails" into a reasoning agent is still a massive open question. We know what we need, but we haven't figured out how to build it effectively in practice.

Ravid Shwartz Ziv

23,782 views • 9 months ago

World Simulator, reimagined — now alive with humans, robots, and their vibrant society unfolding in 3D real-world geospatial scenes across the globe! 🚀 One day soon, humans and robots will co-exist in the same world. To prepare, we must address: 1️⃣ How can robots cooperate or compete intelligently? 2️⃣ How do humans build social bonds and communities? 3️⃣ How can both co-exist in an open, dynamic world? Announcing Virtual Community Project — a social-physical world simulator, where human characters and robotic agents can interact, grow, and co-evolve within open-world societies, stretching from London to New York, and beyond! Key features include: ✅ Unified multi-agent physics simulations for rich social + physical interactions of humans and robots ✅ Massive auto-generated 3D scenes grounded with the rea-world geospatial data ✅ Agent communities populated by robots and LLM-driven human characters with rich appearances, personalities, and social ties. 🌍 Enter our Virtual Community, an open world to study embodied AI at scale— one social-physical world model at a time! 🔗 Project: 💻 Code: Paper: 1/n
0:53

World Simulator, reimagined — now alive with humans, robots, and their vibrant society unfolding in 3D real-world geospatial scenes across the globe! 🚀 One day soon, humans and robots will co-exist in the same world. To prepare, we must address: 1️⃣ How can robots cooperate or compete intelligently? 2️⃣ How do humans build social bonds and communities? 3️⃣ How can both co-exist in an open, dynamic world? Announcing Virtual Community Project — a social-physical world simulator, where human characters and robotic agents can interact, grow, and co-evolve within open-world societies, stretching from London to New York, and beyond! Key features include: ✅ Unified multi-agent physics simulations for rich social + physical interactions of humans and robots ✅ Massive auto-generated 3D scenes grounded with the rea-world geospatial data ✅ Agent communities populated by robots and LLM-driven human characters with rich appearances, personalities, and social ties. 🌍 Enter our Virtual Community, an open world to study embodied AI at scale— one social-physical world model at a time! 🔗 Project: 💻 Code: Paper: 1/n

Chuang Gan

90,664 views • 1 year ago

10 more days to get tickets to the fifth annual beartaria festival in the heart of the Missouri ozarks. How can we build more quality into the systems we interact with? So that our life has a higher yield and a higher joy. It’s not about running away, it’s not about some “secret” or magical person that fixes everything. It’s about having a place to go once a year that’s safe and fun for our families. Where we can learn, laugh, jam, play sports, build, and have epic hangs. Onward! Oct 9-11
5:35

10 more days to get tickets to the fifth annual beartaria festival in the heart of the Missouri ozarks. How can we build more quality into the systems we interact with? So that our life has a higher yield and a higher joy. It’s not about running away, it’s not about some “secret” or magical person that fixes everything. It’s about having a place to go once a year that’s safe and fun for our families. Where we can learn, laugh, jam, play sports, build, and have epic hangs. Onward! Oct 9-11

Owen Benjamin 🐻

49,436 views • 4 days ago

SITUATION EXPLAINED: A new generation of AI labs are betting that world models are the path to general intelligence that can interact with the real world. We had General Intuition CEO Pim de Witte on MTS to explain what world models are, and why intuitively world models offer a clearer path towards general intelligence than LLMs. For humans, text is a technology for compressing information about the unfolding, three-dimensional world around us and communicating it to other people. When LLMs reason about the world, they do so by reconstructing the world through text. World models work by modeling the three-dimensional world at the architecture level and then allowing agents to interact with that world. Unlike an LLM, which understands space and time through text, world models perform spatial and temporal reasoning natively. General Intuition hopes to use world models to create embodied AI—machines that can reason and act in the real world. But other companies are also pushing the frontier in this space. Odyssey ML today announced a multi-agent world model, Agora-1. Their launch video shows four participants interacting with a real-time world model simulation of GoldenEye, a first-person shooter for the N64. A playable preview of the GoldenEye simulation is available on their site.
1:31

SITUATION EXPLAINED: A new generation of AI labs are betting that world models are the path to general intelligence that can interact with the real world. We had General Intuition CEO Pim de Witte on MTS to explain what world models are, and why intuitively world models offer a clearer path towards general intelligence than LLMs. For humans, text is a technology for compressing information about the unfolding, three-dimensional world around us and communicating it to other people. When LLMs reason about the world, they do so by reconstructing the world through text. World models work by modeling the three-dimensional world at the architecture level and then allowing agents to interact with that world. Unlike an LLM, which understands space and time through text, world models perform spatial and temporal reasoning natively. General Intuition hopes to use world models to create embodied AI—machines that can reason and act in the real world. But other companies are also pushing the frontier in this space. Odyssey ML today announced a multi-agent world model, Agora-1. Their launch video shows four participants interacting with a real-time world model simulation of GoldenEye, a first-person shooter for the N64. A playable preview of the GoldenEye simulation is available on their site.

MTS

11,693 views • 4 months ago

I made tons of money building websites for people and small companies. Most of that is now gone. You can now generate, customize, and deploy a website using natural language. I recorded myself building a site from scratch using 10Web.io. 4 minutes later, I had a full website generated just for me. Crazy! That's mostly how I paid rent when I graduated college: I'd either build you a new site or make changes to an existing one. It's nuts anyone can do that today by just asking. But this doesn't stop with generating a website. 10Web also released an AI Copilot that you can use to edit a website with a chat-based AI assistant. Here is what you can do with the AI Copilot: 1. You can edit individual elements and widgets on your site by selecting them and describing the changes you want. 2. You can generate new images, create sections, and generate or edit text. 3. You can also add any new elements to the site. The best way to understand how much progress we've made is by looking at the AI Copilot in action: And the funny part is that we are just figuring out how to use AI models. 2025 will be crazy.
4:17

I made tons of money building websites for people and small companies. Most of that is now gone. You can now generate, customize, and deploy a website using natural language. I recorded myself building a site from scratch using 10Web.io. 4 minutes later, I had a full website generated just for me. Crazy! That's mostly how I paid rent when I graduated college: I'd either build you a new site or make changes to an existing one. It's nuts anyone can do that today by just asking. But this doesn't stop with generating a website. 10Web also released an AI Copilot that you can use to edit a website with a chat-based AI assistant. Here is what you can do with the AI Copilot: 1. You can edit individual elements and widgets on your site by selecting them and describing the changes you want. 2. You can generate new images, create sections, and generate or edit text. 3. You can also add any new elements to the site. The best way to understand how much progress we've made is by looking at the AI Copilot in action: And the funny part is that we are just figuring out how to use AI models. 2025 will be crazy.

Santiago

57,967 views • 1 year ago

Welcome to AI, Explained by Humans, where we break down new developments in AI and how they'll affect your daily life. Research from leading AI labs suggests that AI systems are capable of lying, scheming, and surprising their creators. Whether or not AI can be conscious, it is clearly doing something markedly more sophisticated than previous generations of digital technology. Today, reporter Tharin Pillay breaks down the discussions happening between researchers, innovators, and even philosophers to figure out if AI has a mind, what it can do with that mind, and what that means for how we interact with it.
1:35

Welcome to AI, Explained by Humans, where we break down new developments in AI and how they'll affect your daily life. Research from leading AI labs suggests that AI systems are capable of lying, scheming, and surprising their creators. Whether or not AI can be conscious, it is clearly doing something markedly more sophisticated than previous generations of digital technology. Today, reporter Tharin Pillay breaks down the discussions happening between researchers, innovators, and even philosophers to figure out if AI has a mind, what it can do with that mind, and what that means for how we interact with it.

TIME

20,302 views • 7 months ago