Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

AI can now turn a single image into an explorable physical world. For engineering, this means we can interact with, stress-test, and build intuition about failure in systems that do not yet exist. We can rapidly generate, interrogate, and learn from these worlds to understand how complex physical behavior...

11,713 Aufrufe • vor 2 Monaten •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

This is THE moment of Physical AI! We are officially announcing Cosmos 3: Omnimodal World Models for Physical AI 🚀 - Cosmos 3 is an omnimodal world model: within a unified architecture, it can understand and generate language, images, video, audio, and actions. - It is not just a VLM, not just a video generator, not just an audio-visual generative model, and not just a physics simulator / world-action model. It can understand images and videos, generate images, videos, and audio, simulate future worlds, predict actions, and generate robot policies—enabling models to truly begin to “touch the world.” - Cosmos 3 is the #1 open-weight reasoner / T2I / I2V / robot policy across many benchmarks. Huge thanks to every teammate who fought side by side on this journey—from architecture, data, training, infra, serving, and evaluation to post-training. Every part of this project carries an incredible amount of hard work. This was my first time leading a project as Tech Lead, and I feel truly fortunate. The future of Physical AI needs models that can not only “see” and “describe” the world, but also “imagine,” “simulate,” and “act”—and eventually close the loop with the real world. I hope Cosmos 3 can become an important starting point for this direction, and I’m excited to push Physical AI into its next stage together with the open-source community. Welcome to the era of Physical AI. HuggingFace: Project Website: Code:

Max Zhaoshuo Li 李赵硕

1,078,418 Aufrufe • vor 2 Monaten

Can we compile matter - for instance, a pine cone - and derive new active materials, end-to-end from observation to manufacturing? If physical systems can be formalized as composable mathematics, we can point AI that has been shown to resolve long-open mathematical problems at matter itself. Our new work turns bioinspired engineering from analogy into formal compilation: biology and mechanics become explicit, checkable, and executable, so AI reasoning can produce physical designs. This is the first end-to-end demonstration in which a formally compositional multiscale model is carried from a biological hierarchy, through engineered design and fabrication specification, to executable manufacturing code - and then to a physically tested artifact. Background: Humans have long been inspired by biology to advance technology, but this has usually been an ad hoc process rather than a mathematically rigorous one. Natural materials such as pinecones achieve adaptive behavior through mechanisms organized across many scales. Engineering typically translates those mechanisms by analogy: identify a biological principle, build something inspired by it, and validate each new design as a separate case. This can produce remarkable results, but the knowledge does not readily compound. Instead, we represent each scale as a dynamical module with explicit states, stimuli, governing laws, and interfaces. Every scale-to-scale map must preserve the stimulus - response dynamics: evolve the fine-scale system and then map upward, or map upward first and then evolve. The two paths must agree. Because this condition is preserved under composition, locally valid interfaces remain consistent when assembled into the full hierarchy. We then carry that structure into an engineered system, translate the target behavior into a verified fabrication specification, and compile it into G-code: the toolpaths, deposition sequence, temperatures, speeds, and other commands executed by a 3D printer. The intermediate translations are explicit, checkable, and executable rather than completed through an ad hoc handoff. The formal guarantee is that given valid local models and interfaces, their composition remains valid. Whether those models and manufacturing assumptions accurately capture physical reality remains an empirical question. That is why we fabricated and tested the results. We generated four actuator classes by crossing two stimuli - humidity and heat - with two responses: bending and twisting. The fourth, thermal twisting, required no new pipeline and no separate derivation within the framework. It emerged by composing a thermal stimulus module already validated in one case with a twisting module validated in another. The generated G-code produced the intended motion without manual redesign, and all four predictions fell within one experimental standard deviation of the measured response. Why this matters: 1⃣For AI in science, this provides a physics-aware type system against which generative proposals can be checked - and rejected at the interface - before expensive simulation, fabrication, or experiment. It is roughly analogous to proof checking, but for the composition of physical mechanisms. 2⃣For engineering, the accessible design space can scale with a library of validated components rather than with the number of individually derived cases. 3⃣The mathematics, category theory, carries all the way into a physical object on a print bed. This points toward scientific knowledge as executable infrastructure: models that are not only described in papers, but typed, composable, verifiable, and able to compile into experiments. Excellent work led by my student Lee Marom with Skylar Tibbits & Gioele Zardini. Paper published in J. Mech. Phys. Solids along with code, Grasshopper scripts, and manufacturing G-code below.

Markus J. Buehler

127,025 Aufrufe • vor 13 Tagen

A Talk About AI That Will Blow Your Mind. It Did In 1998 When I Attended The Talk. I just found this video from 1998 when I attended this talk by Rupert Sheldrake, Terence McKenna and Ralph Abraham at the University of California, Santa Cruz to explore how machine intelligence might evolve in relation to our own. I never thought I would see this again and it had a great influence on me in the AI I was building in that era and on to today. But ai just found a copy. I certainly did not run around with a VHS recorder so I am blown away that this exists. Now you can see what I saw. At that time, the internet was still young, and artificial intelligence belonged mostly to science fiction. Yet many of the questions we raised then have become part of daily life. In this conversation, it was explored whether intelligence is best understood as logic and computation, or as something embodied, participatory, and alive. Can the mind be reduced to code, or does life itself depend on forms of knowing that no algorithm can contain? AI now outpace us in speed, reach, and memory. Yet the deeper mystery is not how far they can go, but what they reveal about mind and ourselves. Will AI reproduce the limitations of our mechanistic worldview, or might it help us rediscover dimensions of mind that transcend machinery altogether? It's striking how near we now are to the possibilities we once only speculated about. Quantum computing, self-learning systems, large language models very much as Terence describes—and the looming prospect of superintelligence—have moved from the margins to the mainstream. But the heart of the conversation remains just as relevant today, if not more so: what is consciousness, and how might we participate in its unfolding evolution?

Brian Roemmele

147,955 Aufrufe • vor 8 Monaten