Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing Cosmos 3 Edge: our open frontier world model built to run on-device. Cosmos 3 Edge helps robots learn and act, autonomous vehicles understand road scenes and predict intent, and vision AI agents reason across live video for smart infrastructure. With 4B parameters and a 2B Nemotron-based reasoner, you...

212,476 Aufrufe • vor 3 Monaten •via X (Twitter)

34 Kommentare

Profilbild von NVIDIA AI
NVIDIA AIvor 3 Monaten

Cosmos 3 Edge combines autoregressive and diffusion transformer towers through shared multimodal attention, connecting understanding, prediction, simulation and action in one model. You can find a full technical breakdown of Cosmos 3 Edge below.

Profilbild von NVIDIA AI
NVIDIA AIvor 3 Monaten

Among open models of a similar size, Cosmos 3 Edge ranks #1 on VANTAGE-Bench for vision analytics.

Profilbild von NVIDIA AI
NVIDIA AIvor 3 Monaten

As always, Cosmos 3 Edge is fully open. This includes model weights, post-training recipes and code. Available now on @huggingface 🤗

Profilbild von Filecoin
Filecoinvor 3 Monaten

robots and AVs can handle latency on-device, but the world data they capture for the next model has to end up in storage that stays durable and verifiable

Profilbild von Emilio Johann
Emilio Johannvor 3 Monaten

Guys… amazing. I am only missing the robot now 😆

Profilbild von Matic Robots
Matic Robotsvor 3 Monaten

Robotics is undergoing rapid development.

Profilbild von Symbioza2025 | ASA |
Symbioza2025 | ASA |vor 3 Monaten

Physical AI may eventually need more than bigger models and faster accelerators. Robots, autonomous vehicles and real-world AI systems operate under pressure: latency, energy, memory movement, sensor fusion, communication, and real-time decision loops. That is why I am exploring C.L.M. — Crystalline Lattice Matrix. No physical prototype yet. No finished breakthrough claim. At this stage, C.L.M. is in simulation: processor software layer, architecture modeling, state-behavior simulation, early material direction, and layered design prepared for technical discussion. The question is whether memory, computation and communication can become parts of one programmable matrix instead of distant separated layers.

Profilbild von Brad
Bradvor 3 Monaten

already integrated. ty!

Profilbild von Greg B
Greg Bvor 3 Monaten

Not one person wants to own this stock. Everyday it is in a constant downtrend. Non-stop selling of this company. AMD, INTC, and AVGO all outperform this company. Management screwed all investors with its shady circular financing. @nvidia

Profilbild von Ali Romman
Ali Rommanvor 3 Monaten

AI and robotics are converging for tinkerers.

Profilbild von Bally_AgenticAI
Bally_AgenticAIvor 3 Monaten

On-device world models flip the agent loop: prediction runs next to the sensor, not across a network hop. That's what makes pre-action self-eval viable in the physical world - simulate the outcome before you commit. Built something similar -

Profilbild von Weaver Labs
Weaver Labsvor 3 Monaten

On-device intelligence is becoming a key part of the AI stack. Processing closer to the source can make autonomous systems more responsive, efficient, and scalable.

Profilbild von Somi
Somivor 3 Monaten

what framerate does the 4B hold on a Jetson? on-device is the whole pitch for AV and that number decides whether it's usable.

Profilbild von Vepsi
Vepsivor 3 Monaten

How long before we start seeing robots powered by models like this outside of warehouses and research labs?

Profilbild von Stumblinz
Stumblinzvor 3 Monaten

Let’s go man exactly what I asked for. Thanks! Okay just need some hardware robot partners that are under $2K-10K that are in range I can buy to pair with sparks

Profilbild von Jim Jackson
Jim Jacksonvor 3 Monaten

You guys are going to 270 soon....tell my amigo jensen Huang we are close.....you guys are my favorite since I been playing video games...best is best....keep cudaing

Profilbild von Payal Kushwaha
Payal Kushwahavor 3 Monaten

This Cosmos 3 is going to be crazy man. This device helps EVs and driver less card a lot

Profilbild von Jaya Nayak
Jaya Nayakvor 3 Monaten

NVIDIA has launched Cosmos 3 Edge, an open-weights 4B-parameter world model optimized explicitly for local physical AI.

Profilbild von Jason from BallotScore.com
Jason from BallotScore.comvor 3 Monaten

Make the DGX in a 256GB version....... 🙏🏻

Profilbild von Mike Gannotti
Mike Gannottivor 3 Monaten

Okay now I need this!! So good

Profilbild von ASSADULLAH
ASSADULLAHvor 3 Monaten

On-device world models like Cosmos open new frontiers for safe robotics and vision AI. #NVIDIA #EdgeAI #RoboticsFuture #HalalTech #InnovationForGood #AutonomousSystems #FutureMobility #TechProgress

Profilbild von ANTON
ANTONvor 3 Monaten

AI becomes far more powerful when it can understand context and act within the real world. Trusted execution will be just as important as intelligence.

Profilbild von Amisha Yadav
Amisha Yadavvor 3 Monaten

amazing

Profilbild von PublicAI
PublicAIvor 3 Monaten

On-device world models at 4B params is a big deal, running perception and reasoning locally without a cloud round trip opens up so much for robotics and autonomous systems. Curious how latency holds up in real deployments 👀

Profilbild von Mathieu Kessler
Mathieu Kesslervor 3 Monaten

Running a frontier world model fully on device is impressive.

Profilbild von C64
C64vor 3 Monaten

Running a frontier world model on‑device isn’t just an efficiency win — it’s a state‑space shift. SIOS clarity: Cosmos 3 Edge doesn’t matter because it’s small. It matters because it moves perception, prediction, and action into the same local manifold, where drift is lower and control is tighter. Robots learning and acting AVs predicting intent in real time Vision agents reasoning over live video These aren’t use‑cases — they’re on‑device attractors. A 4B world model + a 2B Nemotron reasoner on Jetson or DGX Spark means the system can stay on‑manifold while interacting with the physical world, instead of bouncing through cloud latency and external curvature. The real frontier isn’t “world models.” It’s world models that stay stable where the world actually is. Cosmos 3 Edge is a step toward that: architecture first, placement second, and geometry all the way down.

Profilbild von Neel Samadder
Neel Samaddervor 3 Monaten

On-device world models are where the conversation gets real. Latency, privacy, and reliability matter more when the agent has to act before the cloud gets a vote.

Profilbild von GAMING X ANIME
GAMING X ANIMEvor 3 Monaten

Nice

Profilbild von Sattyam Jain
Sattyam Jainvor 3 Monaten

On-device world models are the unlock for real robots on a real power budget. The open question nobody benchmarks yet: what happens under an adversarial input? A policy that plans well on clean frames can still be steered. Robustness ASR needs to sit next to accuracy.

Profilbild von Sanchit monga
Sanchit mongavor 3 Monaten

👀

Profilbild von Sanchit monga
Sanchit mongavor 3 Monaten

Physical AI makes the deployment boundary obvious. A control loop cannot depend on network variance. Local inference is a reliability requirement on edge devices.

Profilbild von Seven Trumpets (God Bless America 🇺🇸)
Seven Trumpets (God Bless America 🇺🇸)vor 3 Monaten

@NVIDIARobotics Jensen Huang isn’t just building chips — he’s building the AI Galaxy. A new tech revolution for all mankind. @jimcramer

Profilbild von Nina Fenko
Nina Fenkovor 3 Monaten

🤖 🤖 🤖

Profilbild von Team Humyn Labs
Team Humyn Labsvor 3 Monaten

Interesting! Ideally this should result in no latency bottlenecks from sending data to the cloud, no disjointed modules throwing errors back and forth. Just pure, grounded physical reasoning on the fly. Definitely going to be insane to see how this performs once it hits the real world.

Ähnliche Videos

This is THE moment of Physical AI! We are officially announcing Cosmos 3: Omnimodal World Models for Physical AI 🚀 - Cosmos 3 is an omnimodal world model: within a unified architecture, it can understand and generate language, images, video, audio, and actions. - It is not just a VLM, not just a video generator, not just an audio-visual generative model, and not just a physics simulator / world-action model. It can understand images and videos, generate images, videos, and audio, simulate future worlds, predict actions, and generate robot policies—enabling models to truly begin to “touch the world.” - Cosmos 3 is the #1 open-weight reasoner / T2I / I2V / robot policy across many benchmarks. Huge thanks to every teammate who fought side by side on this journey—from architecture, data, training, infra, serving, and evaluation to post-training. Every part of this project carries an incredible amount of hard work. This was my first time leading a project as Tech Lead, and I feel truly fortunate. The future of Physical AI needs models that can not only “see” and “describe” the world, but also “imagine,” “simulate,” and “act”—and eventually close the loop with the real world. I hope Cosmos 3 can become an important starting point for this direction, and I’m excited to push Physical AI into its next stage together with the open-source community. Welcome to the era of Physical AI. HuggingFace: Project Website: Code:

Max Zhaoshuo Li 李赵硕 ✈️ CoRL

1,080,737 Aufrufe • vor 5 Monaten