Loading video...

Video Failed to Load

Go Home

Introducing Cosmos 3 Edge: our open frontier world model built to run on-device. Cosmos 3 Edge helps robots learn and act, autonomous vehicles understand road scenes and predict intent, and vision AI agents reason across live video for smart infrastructure. With 4B parameters and a 2B Nemotron-based reasoner, you...

212,476 views • 3 months ago •via X (Twitter)

34 Comments

NVIDIA AI's profile picture
NVIDIA AI3 months ago

Cosmos 3 Edge combines autoregressive and diffusion transformer towers through shared multimodal attention, connecting understanding, prediction, simulation and action in one model. You can find a full technical breakdown of Cosmos 3 Edge below.

NVIDIA AI's profile picture
NVIDIA AI3 months ago

Among open models of a similar size, Cosmos 3 Edge ranks #1 on VANTAGE-Bench for vision analytics.

NVIDIA AI's profile picture
NVIDIA AI3 months ago

As always, Cosmos 3 Edge is fully open. This includes model weights, post-training recipes and code. Available now on @huggingface 🤗

Filecoin's profile picture
Filecoin3 months ago

robots and AVs can handle latency on-device, but the world data they capture for the next model has to end up in storage that stays durable and verifiable

Emilio Johann's profile picture
Emilio Johann3 months ago

Guys… amazing. I am only missing the robot now 😆

Matic Robots's profile picture
Matic Robots3 months ago

Robotics is undergoing rapid development.

Symbioza2025 | ASA |'s profile picture
Symbioza2025 | ASA |3 months ago

Physical AI may eventually need more than bigger models and faster accelerators. Robots, autonomous vehicles and real-world AI systems operate under pressure: latency, energy, memory movement, sensor fusion, communication, and real-time decision loops. That is why I am exploring C.L.M. — Crystalline Lattice Matrix. No physical prototype yet. No finished breakthrough claim. At this stage, C.L.M. is in simulation: processor software layer, architecture modeling, state-behavior simulation, early material direction, and layered design prepared for technical discussion. The question is whether memory, computation and communication can become parts of one programmable matrix instead of distant separated layers.

Brad's profile picture
Brad3 months ago

already integrated. ty!

Greg B's profile picture
Greg B3 months ago

Not one person wants to own this stock. Everyday it is in a constant downtrend. Non-stop selling of this company. AMD, INTC, and AVGO all outperform this company. Management screwed all investors with its shady circular financing. @nvidia

Ali Romman's profile picture
Ali Romman3 months ago

AI and robotics are converging for tinkerers.

Bally_AgenticAI's profile picture
Bally_AgenticAI3 months ago

On-device world models flip the agent loop: prediction runs next to the sensor, not across a network hop. That's what makes pre-action self-eval viable in the physical world - simulate the outcome before you commit. Built something similar -

Weaver Labs's profile picture
Weaver Labs3 months ago

On-device intelligence is becoming a key part of the AI stack. Processing closer to the source can make autonomous systems more responsive, efficient, and scalable.

Somi's profile picture
Somi3 months ago

what framerate does the 4B hold on a Jetson? on-device is the whole pitch for AV and that number decides whether it's usable.

Vepsi's profile picture
Vepsi3 months ago

How long before we start seeing robots powered by models like this outside of warehouses and research labs?

Stumblinz's profile picture
Stumblinz3 months ago

Let’s go man exactly what I asked for. Thanks! Okay just need some hardware robot partners that are under $2K-10K that are in range I can buy to pair with sparks

Jim Jackson's profile picture
Jim Jackson3 months ago

You guys are going to 270 soon....tell my amigo jensen Huang we are close.....you guys are my favorite since I been playing video games...best is best....keep cudaing

Payal Kushwaha's profile picture
Payal Kushwaha3 months ago

This Cosmos 3 is going to be crazy man. This device helps EVs and driver less card a lot

Jaya Nayak's profile picture
Jaya Nayak3 months ago

NVIDIA has launched Cosmos 3 Edge, an open-weights 4B-parameter world model optimized explicitly for local physical AI.

Jason from BallotScore.com's profile picture
Jason from BallotScore.com3 months ago

Make the DGX in a 256GB version....... 🙏🏻

Mike Gannotti's profile picture
Mike Gannotti3 months ago

Okay now I need this!! So good

ASSADULLAH's profile picture
ASSADULLAH3 months ago

On-device world models like Cosmos open new frontiers for safe robotics and vision AI. #NVIDIA #EdgeAI #RoboticsFuture #HalalTech #InnovationForGood #AutonomousSystems #FutureMobility #TechProgress

ANTON's profile picture
ANTON3 months ago

AI becomes far more powerful when it can understand context and act within the real world. Trusted execution will be just as important as intelligence.

Amisha Yadav's profile picture
Amisha Yadav3 months ago

amazing

PublicAI's profile picture
PublicAI3 months ago

On-device world models at 4B params is a big deal, running perception and reasoning locally without a cloud round trip opens up so much for robotics and autonomous systems. Curious how latency holds up in real deployments 👀

Mathieu Kessler's profile picture
Mathieu Kessler3 months ago

Running a frontier world model fully on device is impressive.

C64's profile picture
C643 months ago

Running a frontier world model on‑device isn’t just an efficiency win — it’s a state‑space shift. SIOS clarity: Cosmos 3 Edge doesn’t matter because it’s small. It matters because it moves perception, prediction, and action into the same local manifold, where drift is lower and control is tighter. Robots learning and acting AVs predicting intent in real time Vision agents reasoning over live video These aren’t use‑cases — they’re on‑device attractors. A 4B world model + a 2B Nemotron reasoner on Jetson or DGX Spark means the system can stay on‑manifold while interacting with the physical world, instead of bouncing through cloud latency and external curvature. The real frontier isn’t “world models.” It’s world models that stay stable where the world actually is. Cosmos 3 Edge is a step toward that: architecture first, placement second, and geometry all the way down.

Neel Samadder's profile picture
Neel Samadder3 months ago

On-device world models are where the conversation gets real. Latency, privacy, and reliability matter more when the agent has to act before the cloud gets a vote.

GAMING X ANIME's profile picture
GAMING X ANIME3 months ago

Nice

Sattyam Jain's profile picture
Sattyam Jain3 months ago

On-device world models are the unlock for real robots on a real power budget. The open question nobody benchmarks yet: what happens under an adversarial input? A policy that plans well on clean frames can still be steered. Robustness ASR needs to sit next to accuracy.

Sanchit monga's profile picture
Sanchit monga3 months ago

👀

Sanchit monga's profile picture
Sanchit monga3 months ago

Physical AI makes the deployment boundary obvious. A control loop cannot depend on network variance. Local inference is a reliability requirement on edge devices.

Seven Trumpets (God Bless America 🇺🇸)'s profile picture
Seven Trumpets (God Bless America 🇺🇸)3 months ago

@NVIDIARobotics Jensen Huang isn’t just building chips — he’s building the AI Galaxy. A new tech revolution for all mankind. @jimcramer

Nina Fenko's profile picture
Nina Fenko3 months ago

🤖 🤖 🤖

Team Humyn Labs's profile picture
Team Humyn Labs3 months ago

Interesting! Ideally this should result in no latency bottlenecks from sending data to the cloud, no disjointed modules throwing errors back and forth. Just pure, grounded physical reasoning on the fly. Definitely going to be insane to see how this performs once it hits the real world.

Related Videos

This is THE moment of Physical AI! We are officially announcing Cosmos 3: Omnimodal World Models for Physical AI 🚀 - Cosmos 3 is an omnimodal world model: within a unified architecture, it can understand and generate language, images, video, audio, and actions. - It is not just a VLM, not just a video generator, not just an audio-visual generative model, and not just a physics simulator / world-action model. It can understand images and videos, generate images, videos, and audio, simulate future worlds, predict actions, and generate robot policies—enabling models to truly begin to “touch the world.” - Cosmos 3 is the #1 open-weight reasoner / T2I / I2V / robot policy across many benchmarks. Huge thanks to every teammate who fought side by side on this journey—from architecture, data, training, infra, serving, and evaluation to post-training. Every part of this project carries an incredible amount of hard work. This was my first time leading a project as Tech Lead, and I feel truly fortunate. The future of Physical AI needs models that can not only “see” and “describe” the world, but also “imagine,” “simulate,” and “act”—and eventually close the loop with the real world. I hope Cosmos 3 can become an important starting point for this direction, and I’m excited to push Physical AI into its next stage together with the open-source community. Welcome to the era of Physical AI. HuggingFace: Project Website: Code:

Max Zhaoshuo Li 李赵硕 ✈️ CoRL

1,080,737 views • 5 months ago