正在加载视频...

视频加载失败

Introducing Cosmos 3 Edge: our open frontier world model built to run on-device. Cosmos 3 Edge helps robots learn and act, autonomous vehicles understand road scenes and predict intent, and vision AI agents reason across live video for smart infrastructure. With 4B parameters and a 2B Nemotron-based reasoner, you...

212,476 次观看 • 3 个月前 •via X (Twitter)

34 条评论

NVIDIA AI 的头像
NVIDIA AI3 个月前

Cosmos 3 Edge combines autoregressive and diffusion transformer towers through shared multimodal attention, connecting understanding, prediction, simulation and action in one model. You can find a full technical breakdown of Cosmos 3 Edge below.

NVIDIA AI 的头像
NVIDIA AI3 个月前

Among open models of a similar size, Cosmos 3 Edge ranks #1 on VANTAGE-Bench for vision analytics.

NVIDIA AI 的头像
NVIDIA AI3 个月前

As always, Cosmos 3 Edge is fully open. This includes model weights, post-training recipes and code. Available now on @huggingface 🤗

Filecoin 的头像
Filecoin3 个月前

robots and AVs can handle latency on-device, but the world data they capture for the next model has to end up in storage that stays durable and verifiable

Emilio Johann 的头像
Emilio Johann3 个月前

Guys… amazing. I am only missing the robot now 😆

Matic Robots 的头像
Matic Robots3 个月前

Robotics is undergoing rapid development.

Symbioza2025 | ASA | 的头像
Symbioza2025 | ASA |3 个月前

Physical AI may eventually need more than bigger models and faster accelerators. Robots, autonomous vehicles and real-world AI systems operate under pressure: latency, energy, memory movement, sensor fusion, communication, and real-time decision loops. That is why I am exploring C.L.M. — Crystalline Lattice Matrix. No physical prototype yet. No finished breakthrough claim. At this stage, C.L.M. is in simulation: processor software layer, architecture modeling, state-behavior simulation, early material direction, and layered design prepared for technical discussion. The question is whether memory, computation and communication can become parts of one programmable matrix instead of distant separated layers.

Brad 的头像
Brad3 个月前

already integrated. ty!

Greg B 的头像
Greg B3 个月前

Not one person wants to own this stock. Everyday it is in a constant downtrend. Non-stop selling of this company. AMD, INTC, and AVGO all outperform this company. Management screwed all investors with its shady circular financing. @nvidia

Ali Romman 的头像
Ali Romman3 个月前

AI and robotics are converging for tinkerers.

Bally_AgenticAI 的头像
Bally_AgenticAI3 个月前

On-device world models flip the agent loop: prediction runs next to the sensor, not across a network hop. That's what makes pre-action self-eval viable in the physical world - simulate the outcome before you commit. Built something similar -

Weaver Labs 的头像
Weaver Labs3 个月前

On-device intelligence is becoming a key part of the AI stack. Processing closer to the source can make autonomous systems more responsive, efficient, and scalable.

Somi 的头像
Somi3 个月前

what framerate does the 4B hold on a Jetson? on-device is the whole pitch for AV and that number decides whether it's usable.

Vepsi 的头像
Vepsi3 个月前

How long before we start seeing robots powered by models like this outside of warehouses and research labs?

Stumblinz 的头像
Stumblinz3 个月前

Let’s go man exactly what I asked for. Thanks! Okay just need some hardware robot partners that are under $2K-10K that are in range I can buy to pair with sparks

Jim Jackson 的头像
Jim Jackson3 个月前

You guys are going to 270 soon....tell my amigo jensen Huang we are close.....you guys are my favorite since I been playing video games...best is best....keep cudaing

Payal Kushwaha 的头像
Payal Kushwaha3 个月前

This Cosmos 3 is going to be crazy man. This device helps EVs and driver less card a lot

Jaya Nayak 的头像
Jaya Nayak3 个月前

NVIDIA has launched Cosmos 3 Edge, an open-weights 4B-parameter world model optimized explicitly for local physical AI.

Jason from BallotScore.com 的头像
Jason from BallotScore.com3 个月前

Make the DGX in a 256GB version....... 🙏🏻

Mike Gannotti 的头像
Mike Gannotti3 个月前

Okay now I need this!! So good

ASSADULLAH 的头像
ASSADULLAH3 个月前

On-device world models like Cosmos open new frontiers for safe robotics and vision AI. #NVIDIA #EdgeAI #RoboticsFuture #HalalTech #InnovationForGood #AutonomousSystems #FutureMobility #TechProgress

ANTON 的头像
ANTON3 个月前

AI becomes far more powerful when it can understand context and act within the real world. Trusted execution will be just as important as intelligence.

Amisha Yadav 的头像
Amisha Yadav3 个月前

amazing

PublicAI 的头像
PublicAI3 个月前

On-device world models at 4B params is a big deal, running perception and reasoning locally without a cloud round trip opens up so much for robotics and autonomous systems. Curious how latency holds up in real deployments 👀

Mathieu Kessler 的头像
Mathieu Kessler3 个月前

Running a frontier world model fully on device is impressive.

C64 的头像
C643 个月前

Running a frontier world model on‑device isn’t just an efficiency win — it’s a state‑space shift. SIOS clarity: Cosmos 3 Edge doesn’t matter because it’s small. It matters because it moves perception, prediction, and action into the same local manifold, where drift is lower and control is tighter. Robots learning and acting AVs predicting intent in real time Vision agents reasoning over live video These aren’t use‑cases — they’re on‑device attractors. A 4B world model + a 2B Nemotron reasoner on Jetson or DGX Spark means the system can stay on‑manifold while interacting with the physical world, instead of bouncing through cloud latency and external curvature. The real frontier isn’t “world models.” It’s world models that stay stable where the world actually is. Cosmos 3 Edge is a step toward that: architecture first, placement second, and geometry all the way down.

Neel Samadder 的头像
Neel Samadder3 个月前

On-device world models are where the conversation gets real. Latency, privacy, and reliability matter more when the agent has to act before the cloud gets a vote.

GAMING X ANIME 的头像
GAMING X ANIME3 个月前

Nice

Sattyam Jain 的头像
Sattyam Jain3 个月前

On-device world models are the unlock for real robots on a real power budget. The open question nobody benchmarks yet: what happens under an adversarial input? A policy that plans well on clean frames can still be steered. Robustness ASR needs to sit next to accuracy.

Sanchit monga 的头像
Sanchit monga3 个月前

👀

Sanchit monga 的头像
Sanchit monga3 个月前

Physical AI makes the deployment boundary obvious. A control loop cannot depend on network variance. Local inference is a reliability requirement on edge devices.

Seven Trumpets (God Bless America 🇺🇸) 的头像
Seven Trumpets (God Bless America 🇺🇸)3 个月前

@NVIDIARobotics Jensen Huang isn’t just building chips — he’s building the AI Galaxy. A new tech revolution for all mankind. @jimcramer

Nina Fenko 的头像
Nina Fenko3 个月前

🤖 🤖 🤖

Team Humyn Labs 的头像
Team Humyn Labs3 个月前

Interesting! Ideally this should result in no latency bottlenecks from sending data to the cloud, no disjointed modules throwing errors back and forth. Just pure, grounded physical reasoning on the fly. Definitely going to be insane to see how this performs once it hits the real world.

相关视频

This is THE moment of Physical AI! We are officially announcing Cosmos 3: Omnimodal World Models for Physical AI 🚀 - Cosmos 3 is an omnimodal world model: within a unified architecture, it can understand and generate language, images, video, audio, and actions. - It is not just a VLM, not just a video generator, not just an audio-visual generative model, and not just a physics simulator / world-action model. It can understand images and videos, generate images, videos, and audio, simulate future worlds, predict actions, and generate robot policies—enabling models to truly begin to “touch the world.” - Cosmos 3 is the #1 open-weight reasoner / T2I / I2V / robot policy across many benchmarks. Huge thanks to every teammate who fought side by side on this journey—from architecture, data, training, infra, serving, and evaluation to post-training. Every part of this project carries an incredible amount of hard work. This was my first time leading a project as Tech Lead, and I feel truly fortunate. The future of Physical AI needs models that can not only “see” and “describe” the world, but also “imagine,” “simulate,” and “act”—and eventually close the loop with the real world. I hope Cosmos 3 can become an important starting point for this direction, and I’m excited to push Physical AI into its next stage together with the open-source community. Welcome to the era of Physical AI. HuggingFace: Project Website: Code:

Max Zhaoshuo Li 李赵硕 ✈️ CoRL

1,080,737 次观看 • 5 个月前