Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Today we are releasing JST-2, the world's first full-stack physics-native world foundation model. Many world models learn in pixel/video space. We went back to first principles and built the entire model stack in 3D. Generate a 3D scene in seconds and expand it in real time. Create characters with...

1,721,103 Aufrufe • vor 7 Tagen •via X (Twitter)

58 Kommentare

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

JST models the world as persistent atoms in 3D space. Each Physics-Native Token has an explicit xyz position and learned vectors for attributes and dynamics. We spent four years building the full physics-native stack around this representation: tokenization, architecture, the data synthesis engine, pre-training, and post-training.

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Generate a 3D scene in about one second of model inference, at a cost below $0.01. Move to a new viewpoint and generate the missing parts in real time. Keep expanding the same world, with up to 64 input views as a spatial context window.

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

From one image to a 3D character with motion built in. Its dynamics are learned from data, without separate rigging and skinning steps. JST-2 outperforms state-of-the-art models in blind human evaluations of character generation and animation readiness. Full benchmark:

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Generate full-body 3D motion from text or video. From video, JST-2 reconstructs visible movement and infers how unseen body parts move. JST-2 leads state-of-the-art models on text-to-motion and video-to-motion in blind human evaluations. Full benchmark:

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

JST-2 reconstructs complete 3D environments from sparse real-world observations and expands them from new viewpoints. This opens a path to building robot simulation environments from real places. Generated scenes render locally, without running the model for every frame.

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Next: JST-3. In JST-2, character motion is driven by learned dynamics. With JST-3, we aim to extend learned dynamics to interactions between objects, replacing rule-based simulation with learned physics. Our goal is an experience engine for physical AI, where agents learn by acting in simulated worlds and observing the consequences.

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

JST-2 is live. Read the research and benchmarks: Try JST-2 for free today.

Profilbild von Danni
Dannivor 7 Tagen

I had way too much fun building this Lord of the Rings-inspired Rivendell game with ChatGPT Astra + our Viggle's JST-2 world model. Generating the scenes made it so much easier to build, and so much prettier. Come explore the valley, the Unseen World and the Council!

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Wow the quality is fire! Crisp scenes, and the characters move so naturally. Let's play!

Profilbild von Nan Ha
Nan Havor 7 Tagen

So proud of the team! JST-1 powered our first product Viggle, which went viral 2 years ago and now has 50M+ users. I can see JST-2 opens up so many opportunities for game development & robotics training. Can't wait for the next milestone!

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Can't get to the next milestone without you Nan!

Profilbild von Hang Chu
Hang Chuvor 7 Tagen

We've spent four years building JST, and I'm excited to finally share JST-2 with everyone. Please try it and tell us what you think! Happy to answer questions about the research or the model. We'd also love to hear what you want to build and explore how we can help!

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Four years of conviction and building from first principles brought JST-2 here. Thank you for leading the team through it, Hang. Now we can't wait to see what builders create.

Profilbild von Orikan
Orikanvor 7 Tagen

If JST-2 can't spill a cup yet, what are you hoping people build with it while JST-3 is coming?

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

JST-2 is built for creating usable 3D characters, motion, and scenes today, especially for games, prototypes, and interactive experiences.

Profilbild von Fish Audio
Fish Audiovor 7 Tagen

Congrats on the launch!

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Thank you! We love Drama 3 too 💚

Profilbild von PINOC
PINOCvor 7 Tagen

Every JST-2 capability is live in PINOC, free to try 👀 Turn one image into a 3D character, make it move from text or video, and build the world around it. Show us what you make:

Profilbild von Kaitee
Kaiteevor 7 Tagen

Which painting should JST-2 do next? I'd vote Las Meninas

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Las Meninas would be an incredible stress test 👀 So many characters, sightlines, mirrors, and layers of depth !

Profilbild von Roy
Royvor 7 Tagen

Had a blast generating loads of environments, the details have improved a ton! Look forwards to making more with it.

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Yes Roy💪 let's build some killing games!

Profilbild von Aaliya
Aaliyavor 7 Tagen

Turning one image into an animated 3D character without manual rigging could save creators a lot of time.

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Exactly. We want creators to spend less time fighting the pipeline and more time building the character and world they imagined.

Profilbild von Oluwatimileyin✨🦋
Oluwatimileyin✨🦋vor 7 Tagen

Is the robotics demo on the JST-2 page somewhere? want to send it to a friend who trains robots

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

yes, Modeling the real world - this part!

Profilbild von Sam Hocking
Sam Hockingvor 7 Tagen

Will give it a read later, looks good

Profilbild von WY
WYvor 7 Tagen

准备试试把JST-2加入到我的游戏制作工作流中!

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Looking forward to it!

Profilbild von Abbidabbi
Abbidabbivor 7 Tagen

Had a blast creating scenes with small games using Jst-2 from scene creation to character creation and custom animations with their motion feature built a small game as well!

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

that's amazing, what game did yo build?

Profilbild von Abbidabbi
Abbidabbivor 7 Tagen

a Small little game playable on browser where you have to pick up all the mushrooms!

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

beautiful style!

Profilbild von Alex Carter AI
Alex Carter AIvor 7 Tagen

built in 3D first, so when you orbit the room doesn't smear the way video world models do. that's the test I run on every one of these

Profilbild von Avid
Avidvor 7 Tagen

I’d point an agent at JST-2 and let it keep regenerating the scene till it passes its own check

Profilbild von Alejandro Martinez | IA
Alejandro Martinez | IAvor 7 Tagen

fair to flag these are Viggle's own blind tests. one model beating four specialists is basically what we saw happen with LLMs though, so I'm not that surprised

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

one general model that can actually scale. that's our path!

Profilbild von Ethan Cole AI
Ethan Cole AIvor 7 Tagen

filling in the arm the camera missed is the part I'd test first

Profilbild von anish
anishvor 7 Tagen

A world model predicts how a scene changes from one moment to the next, so you can simulate things before trying them for real

Profilbild von 独立开发者William
独立开发者Williamvor 7 Tagen

Congrats on JST-2, this is actually sick. 1-second scenes + characters that already come with motion is insane. Gonna go try it right now.😍😍😍

Profilbild von Lydia Monroe
Lydia Monroevor 7 Tagen

for two person teams rigging ate the whole budget, so most just skipped it. if it's really one image to a rigged character i mostly want to see how the hands hold up

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Hands are one of the areas where JST-2 performed especially well in blind evaluations. Definitely put it to the test—and you can find the detailed comparison in our launch blog.

Profilbild von Blake Thompson
Blake Thompsonvor 7 Tagen

no retargeting step would save me hours on every project

Profilbild von Tugay Alyildiz
Tugay Alyildizvor 7 Tagen

@kirbyman01 sticks and stones may break my bones

Profilbild von 𝐙𝐞𝐧𝐠 💜
𝐙𝐞𝐧𝐠 💜vor 7 Tagen

This is so good! Great to see Viggle back with amazing model

Profilbild von 木马人
木马人vor 7 Tagen

这个模型的效果太惊艳了~回头试试~

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

thanks! the 3d character building should be much easier now as it skips the rigging & retargeting

Profilbild von Rez Karim
Rez Karimvor 7 Tagen

What's the quickest way from a JST-2 scene into Godot or Unity?

Profilbild von Salman
Salmanvor 7 Tagen

This is a massive leap forward. Incredible work! Huge congrats on the JST-2 launch! 🔥

Profilbild von A.I.Warper
A.I.Warpervor 7 Tagen

Nice!

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

Thanks Warper! Welcome to try;)

Profilbild von Viggle Games
Viggle Gamesvor 7 Tagen

We’re already putting JST-2 to work in our games. 🎮 Bringing characters to life with high-quality models and motions. See it in action and try our games here:

Profilbild von Ben Ren
Ben Renvor 7 Tagen

Super coooooool

Profilbild von XIAOJUAN QI
XIAOJUAN QIvor 7 Tagen

Super cool!Big congratulations to the team!

Profilbild von elvis
elvisvor 7 Tagen

how's JST-2 holding up when it's buried in a long agent loop?

Profilbild von Anderson
Andersonvor 7 Tagen

AI search summaries keep citing sources that do not exist

Profilbild von Saidul
Saidulvor 7 Tagen

so JST-2 makes the characters inside the same splat scene? Marble leaves me with an empty room to fill

Profilbild von ViggleAI
ViggleAIvor 7 Tagen

yes exactly, a world with moving characters

Ähnliche Videos