Loading video...

Video Failed to Load

Go Home

With everyone busily using LLMs + Blender/Three.js to make 3D models, I thought I'd try a different geometric representation. This dragon isn't a mesh, NeRF, 3DGS, or video model: it's 27kb of GLSL code (generated via LLM), defining a closed-form implicit surface. 🧵 [1/n]

678,939 views • 6 days ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,849 views • 1 year ago

is it legal? NVIDIA and Microsoft just open-sourced the pieces of a full 3D studio for Opus 5.5 15 github repos, sorted by what you want to make: GENERATE 3D ASSETS 01. TRELLIS.2 by Microsoft: -> one image in, a fully textured 3D asset out, about 3 seconds on an H100 02. Hunyuan3D-2.1 by Tencent: -> production-ready 3D assets with PBR textures 03. stable-fast-3d by Stability AI: -> one photo to a clean UV-unwrapped mesh, built for speed 04. meshy-mcp-server by Meshy: -> text or image to 3D, then remesh, retexture, rig and animate from your agent BUILD SCENES AND WORLDS 05. mcp-for-blender: -> prompt-driven modeling, scene building and edits in a live Blender 06. HY-World-2.0 by Tencent: -> text or a single image to a navigable 3D world 07. supersplat by PlayCanvas: -> inspect, edit, optimize and publish 3D Gaussian splats in the browser 08. kit-usd-agents by NVIDIA: -> edit Omniverse USD scenes in plain English, plus MCP servers for Kit and Isaac Sim MAKE A GAME 09. unity-mcp: -> run the Unity Editor in plain English: scenes, C# scripts, assets, tests, builds 10. godot-ai: -> 46 tools for a live Godot editor: scenes, scripts, signals, UI, particles 11. unreal-engine-mcp: -> drive a live Unreal Editor: actors, world building, Blueprints 3D ON THE WEB 12. editor-mcp-server by PlayCanvas: -> your agent builds PlayCanvas scenes and checks they actually run 13. three.js: -> the JavaScript 3D library itself, 115k stars on GitHub 14. react-three-fiber: -> build three.js scenes as reusable React components 15. threejs-skills: -> 10 three.js skills for Claude Code, from shaders to post-processing a full 3D pipeline, and every piece of it lives on github

Mnimiy

193,731 views • 3 days ago

introducing a new, very fun, LLM benchmark- the Game-of-Life Bench! the rules are simple: given an 8x8 grid following Conway's game of life rules, the goal is to create an initial pattern with at most 32 cells that can last the longest number of turns before dying/repeating. some results to highlight (with caveats detailed below): - gpt 5.1 lasts the longest with a 106 step run - claude models are really bad at this! they refuse to reason about this task and score < 25 points - deepseek r1 is the best open model with 102 steps. why? because i wanted to create a benchmark that has (i think) no practicality, but is still fun to look at, cheap, and still measures something interesting. i also am a big fan of the game of life. its absurdly simple rules leading to intractability is extremely cool to me. also, i saw a lot of work with LLMs trying to "predict" the next state in Conway's game of life, I think game-of-life bench is more fun because it's pretty open ended and only asks the LLM for the initial state. I also think this could be an RL env? but idk why you would ever train on this task haha i don't think this is a "serious" benchmark because it doesnt measure anything practical, but i still think it's a hard benchmark exactly because you can't predict what happens with your initial state many turns into the future; this is why i was initially expecting all LLMs to be bad at it, but turns out, some are clearly better than the others (the ordering may surprise you!) reminder: this is still a work-in-progress; (1) i am gpu-poor so could only do 10 runs for each model, even though total running cost is relatively low. maybe with some more credits i can run more seeds for each model. (2) i handpicked models which i think are at the frontier right now, plus some others that were on my mind. so, if you'd like to see a model on here, let me know. (3) i currently only do an 8x8 grid because i thought that by itself would be pretty hard for current LLMs, but of course we can increase grid sizes! (4) the coolest thing is, i dont think we can calculate the max possible number of states (yay undecidability!) you can go without repeating, so this is essentially a no-ceiling task, which is pretty cool! again, i did this mostly out of a desire to make LLMs do something fun. if this keeps me entertained for a few more days, i'd likely release a blog post on it. if it keeps me entertained for a week (and someone sponsors me), i'll put more work into it :P lastly, this is fully open sourced, so feel free to run this on your own!

Akshit

13,775 views • 7 months ago