So much exciting open-source 2d-to-3d research being shared open-source.... Here is VAST AI Research implementation of Zehuan-Huang’s paper on Hugging Face Gradio MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationshow more

Static 3D generation isn't enough. We need assets ready... for animation. Our new #SIGGRAPH work, AniGen, takes a single image and generates the 3D shape, skeleton, and skinning weights all at once. Code is fully open-sourced! Kudos to Yihua and VAST AI Research 🧵(1/4)show more

Editing facial expressions in real time now on Hugging... Face Spaces 👨‍🎤🔀 A Grog converted Cog image to Gradio running a ComfyUI backend - magic of open source 🤝 ▶️show more

We are proud to announce our first contribution to... open source Computer Vision research! 🚀 Today, we’re publishing on Hugging Face a 1,000 3D Maps Dataset under CC-BY-NC license, designed to accelerate progress in 3D perception and spatial AI. Our way to give back to the global AI community and show how DePIN can make an impact. 🧵 👉show more

Microsoft TRELLIS.2 is here 🔥 • Single image →... textured 3D mesh • 4B params, flow-matching transformer • Up to 1536³ resolution • Open weights, MIT licensed ⬇️ Demo available on Hugging Faceshow more

Krea 2 is now on Artificial Analysis #1 image... model from an independent research lab and #6 globally on text-to-image leaderboard. open-source cooking and coming soon.show more

The speech on the FREE open source Sesame text... to speech is astonishing. It just killed Google’s voice project for podcasts and the monetization they hoped for. Here is a Hugging Face Gradio link to test: But download it and clone your voice!show more

This AI model turns a single image + audio... into a talking avatar video of infinite length. StableAvatar is built on Wan 2.1, and MIT Licensed. Open-source AI video is accelerating, and it’s exciting to watch!show more

Create a 3D model from a single image, set... of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”show more

With Hunyuan3D World Model 1.0 now released and open-sourced,... we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:show more

As announced in partnership with NVIDIA at CES, we’re... excited to introduce Stable Point Aware 3D (SPAR3D), setting a new standard in 3D generation. Ideal for running on NVIDIA RTX AI PCs, SPAR3D enables real-time editing and complete structure generation of 3D objects from a single image in under a second. You can download the weights on Hugging Face and code on GitHub, or access the model through the Stability AI API. Learn more here: (1/3)show more

I built a plugin to generate 3D assets directly... from Codex, using the latest update that introduces image generation. It generates an image, calls the Tripo3D API, then starts an MCP server and a local viewer directly inside Codex. It uses the paid Tripo3D API (12 free generations, 600 credits included). Everything is open source on my GitHub. Link below. Feel free to contribute. Room for improvement: skeleton/animation support and multi-provider 3D support.show more

Announcing our latest open medical AI models for developers:... MedGemma 1.5, which is small enough to run offline & improves performance on 3D imaging (CT & MRI), & MedASR, a speech-to-text model for medical dictation. Both available on Hugging Face + Vertex AI. #MedGemma #HealthAI #GenerativeAIshow more

Today, we are releasing Stable Video Diffusion, our first... foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:show more

BOOM! STANFORD LAUNCHES FRAMEPACK A FREE OPEN SOURCE AI... THAT CAN RUN ON 6 GB LAPTOP GPU TO GENERATE MINUTE LONG 30FPS VIDEO FROM SINGLE IMAGE. It is game changing…show more

SAM 3D Body is a CVPR 2026 award candidate... paper from AI at Meta model recovers a full 3D human body mesh from a single RGB image you can run it automatically, or guide the reconstruction with masks and 2D keypoints thx to Niels Rogge for awesome demo ideashow more

I’m making big changes to the AI hedge fund.... Multi ticker trading. Here is how it works: • you specify tickers • analysts research all tickers • portfolio manager creates trading signal Before: we only supported 1 ticker. Now: you can add as many as you like. No coding experience required to run. Everything is open source.show more

Wonderland: Navigating 3D Scenes from a Single Image Contributions:... • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.show more

Introducing WELLAIOS: A revolutionary Open source AI Agent development... framework and launchpad on Solana WELLAIOS empowers you to create, tokenize, and trade advanced AI agents on the Solana blockchain. Built by our team of AI professionals, our platform combines a sophisticated open-source framework with multi-modal AI technology, bringing character creation and storytelling to life without having to write a single line of code. Create intelligent digital characters that evolve, interact, and generate content through our library of AI agents. Each character becomes a unique asset equipped with a large set of AI tools on the Solana blockchain. For developers and creators: Join our thriving ecosystem where innovation meets rewards. Build plugins, contribute to our open-source framework, and earn as your creations shape the future. 👀 Sneak Peek: Watch our 3D AI agent capabilities showcase for content creation. Coming soon to Solana. Follow us on X for exclusive updates and be part of the revolution.show more

DimensionX: Create Any 3D and 4D Scenes from a... Single Image with Controllable Video Diffusion TL;DR: Create 3/4DGS from Video Diffusion Note: Some first inference code released (not all yet). Contributions (cited): • We present DimensionX, a novel framework for generating photorealistic 3D and 4D scenes from only a single image using controllable video diffusion. • We propose ST-Director, which decouples the spatial and temporal priors in video diffusion models by learning (spatial and temporal) dimension-aware modules with our curated datasets. We further enhance the hybriddimension control with a training-free composition approach according to the essence of video diffusion denoising process. • To bridge the gap between video diffusion and real-world scenes, we design a trajectory-aware mechanism for 3D generation and an identity-preserving denoising approach for 4D generation, enabling more realistic and controllable scene synthesis. • Extensive experiments manifest that our DimensionX delivers superior performance in video, 3D, and 4D generation compared with baseline methods.show more

Excited to announce AI Research Skills - an open-source... library of 82 specialized skills for AI coding tools. One command gives your agent expert knowledge in: → Model training & fine-tuning (TRL, Unsloth ...) → Distributed systems (DeepSpeed, FSDP ...) → Inference optimization (vLLM, TensorRT ...) → Agent building ? (Langchain, AutoGPT ...) Works with Claude Code, Cursor, Gemini CLI, Windsurf, and Codex with one click interactive installation @ npx orchestra-research/ai-research-skills If you found the ML paper writing skill useful, check out the comprehensive collectionshow more