My first PhD paper!🎉We learn *diffusion* models for code... generation that learn to directly *edit* syntax trees of programs. The result is a system that can incrementally write code, see the execution output, and debug it. 🧵1/nshow more

Excited to introduce Diffusion Augmented Agents (DAAGs)✨. We give... an agent control of a diffusion model, so it can create its own *synthetic experience*.🪄 The result is a lifelong agent that can learn new reward detectors and policies, much more efficiently. Here's how. 👇show more

Today we're launching new ways to learn in Claude... Code and the Claude app. First up: Claude Code now lets you customize communication styles with /output-styleshow more

You can edit your source code directly from Chrome... Sources tab and it will synchronize with the filesystem! That HMR is dope! Chrome Angularshow more

Can we use motion to prompt diffusion models? Our... #ICLR2024 paper does just that. We propose Motion Guidance, a technique that allows users to edit an image by specifying “where things should move.”show more

🚀 Introducing GenLit – Reformulating Single-Image Relighting as Video... Generation! We leverage video diffusion models to perform realistic near-field relighting from just a single image—No explicit 3D reconstruction or ray tracing required! No intermediate graphics buffers, directly in the pixel space! 📄 Dive into the paper: 🎥 Project page & demos: 🛠 Code coming soon! #GenerativeAI #ComputerVision #Relighting #DiffusionModels #Graphics 🧵 1/5show more

We're also excited for Canvas to become a more... personalized tutor that you can interact in much richer ways. You can ask ChatGPT to explain some mathematical concept, write code to plot that will help you learn it in a more visual way.show more

1/ Happy to share VADER: Video Diffusion Alignment via... Reward Gradients. We adapt foundational video diffusion models using pre-trained reward models to generate high-quality, aligned videos for various end-applications. Below we generated a short movie using VADER 😀, we used ChatGPT to write a script and an off-the-shelf AI music generator to generate the sound. Our code & weights are open-sourced:show more

We have released the code and weights for our... #CVPR2023 paper "Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model"! code: abs: project: The demo is below:show more

My Three.js + TSL shader course — Fragments —... is open for registration for the next 2 weeks! It's the perfect way to learn the techniques that power some of the most incredible shaders out there, and how to build them in code.show more

Meta just announced that Code Llama was now free... for both research and commercial. This might the strongest competitor to ChatGPT: ▸ Can generate, explain, and debug your code ▸ Handles input 100,000 tokens ▸ Free for research + commercial use ▸ Outperforms most open models ▸ Comes in 7B, 13B, and 34B ▸ Supports Python, C++, Java, PHP, Typescript (Javascript), C#, and Bash Available in: ▸ Foundation base models (Code Llama) ▸ Python specializations (Code Llama - Python), ▸ Instruction-following models (Code Llama - Instruct)show more

Selected as a best paper finalist at #CVPR2026: PixelDiT... from NVIDIA Research In most image generation models, a pretrained autoencoder compresses the image before any diffusion happens, causing quality loss that accumulates across the entire pipeline. PixelDiT, or Pixel Diffusion Transformers, removes this step entirely. It's a single-stage model that learns the diffusion process directly in pixel space, end-to-end.show more

Diffusion models are great, but we can squeeze out... so much more from them. The only problem is that it usually requires extra training or manual representation editing. In our new paper, we show that with the current capabilities of LLMs, it is much simpler than we thought!show more

AI has huge potential to change how we work... and live. That was clear at Montreal’s ALL IN Conference. But we also need to make sure our AI ecosystem can develop responsibly – and that’s what our new code of conduct does. Learn more about the code here:show more

Robotics has a dirty secret. The biggest bottleneck isn't... hardware. It isn't compute. It's data. And right now, only a handful of corporations can afford to generate it... $ROBA No Code Studio is about to change that. 🧵(1/8)show more

🤖 Try Autopilot (Preview) in VS Code! With Autopilot... enabled, the agent stays in control of the workflow. It can run tools, retry on errors, and continue working until the task is complete. Learn more:show more

But can Sora write code? "have someone explain how... to write python code on a black board that outputs "hello world""show more

we open sourced the code to transform human videos... into robot trajectories, so you can train robots with your hands 👐🏻 we used it in our recent paper R+X: Retrieval and Execution from Everyday Human Videos (ICRA 2025 🇺🇸) link and details in thread 🧵show more

🌐 Agentic Browser Tools (Experimental) in Visual Studio Code!... Agents can now open pages, read content, click elements, and verify changes directly in the integrated browser while building your web app. Enable ⚙️ workbench.browser.enableChatTools to try it out. Learn mode:show more

Don't trust, Verify ! You can now dig into... the core building blocks of Keet to verify the code and cryptography that is being used ! Visit & to view the first wave of our open-source code ! More updates and code to follow soon!🍐show more