Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

ScenarioControl (ECCV 2026) enables end-to-end controllable generative simulation 🚗✨for autonomous driving, allowing users to generate diverse traffic scenarios with fine-grained actor control while preserving realistic scene dynamics. We have released the code, and we’re looking forward to seeing what the community builds with it! 🔗 Check out our project... show more

Felix Heide

2,016 subscribers

56,455 Aufrufe • vor 3 Monaten •via X (Twitter)

Wissenschaft & Technologie Autos & Fahrzeuge

Anya Rossi• Live Now

Private livecam show

1 Kommentare

Profilbild von Conie Lariego

Conie Lariegovor 3 Monaten

bruh simulating traffic for AVs without cars acting like broken NPCs is a headache 💀 this actor control is massive. honestly seeing how we process edge-case data during my internship at Lifewood Data Technology shows exactly why this level of simulation is needed...

Ähnliche Videos

ScenarioControl 🚗🛣️ - Scenario Generation from a single Dashcam Image 📸 or Text Prompt 💬!! Excited to introduce a new vision-language control mechanism for learned driving scenario generation. Given a single dashcam image or a scene prompt or an image, we generate a full scene layout 🧩, temporally consistent rollouts, including map 🗺️, agents 🚗, and ego video🛣️ ScenarioControl enables direct, fine-grained control over layout and traffic while preserving realism. It operates in a vectorized latent space with a new cross-global control mechanism to fuse vision-language inputs with scene structure while preserving realism. Interfaces seamlessly with generative video models! Project: Super fun project by Lili Gao, Yanbo Xu , William Koch, Samuele Ruffino, Luke Rowe , Behdad Chalaki, Dmitriy Rivkin, Julian Ost, Roger Girgis, Mario Bijelic.

ScenarioControl 🚗🛣️ - Scenario Generation from a single Dashcam Image 📸 or Text Prompt 💬!! Excited to introduce a new vision-language control mechanism for learned driving scenario generation. Given a single dashcam image or a scene prompt or an image, we generate a full scene layout 🧩, temporally consistent rollouts, including map 🗺️, agents 🚗, and ego video🛣️ ScenarioControl enables direct, fine-grained control over layout and traffic while preserving realism. It operates in a vectorized latent space with a new cross-global control mechanism to fuse vision-language inputs with scene structure while preserving realism. Interfaces seamlessly with generative video models! Project: Super fun project by Lili Gao, Yanbo Xu , William Koch, Samuele Ruffino, Luke Rowe , Behdad Chalaki, Dmitriy Rivkin, Julian Ost, Roger Girgis, Mario Bijelic.

Felix Heide

22,418 Aufrufe • vor 6 Monaten

Sharing our new work: UniForge3D generates detailed 3D meshes from sparse-view inputs with high fidelity! The code has been released and welcome to try it! Paper: Project Page: Code:

Sharing our new work: UniForge3D generates detailed 3D meshes from sparse-view inputs with high fidelity! The code has been released and welcome to try it! Paper: Project Page: Code:

Yuan Liu

29,511 Aufrufe • vor 20 Tagen

NEWS: Waymo has introduced the Waymo World Model, "a frontier generative model built on Google DeepMind’s Genie 3 that sets a new bar for large-scale, hyper-realistic autonomous driving simulation." "By simulating the “impossible”, we proactively prepare the Waymo Driver for some of the most rare and complex scenarios—from tornadoes to planes landing on freeways—long before it encounters them in the real world. The model’s architecture offers high controllability, allowing our engineers to modify simulations with simple language prompts, driving inputs, and scene layouts. Notably, the Waymo World Model generates high-fidelity, multi-sensor outputs that include both camera and lidar data. This combination of broad world knowledge, fine-grained controllability, and multi-modal realism enhances Waymo’s ability to safely scale our service across more places and new driving environments. In the following sections we showcase the Waymo World Model in action, featuring simulations of the Waymo Driver navigating diverse rare edge-case scenarios." More info below.

NEWS: Waymo has introduced the Waymo World Model, "a frontier generative model built on Google DeepMind’s Genie 3 that sets a new bar for large-scale, hyper-realistic autonomous driving simulation." "By simulating the “impossible”, we proactively prepare the Waymo Driver for some of the most rare and complex scenarios—from tornadoes to planes landing on freeways—long before it encounters them in the real world. The model’s architecture offers high controllability, allowing our engineers to modify simulations with simple language prompts, driving inputs, and scene layouts. Notably, the Waymo World Model generates high-fidelity, multi-sensor outputs that include both camera and lidar data. This combination of broad world knowledge, fine-grained controllability, and multi-modal realism enhances Waymo’s ability to safely scale our service across more places and new driving environments. In the following sections we showcase the Waymo World Model in action, featuring simulations of the Waymo Driver navigating diverse rare edge-case scenarios." More info below.

Sawyer Merritt

133,382 Aufrufe • vor 9 Monaten

At the Paris Motor Show, XPENG and Tesla brought autonomous driving to real Paris streets as part of the official Autonomous Lab program — the first large-scale public experience of XPENG’s AI driving technology in Europe. I also tried Tesla FSD. Both FSD and NGP have made impressive progress, each with its strengths. At XPENG, we believe our larger models give NGP stronger generalization across diverse driving scenarios. Now, You can still sign up for the test ride and try it out. Competition drives progress. Users win. Let’s keep pushing the tech forward, together.

At the Paris Motor Show, XPENG and Tesla brought autonomous driving to real Paris streets as part of the official Autonomous Lab program — the first large-scale public experience of XPENG’s AI driving technology in Europe. I also tried Tesla FSD. Both FSD and NGP have made impressive progress, each with its strengths. At XPENG, we believe our larger models give NGP stronger generalization across diverse driving scenarios. Now, You can still sign up for the test ride and try it out. Competition drives progress. Users win. Let’s keep pushing the tech forward, together.

Xiaopeng He

1,324,050 Aufrufe • vor 20 Tagen

Introducing Code Video Model 🎬 Amazing work led by Ziyu Wan and the team! Agentic coding as the engine for controllable video generation. Scene layout, motion, timing, camera trajectories, and physical dynamics, all in editable code. A coding agent turns prompts into executable programs that render proxy videos. Our training-free early-step conditioning lets a pretrained video model follow the proxy’s structure while adopting a reference image’s appearance. From physics-grounded motion and bullet time to 3D/4D reconstruction and robotics simulation, it all starts with code. Watch the demo and explore more visual results 👇 Project page: Paper: Code: Data: Youtube:

Introducing Code Video Model 🎬 Amazing work led by Ziyu Wan and the team! Agentic coding as the engine for controllable video generation. Scene layout, motion, timing, camera trajectories, and physical dynamics, all in editable code. A coding agent turns prompts into executable programs that render proxy videos. Our training-free early-step conditioning lets a pretrained video model follow the proxy’s structure while adopting a reference image’s appearance. From physics-grounded motion and bullet time to 3D/4D reconstruction and robotics simulation, it all starts with code. Watch the demo and explore more visual results 👇 Project page: Paper: Code: Data: Youtube:

Gordon (Guocheng) Qian

40,646 Aufrufe • vor 24 Tagen

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards *long-context world model*, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK

🔥1-min Interactive Video Generation with Multimodal Control🔥 Towards long-context world model, #LongVie is an end-to-end autoregressive framework for controllable ultra-long video generation - Page: - Paper: . Thanks AK

Ziwei Liu

14,213 Aufrufe • vor 1 Jahr

The code of GSPN #CVPR2025 is released! We proposed a new sqrt(N) complexity attention mechanism, which enables efficient high resolution image generation. We can generate 8k images with 42x speed up compared to self-attention in StableDiffusionXL! Code: Paper:

The code of GSPN #CVPR2025 is released! We proposed a new sqrt(N) complexity attention mechanism, which enables efficient high resolution image generation. We can generate 8k images with 42x speed up compared to self-attention in StableDiffusionXL! Code: Paper:

Xiaolong Wang

355,123 Aufrufe • vor 1 Jahr

I'm excited to share our new work, VistaDream, which generates a 3D Gaussian field from a single-view image. The codes have already been released. Project page: (with interactive demos) Code: Paper:

I'm excited to share our new work, VistaDream, which generates a 3D Gaussian field from a single-view image. The codes have already been released. Project page: (with interactive demos) Code: Paper:

Yuan Liu

79,751 Aufrufe • vor 2 Jahren

🚀Excited to introduce GEN3C #CVPR2025, a generative video model with an explicit 3D cache for precise camera control. 🎥It applies to multiple use cases, including single-view and sparse-view NVS🖼️ and challenging settings like monocular dynamic NVS and driving simulation🚗. Project page:

🚀Excited to introduce GEN3C #CVPR2025, a generative video model with an explicit 3D cache for precise camera control. 🎥It applies to multiple use cases, including single-view and sparse-view NVS🖼️ and challenging settings like monocular dynamic NVS and driving simulation🚗. Project page:

Xuanchi Ren

60,169 Aufrufe • vor 1 Jahr

🤖 What if a humanoid robot could make a hamburger from raw ingredients—all the way to your plate? 🔥 Excited to announce ViTacFormer: our new pipeline for next-level dexterous manipulation with active vision + high-resolution touch. 🎯 For the first time ever, we demonstrate ~2.5 minutes of continuous, autonomous control—combining active vision, high-res touch, and high-DoF robot hands SharpaWave — to complete complex, real-world tasks. Code is fully released; check out our: Homepage: Paper link: Github:

🤖 What if a humanoid robot could make a hamburger from raw ingredients—all the way to your plate? 🔥 Excited to announce ViTacFormer: our new pipeline for next-level dexterous manipulation with active vision + high-resolution touch. 🎯 For the first time ever, we demonstrate ~2.5 minutes of continuous, autonomous control—combining active vision, high-res touch, and high-DoF robot hands SharpaWave — to complete complex, real-world tasks. Code is fully released; check out our: Homepage: Paper link: Github:

Haoran Geng

96,393 Aufrufe • vor 1 Jahr

MagicScroll: Nontypical Aspect-Ratio Image Generation for Visual Storytelling via Multi-Layered Semantic-Aware Denoising paper page: Visual storytelling often uses nontypical aspect-ratio images like scroll paintings, comic strips, and panoramas to create an expressive and compelling narrative. While generative AI has achieved great success and shown the potential to reshape the creative industry, it remains a challenge to generate coherent and engaging content with arbitrary size and controllable style, concept, and layout, all of which are essential for visual storytelling. To overcome the shortcomings of previous methods including repetitive content, style inconsistency, and lack of controllability, we propose MagicScroll, a multi-layered, progressive diffusion-based image generation framework with a novel semantic-aware denoising process. The model enables fine-grained control over the generated image on object, scene, and background levels with text, image, and layout conditions. We also establish the first benchmark for nontypical aspect-ratio image generation for visual storytelling including mediums like paintings, comics, and cinematic panoramas, with customized metrics for systematic evaluation. Through comparative and ablation studies, MagicScroll showcases promising results in aligning with the narrative text, improving visual coherence, and engaging the audience. We plan to release the code and benchmark in the hope of a better collaboration between AI researchers and creative practitioners involving visual storytelling.

MagicScroll: Nontypical Aspect-Ratio Image Generation for Visual Storytelling via Multi-Layered Semantic-Aware Denoising paper page: Visual storytelling often uses nontypical aspect-ratio images like scroll paintings, comic strips, and panoramas to create an expressive and compelling narrative. While generative AI has achieved great success and shown the potential to reshape the creative industry, it remains a challenge to generate coherent and engaging content with arbitrary size and controllable style, concept, and layout, all of which are essential for visual storytelling. To overcome the shortcomings of previous methods including repetitive content, style inconsistency, and lack of controllability, we propose MagicScroll, a multi-layered, progressive diffusion-based image generation framework with a novel semantic-aware denoising process. The model enables fine-grained control over the generated image on object, scene, and background levels with text, image, and layout conditions. We also establish the first benchmark for nontypical aspect-ratio image generation for visual storytelling including mediums like paintings, comics, and cinematic panoramas, with customized metrics for systematic evaluation. Through comparative and ablation studies, MagicScroll showcases promising results in aligning with the narrative text, improving visual coherence, and engaging the audience. We plan to release the code and benchmark in the hope of a better collaboration between AI researchers and creative practitioners involving visual storytelling.

AK

22,379 Aufrufe • vor 2 Jahren

🇪🇸 We just received Spain's first national operating permit for L4 autonomous passenger vehicles from the Directorate-General for Traffic (DGT) together with Uber – the first national approval for the GXR in the EU. Commercial operations expected to begin by end-2026. $WRD

🇪🇸 We just received Spain's first national operating permit for L4 autonomous passenger vehicles from the Directorate-General for Traffic (DGT) together with Uber – the first national approval for the GXR in the EU. Commercial operations expected to begin by end-2026. $WRD

WeRide.ai

354,124 Aufrufe • vor 1 Monat

📢📢📢 Excited to share our new work *Autonomous Character-Scene Interaction Synthesis from Text Instruction* (Siggraph Asia 24). It presents a unified model for flexible scene-conditioned motion generation given text, scene, trajectory conditions. The results with smooth interaction look very impressive! 📰Paper: Project: Code and data will be released soon.

📢📢📢 Excited to share our new work Autonomous Character-Scene Interaction Synthesis from Text Instruction (Siggraph Asia 24). It presents a unified model for flexible scene-conditioned motion generation given text, scene, trajectory conditions. The results with smooth interaction look very impressive! 📰Paper: Project: Code and data will be released soon.

Siyuan Huang

11,451 Aufrufe • vor 2 Jahren

We are proud to announce our rebrand!We’re excited to share the opportunities we have created in communities around the country and looking forward to implementing new initiatives. Big shout out to 2Cents FC for partnering with us on the rebrand!

We are proud to announce our rebrand!We’re excited to share the opportunities we have created in communities around the country and looking forward to implementing new initiatives. Big shout out to 2Cents FC for partnering with us on the rebrand!

United Black Players of the USL

34,537 Aufrufe • vor 3 Jahren

Multi-Track Timeline Control for Text-Driven 3D Human Motion Generation paper page: Recent advances in generative modeling have led to promising progress on synthesizing 3D human motion from text, with methods that can generate character animations from short prompts and specified durations. However, using a single text prompt as input lacks the fine-grained control needed by animators, such as composing multiple actions and defining precise durations for parts of the motion. To address this, we introduce the new problem of timeline control for text-driven motion synthesis, which provides an intuitive, yet fine-grained, input interface for users. Instead of a single prompt, users can specify a multi-track timeline of multiple prompts organized in temporal intervals that may overlap. This enables specifying the exact timings of each action and composing multiple actions in sequence or at overlapping intervals. To generate composite animations from a multi-track timeline, we propose a new test-time denoising method. This method can be integrated with any pre-trained motion diffusion model to synthesize realistic motions that accurately reflect the timeline. At every step of denoising, our method processes each timeline interval (text prompt) individually, subsequently aggregating the predictions with consideration for the specific body parts engaged in each action. Experimental comparisons and ablations validate that our method produces realistic motions that respect the semantics and timing of given text prompts.

Multi-Track Timeline Control for Text-Driven 3D Human Motion Generation paper page: Recent advances in generative modeling have led to promising progress on synthesizing 3D human motion from text, with methods that can generate character animations from short prompts and specified durations. However, using a single text prompt as input lacks the fine-grained control needed by animators, such as composing multiple actions and defining precise durations for parts of the motion. To address this, we introduce the new problem of timeline control for text-driven motion synthesis, which provides an intuitive, yet fine-grained, input interface for users. Instead of a single prompt, users can specify a multi-track timeline of multiple prompts organized in temporal intervals that may overlap. This enables specifying the exact timings of each action and composing multiple actions in sequence or at overlapping intervals. To generate composite animations from a multi-track timeline, we propose a new test-time denoising method. This method can be integrated with any pre-trained motion diffusion model to synthesize realistic motions that accurately reflect the timeline. At every step of denoising, our method processes each timeline interval (text prompt) individually, subsequently aggregating the predictions with consideration for the specific body parts engaged in each action. Experimental comparisons and ablations validate that our method produces realistic motions that respect the semantics and timing of given text prompts.

AK

126,654 Aufrufe • vor 2 Jahren

Some of our air traffic control towers use radars from the 1960s and the operating system we use dates back to 1995 and 2000. We’re dealing with floppy discs and paper strips! The mess we inherited is insane. Technology has far exceeded what we have so U.S. Department of Transportation is upgrading our air traffic control with the most advanced system. Check out all the details in my interview with Miranda Devine on Pod Force One! ⬇️

Some of our air traffic control towers use radars from the 1960s and the operating system we use dates back to 1995 and 2000. We’re dealing with floppy discs and paper strips! The mess we inherited is insane. Technology has far exceeded what we have so U.S. Department of Transportation is upgrading our air traffic control with the most advanced system. Check out all the details in my interview with Miranda Devine on Pod Force One! ⬇️

Secretary Sean Duffy

223,391 Aufrufe • vor 1 Jahr

With the new year underway, it’s the right moment to look back at a year that truly moved our community forward. This film highlights our key moments and the ongoing impact of the #InvictusGames Foundation, made possible by our community, partners and supporters. The work ahead in 2026 builds on this momentum, and we’re looking forward to the next chapter together. #IAMHere

With the new year underway, it’s the right moment to look back at a year that truly moved our community forward. This film highlights our key moments and the ongoing impact of the #InvictusGames Foundation, made possible by our community, partners and supporters. The work ahead in 2026 builds on this momentum, and we’re looking forward to the next chapter together. #IAMHere

Invictus Games Foundation 💛🖤

10,374 Aufrufe • vor 9 Monaten

Have you been looking for a tech course that does not require you to code? We have the right course for you! Our UI/UX Product Design program will prepare you to become an end-to-end Product Designer by learning UX and UI design.

Have you been looking for a tech course that does not require you to code? We have the right course for you! Our UI/UX Product Design program will prepare you to become an end-to-end Product Designer by learning UX and UI design.

Moringa School

4,573,710 Aufrufe • vor 2 Jahren

Have you been looking for a tech course that does not require you to code? We have the right course for you! Our UI/UX Product Design program will prepare you to become an end-to-end Product Designer by learning UX and UI design.

Have you been looking for a tech course that does not require you to code? We have the right course for you! Our UI/UX Product Design program will prepare you to become an end-to-end Product Designer by learning UX and UI design.

Moringa School

2,956,646 Aufrufe • vor 2 Jahren

We now run paid ads end-to-end from the Claude Code terminal at our $7M ARR agency. Our head of growth, Ivan, walks through the complete build on camera. > Builds the ICP matrix, sources target companies and contacts, enriches their emails via Prospero > Extracts brand specs from the landing page and assets, matches them against our proven ad template library > Fans out across parallel agents to generate creative variations > Renders the images and auto-uploads the audiences plus ads into Meta and LinkedIn campaigns We ran it live on Lovable just to see what would come out. Watch the entire thing:

Michel Lieben

17,477 Aufrufe • vor 6 Monaten