正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

This is getting interesting. In this iteration, the magnifying glass is tracked in real-time, feeding only what is seen through it to the diffusion process, revealing the invisible within a piece of clay. Real-time diffusion with Stream Diffusion + SDXL Turbo. #StableDiffusion #SDXLTurbo #StreamDiffusion #StabilityAI #Realtime

Hugues Bruyère

7,299 subscribers

26,432 次观看 • 2 年前 •via X (Twitter)

科学技术艺术 #StableDiffusion

Anya Rossi• Live Now

Private livecam show

10 条评论

littlecakes 的头像

littlecakes2 年前

amazing!

Hugues Bruyère 的头像

Hugues Bruyère2 年前

Thank you!

alejandro cartagena 的头像

alejandro cartagena2 年前

❤️❤️❤️

Hugues Bruyère 的头像

Hugues Bruyère2 年前

☺️😶‍🌫️

Brian Jordan 的头像

Brian Jordan2 年前

@cumulo_autumn

Moritz Stefaner 的头像

Moritz Stefaner2 年前

Lovely!

Hugues Bruyère 的头像

Hugues Bruyère2 年前

Thanks!

Metaverse | Eric 的头像

Metaverse | Eric2 年前

This is so great，Very interesting

humanboy 的头像

humanboy2 年前

💜

MouX 的头像

MouX2 年前

This is the wow

相关视频

Diffusion is the foundational ML framework behind state-of-the-art AI image and video generation, including Sora, Midjourney and Google Veo. In this episode of Decoded, Ankit Gupta sits down with Francois Chaubard to discuss how diffusion works, walk through a code sample, and explain why everyone training models should understand it. 00:00 Intro 00:33 What is diffusion? 02:50 What are applications of diffusion today? 04:06 Key innovations 07:01 Code examples 19:25 The "squint test" 22:27 Other areas diffusion is widely accessible 24:49 Outro

Diffusion is the foundational ML framework behind state-of-the-art AI image and video generation, including Sora, Midjourney and Google Veo. In this episode of Decoded, Ankit Gupta sits down with Francois Chaubard to discuss how diffusion works, walk through a code sample, and explain why everyone training models should understand it. 00:00 Intro 00:33 What is diffusion? 02:50 What are applications of diffusion today? 04:06 Key innovations 07:01 Code examples 19:25 The "squint test" 22:27 Other areas diffusion is widely accessible 24:49 Outro

Y Combinator

74,604 次观看 • 6 个月前

Skinny Bob is back in the Cycle and we are being told he is 100% real alien DNA.. I put the original clips through my Diffusion process (Not Ai Upscale) to get the maximum detail.. I clip in a few interesting aspects of his features.. This is about as clean as i can get it while still respecting the original details in the video.

Skinny Bob is back in the Cycle and we are being told he is 100% real alien DNA.. I put the original clips through my Diffusion process (Not Ai Upscale) to get the maximum detail.. I clip in a few interesting aspects of his features.. This is about as clean as i can get it while still respecting the original details in the video.

ProPixel Video Analysis and Research

329,667 次观看 • 1 年前

A quick first pass at a new iteration of the realtime diffusion pipeline: physical interface → camera → realtime img2img → upscale → 3DGS through the new TripoSplat. Rough and held together with tape for now, but the whole loop runs end to end. Next: - better input and camera's pov, - splitting it across two machines to automate the hand-off, - and adding in the Tripo3D API for higher-res models... the 3D printer is just waiting for that. #diffusion #3DGS #TripoSplat

A quick first pass at a new iteration of the realtime diffusion pipeline: physical interface → camera → realtime img2img → upscale → 3DGS through the new TripoSplat. Rough and held together with tape for now, but the whole loop runs end to end. Next: - better input and camera's pov, - splitting it across two machines to automate the hand-off, - and adding in the Tripo3D API for higher-res models... the 3D printer is just waiting for that. #diffusion #3DGS #TripoSplat

Hugues Bruyère

15,526 次观看 • 1 个月前

We are thrilled to announce "Layered Diffusion Brushes": a real-time training-free image editor powered by diffusion models. 🎨✨ This is new work from my PhD student Peyman Gholami Peyman Gholami. Explore the interactive demo and check out more videos at:

We are thrilled to announce "Layered Diffusion Brushes": a real-time training-free image editor powered by diffusion models. 🎨✨ This is new work from my PhD student Peyman Gholami Peyman Gholami. Explore the interactive demo and check out more videos at:

Robert Xiao

14,334 次观看 • 2 年前

Wow, diffusion models (used in AI image generation) are also game engines - a type of world simulation. By predicting the next frame of the classic shooter DOOM, you get a playable game at 20 fps without any underlying real game engine. This video is from the diffusion model.

Wow, diffusion models (used in AI image generation) are also game engines - a type of world simulation. By predicting the next frame of the classic shooter DOOM, you get a playable game at 20 fps without any underlying real game engine. This video is from the diffusion model.

Ethan Mollick

1,768,980 次观看 • 1 年前

I got access to Gemini Diffusion for a few weeks. I believe this is one of the most important upcoming technologies in the AI space, it's like a GPT-4 moment all over again. Once the model gets better, it will completely reshape AI experiences for us. Video is in real time.

I got access to Gemini Diffusion for a few weeks. I believe this is one of the most important upcoming technologies in the AI space, it's like a GPT-4 moment all over again. Once the model gets better, it will completely reshape AI experiences for us. Video is in real time.

Pietro Schirano

109,187 次观看 • 1 年前

I'm thrilled to announce the launch of ⚡️Flash Diffusion from Jasper! Earlier this year, with our acquisition of Clipdrop, we launched the Jasper AI Research Lab in Paris. Today, we are excited to release our first piece of groundbreaking research: the open-source distillation method, "Flash Diffusion". Flash Diffusion accelerates inference by 500%, reduces computing costs, and produces higher-quality image outputs. Dive into the details and discover how Flash Diffusion is set to revolutionize the field of AI and image synthesis. Read all about it here: Try a demo on Hugging Face:

I'm thrilled to announce the launch of ⚡️Flash Diffusion from Jasper! Earlier this year, with our acquisition of Clipdrop, we launched the Jasper AI Research Lab in Paris. Today, we are excited to release our first piece of groundbreaking research: the open-source distillation method, "Flash Diffusion". Flash Diffusion accelerates inference by 500%, reduces computing costs, and produces higher-quality image outputs. Dive into the details and discover how Flash Diffusion is set to revolutionize the field of AI and image synthesis. Read all about it here: Try a demo on Hugging Face:

Timothy Young

10,093 次观看 • 2 年前

Can finally explore latent space through feedback loops in real time with the new #streamdiffusion setup from Lyell. Being able to guide it with my mouse in real time is way too much fun

Can finally explore latent space through feedback loops in real time with the new #streamdiffusion setup from Lyell. Being able to guide it with my mouse in real time is way too much fun

Spencer Sterling

19,146 次观看 • 1 年前

🎉 Today at Decart we're announcing Mirage. The first generative video model that runs in real-time, to infinity. Mirage is a Live Stream Diffusion (LSD), a breakthrough that transforms any video into anything you can imagine, as it plays. 🎮 Try it:

🎉 Today at Decart we're announcing Mirage. The first generative video model that runs in real-time, to infinity. Mirage is a Live Stream Diffusion (LSD), a breakthrough that transforms any video into anything you can imagine, as it plays. 🎮 Try it:

Kfir Aberman

37,114 次观看 • 1 年前

Today, we’re thrilled to announce the open weights for Stable Diffusion 3 Medium, the latest and most advanced text-to-image AI model in our Stable Diffusion 3 series! This new release represents a major milestone in the evolution of generative AI and continues our commitment to democratising this powerful technology. 🎉 Learn more and get started here:

Today, we’re thrilled to announce the open weights for Stable Diffusion 3 Medium, the latest and most advanced text-to-image AI model in our Stable Diffusion 3 series! This new release represents a major milestone in the evolution of generative AI and continues our commitment to democratising this powerful technology. 🎉 Learn more and get started here:

Stability AI

308,160 次观看 • 2 年前

Introducing SDXL Turbo: A real-time text-to-image generation model. SDXL Turbo achieves state-of-the-art performance with a new distillation technology, enabling single-step image generation with unprecedented quality, reducing the required step count from 50 to just one. The code, research paper, and weights for non-commercial use are now available on our website. You can test SDXL Turbo on Stability AI’s image editing platform Clipdrop, with a beta demonstration of the real-time text-to-image generation capabilities. Learn more:

Introducing SDXL Turbo: A real-time text-to-image generation model. SDXL Turbo achieves state-of-the-art performance with a new distillation technology, enabling single-step image generation with unprecedented quality, reducing the required step count from 50 to just one. The code, research paper, and weights for non-commercial use are now available on our website. You can test SDXL Turbo on Stability AI’s image editing platform Clipdrop, with a beta demonstration of the real-time text-to-image generation capabilities. Learn more:

Stability AI

976,344 次观看 • 2 年前

The rate of diffusion of this next generation of AI is unlike anything we've seen, but even more remarkable is the sense of empowerment it has already unlocked in every corner of the world, including rural India.

The rate of diffusion of this next generation of AI is unlike anything we've seen, but even more remarkable is the sense of empowerment it has already unlocked in every corner of the world, including rural India.

Satya Nadella

290,457 次观看 • 3 年前

The Waypoint-1.5 technical paper is now live. Waypoint-1.5 is a real-time video diffusion world model designed to run on consumer GPUs, bringing interactive world models closer to practical, accessible deployment.

The Waypoint-1.5 technical paper is now live. Waypoint-1.5 is a real-time video diffusion world model designed to run on consumer GPUs, bringing interactive world models closer to practical, accessible deployment.

Overworld

80,145 次观看 • 1 个月前

Mercury 2 is live 🚀🚀 The world’s first reasoning diffusion LLM, delivering 5x faster performance than leading speed-optimized LLMs. Watching the team turn years of research into a real product never gets old, and I’m incredibly proud of what we’ve built. We’re just getting started on what diffusion can do for language.

Mercury 2 is live 🚀🚀 The world’s first reasoning diffusion LLM, delivering 5x faster performance than leading speed-optimized LLMs. Watching the team turn years of research into a real product never gets old, and I’m incredibly proud of what we’ve built. We’re just getting started on what diffusion can do for language.

Stefano Ermon

1,041,631 次观看 • 5 个月前

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models paper page: github: Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However, these models still encounter difficulties when generating images from prompts that demand spatial or common sense reasoning. We propose to equip diffusion models with enhanced reasoning capabilities by using off-the-shelf pretrained large language models (LLMs) in a novel two-stage generation process. First, we adapt an LLM to be a text-guided layout generator through in-context learning. When provided with an image prompt, an LLM outputs a scene layout in the form of bounding boxes along with corresponding individual descriptions. Second, we steer a diffusion model with a novel controller to generate images conditioned on the layout. Both stages utilize frozen pretrained models without any LLM or diffusion model parameter optimization. We validate the superiority of our design by demonstrating its ability to outperform the base diffusion model in accurately generating images according to prompts that necessitate both language and spatial reasoning. Additionally, our method naturally allows dialog-based scene specification and is able to handle prompts in a language that is not well-supported by the underlying diffusion model.

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models paper page: github: Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However, these models still encounter difficulties when generating images from prompts that demand spatial or common sense reasoning. We propose to equip diffusion models with enhanced reasoning capabilities by using off-the-shelf pretrained large language models (LLMs) in a novel two-stage generation process. First, we adapt an LLM to be a text-guided layout generator through in-context learning. When provided with an image prompt, an LLM outputs a scene layout in the form of bounding boxes along with corresponding individual descriptions. Second, we steer a diffusion model with a novel controller to generate images conditioned on the layout. Both stages utilize frozen pretrained models without any LLM or diffusion model parameter optimization. We validate the superiority of our design by demonstrating its ability to outperform the base diffusion model in accurately generating images according to prompts that necessitate both language and spatial reasoning. Additionally, our method naturally allows dialog-based scene specification and is able to handle prompts in a language that is not well-supported by the underlying diffusion model.

AK

83,657 次观看 • 3 年前

From painting to nearly real in just minutes. 🎨➡️👤 Krita Diffusion + FacePoke + Live Portrait + Runway Gen 3. This combination is taking us closer to reality faster than ever before. Is this the future of art, or is something lost in the speed? #AIArt #DigitalHumans #CreativeTech

From painting to nearly real in just minutes. 🎨➡️👤 Krita Diffusion + FacePoke + Live Portrait + Runway Gen 3. This combination is taking us closer to reality faster than ever before. Is this the future of art, or is something lost in the speed? #AIArt #DigitalHumans #CreativeTech

Martin Nebelong

73,099 次观看 • 1 年前

🥳We’re releasing StreamDiffusionV2 for the live-stream community—from individual creators with one GPU to enterprise platforms with many. StreamDiffusionV2 is our follow-up to StreamDiffusion: #StreamDiffusion powered real products, but temporal consistency still bugged us. We’re fixing that for the community: 🤔Efficiency ≠ live-readiness: many “real-time” video diffusion models are fast, but live streaming demands per-frame deadlines with low jitter. StreamDiffusionV2 balances temporal stability with strict per-frame deadlines, achieves fast interaction, and is ready for your AI Youtuber Stream Live👇 📒Project page: 💻Code:

🥳We’re releasing StreamDiffusionV2 for the live-stream community—from individual creators with one GPU to enterprise platforms with many. StreamDiffusionV2 is our follow-up to StreamDiffusion: #StreamDiffusion powered real products, but temporal consistency still bugged us. We’re fixing that for the community: 🤔Efficiency ≠ live-readiness: many “real-time” video diffusion models are fast, but live streaming demands per-frame deadlines with low jitter. StreamDiffusionV2 balances temporal stability with strict per-frame deadlines, achieves fast interaction, and is ready for your AI Youtuber Stream Live👇 📒Project page: 💻Code:

Chenfeng_X

20,424 次观看 • 10 个月前

I just coded up 7 apps in 30 seconds with Gemini Diffusion...this has to be a world record. the video is 1x speed 👀

I just coded up 7 apps in 30 seconds with Gemini Diffusion...this has to be a world record. the video is 1x speed 👀

Wes Roth

65,229 次观看 • 1 年前

Thanks to the Latent Consistency Model (LCM), we're nearing real-time image diffusion. I've made a simple MJPEG server for generation stream using diffusers img2img pipeline. It's really fun to play with it. Can't wait for the ControlNet version. try it:

Thanks to the Latent Consistency Model (LCM), we're nearing real-time image diffusion. I've made a simple MJPEG server for generation stream using diffusers img2img pipeline. It's really fun to play with it. Can't wait for the ControlNet version. try it:

Radamés Ajna

231,878 次观看 • 2 年前