Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Google presents LightLab Controlling Light Sources in Images with Diffusion Models

_akhaliq's profile picture

AK

502,106 subscribers

122,958 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & TeknolojiHaberler & PolitikaEğitim
LIVE

Anya Rossi• Live Now

Private livecam show

5 Yorum

AK profil fotoğrafı
AK1 yıl önce

discuss with author:

revolver ocelot profil fotoğrafı
revolver ocelot1 yıl önce

Kinda similar to relight from SD

Giulio Aprin profil fotoğrafı
Giulio Aprin1 yıl önce

@WilliamLamkin Wow

J profil fotoğrafı
J1 yıl önce

cool

C12s profil fotoğrafı
C12s1 yıl önce

Game changer for image editing.

Benzer Videolar

Google published LightLab! a new method that can change the intensity and color of light sources in images and adjust ambient lighting
0:26

Google published LightLab! a new method that can change the intensity and color of light sources in images and adjust ambient lighting

Dreaming Tulpa 🥓👑

35,279 görüntüleme • 1 yıl önce

Google presents CAT4D Create Anything in 4D with Multi-View Video Diffusion Models
2:12

Google presents CAT4D Create Anything in 4D with Multi-View Video Diffusion Models

AK

61,949 görüntüleme • 1 yıl önce

Nvidia presents Articulated Kinematics Distillation from Video Diffusion Models
4:11

Nvidia presents Articulated Kinematics Distillation from Video Diffusion Models

AK

39,189 görüntüleme • 1 yıl önce

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models paper page: github: Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However, these models still encounter difficulties when generating images from prompts that demand spatial or common sense reasoning. We propose to equip diffusion models with enhanced reasoning capabilities by using off-the-shelf pretrained large language models (LLMs) in a novel two-stage generation process. First, we adapt an LLM to be a text-guided layout generator through in-context learning. When provided with an image prompt, an LLM outputs a scene layout in the form of bounding boxes along with corresponding individual descriptions. Second, we steer a diffusion model with a novel controller to generate images conditioned on the layout. Both stages utilize frozen pretrained models without any LLM or diffusion model parameter optimization. We validate the superiority of our design by demonstrating its ability to outperform the base diffusion model in accurately generating images according to prompts that necessitate both language and spatial reasoning. Additionally, our method naturally allows dialog-based scene specification and is able to handle prompts in a language that is not well-supported by the underlying diffusion model.
5:11

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models paper page: github: Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However, these models still encounter difficulties when generating images from prompts that demand spatial or common sense reasoning. We propose to equip diffusion models with enhanced reasoning capabilities by using off-the-shelf pretrained large language models (LLMs) in a novel two-stage generation process. First, we adapt an LLM to be a text-guided layout generator through in-context learning. When provided with an image prompt, an LLM outputs a scene layout in the form of bounding boxes along with corresponding individual descriptions. Second, we steer a diffusion model with a novel controller to generate images conditioned on the layout. Both stages utilize frozen pretrained models without any LLM or diffusion model parameter optimization. We validate the superiority of our design by demonstrating its ability to outperform the base diffusion model in accurately generating images according to prompts that necessitate both language and spatial reasoning. Additionally, our method naturally allows dialog-based scene specification and is able to handle prompts in a language that is not well-supported by the underlying diffusion model.

AK

83,657 görüntüleme • 2 yıl önce

Nvidia presents Align Your Steps Optimizing Sampling Schedules in Diffusion Models Diffusion models (DMs) have established themselves as the state-of-the-art generative modeling approach in the visual domain and beyond. A crucial drawback of DMs is their slow sampling speed,
0:34

Nvidia presents Align Your Steps Optimizing Sampling Schedules in Diffusion Models Diffusion models (DMs) have established themselves as the state-of-the-art generative modeling approach in the visual domain and beyond. A crucial drawback of DMs is their slow sampling speed,

AK

32,888 görüntüleme • 2 yıl önce

Oh wow! "[SIGGRAPH '24] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models" Paper: Project: Code (MIT) :
1:04

Oh wow! "[SIGGRAPH '24] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models" Paper: Project: Code (MIT) :

MrNeRF

59,480 görüntüleme • 2 yıl önce

Meta presents Adaptive Caching for Faster Video Generation with Diffusion Transformers
0:50

Meta presents Adaptive Caching for Faster Video Generation with Diffusion Transformers

AK

53,119 görüntüleme • 1 yıl önce

Diffusion models generate high-quality images but require hundreds of forward passes. MIT CSAIL and Adobe Research introduce Distribution Matching Distillation (DMD), a distillation approach that converts costly multi-step diffusion models into fast one-step generators. A thread 🧵
0:24

Diffusion models generate high-quality images but require hundreds of forward passes. MIT CSAIL and Adobe Research introduce Distribution Matching Distillation (DMD), a distillation approach that converts costly multi-step diffusion models into fast one-step generators. A thread 🧵

MIT CSAIL

34,347 görüntüleme • 2 yıl önce

Block Diffusion Interpolating Between Autoregressive and Diffusion Language Models
0:23

Block Diffusion Interpolating Between Autoregressive and Diffusion Language Models

AK

160,553 görüntüleme • 1 yıl önce

Google isn’t betting on a single AI architecture. Sundar Pichai, CEO of Google: “We’re going to push the diffusion paradigm as hard as possible.” “All of today’s mainline Gemini models are autoregressive. Diffusion is a different paradigm.” “For the same capability, diffusion can be much faster.” “It’s behind the mainline models today, but there will be areas where it’s the right tool.” “We’re pushing multiple directions in parallel, and bringing them together where it makes sense.”
1:02

Google isn’t betting on a single AI architecture. Sundar Pichai, CEO of Google: “We’re going to push the diffusion paradigm as hard as possible.” “All of today’s mainline Gemini models are autoregressive. Diffusion is a different paradigm.” “For the same capability, diffusion can be much faster.” “It’s behind the mainline models today, but there will be areas where it’s the right tool.” “We’re pushing multiple directions in parallel, and bringing them together where it makes sense.”

Forward Future

152,625 görüntüleme • 5 ay önce

Excited to share our interview with Sander Dieleman! This is Part 3 in our History of Diffusion series. We talk about diffusion as spectral autoregression, diffusion language models, flow matching, and much more. Enjoy!
45:04

Excited to share our interview with Sander Dieleman! This is Part 3 in our History of Diffusion series. We talk about diffusion as spectral autoregression, diffusion language models, flow matching, and much more. Enjoy!

Slater Stich

28,713 görüntüleme • 1 yıl önce

Guidance on top of diffusion models can now be used to drag and manipulate images, create pose-conditioned images, and so much more! Check out Readout Guidance: Work w/ trevordarrell, Oliver Wang, Dan Goldman, Aleksander Holynski. More in thread 🧵.
0:20

Guidance on top of diffusion models can now be used to drag and manipulate images, create pose-conditioned images, and so much more! Check out Readout Guidance: Work w/ trevordarrell, Oliver Wang, Dan Goldman, Aleksander Holynski. More in thread 🧵.

Grace Luo

42,698 görüntüleme • 2 yıl önce

Today, we’re introducing Video Overviews in NotebookLM — a visual alternative to Audio Overviews. Dive deeper with short, engaging slide summaries using images, diagrams, quotes and data from your sources, narrated by your AI host.
0:37

Today, we’re introducing Video Overviews in NotebookLM — a visual alternative to Audio Overviews. Dive deeper with short, engaging slide summaries using images, diagrams, quotes and data from your sources, narrated by your AI host.

Google

656,241 görüntüleme • 10 ay önce

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.
0:24

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.

AK

38,416 görüntüleme • 1 yıl önce

Generative Novel View Synthesis with 3D-Aware Diffusion Models abs: project page:
0:24

Generative Novel View Synthesis with 3D-Aware Diffusion Models abs: project page:

AK

304,708 görüntüleme • 3 yıl önce

Today, we’re launching our newest gen AI experiment in @labsdotgoogle: Whisk. Instead of generating images with long, detailed text prompts, Whisk lets you prompt with images. Simply drag in images, and start creating.
0:28

Today, we’re launching our newest gen AI experiment in @labsdotgoogle: Whisk. Instead of generating images with long, detailed text prompts, Whisk lets you prompt with images. Simply drag in images, and start creating.

Google

259,790 görüntüleme • 1 yıl önce

PAIR-Diffusion: Object-Level Image Editing with Structure-and-Appearance Paired Diffusion Models Gradio demo is out on Hugging Face Spaces demo:
1:05

PAIR-Diffusion: Object-Level Image Editing with Structure-and-Appearance Paired Diffusion Models Gradio demo is out on Hugging Face Spaces demo:

AK

87,679 görüntüleme • 3 yıl önce

Nvidia presents ConsiStory Training-Free Consistent Text-to-Image Generation paper page: enable Stable Diffusion XL (SDXL) to generate consistent subjects across a series of images, without additional training.
1:01

Nvidia presents ConsiStory Training-Free Consistent Text-to-Image Generation paper page: enable Stable Diffusion XL (SDXL) to generate consistent subjects across a series of images, without additional training.

AK

161,673 görüntüleme • 2 yıl önce

🤯 Gemini 3.1 Pro Google DeepMind generates parametric 3D models straight from images! 🚀Paired with Rodin Gen-2 Edit's Refine, #Gemini effortlessly delivers million-face detailed #3D models. 🔥3D Generation workflows are evolving! See it in action 👇 #CG #Hyper3D
0:39

🤯 Gemini 3.1 Pro Google DeepMind generates parametric 3D models straight from images! 🚀Paired with Rodin Gen-2 Edit's Refine, #Gemini effortlessly delivers million-face detailed #3D models. 🔥3D Generation workflows are evolving! See it in action 👇 #CG #Hyper3D

Hyper3D by Deemos

77,496 görüntüleme • 3 ay önce