Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Diffusion models clicked for me when I started seeing them through the lens of particle motion. I built this interactive playground where you too can clickety-clack to understand how drift, noise, and other hyperparams control diffusion. I hereby submit this as penance for the sin of YouTube edu-tainment 😇...

juliarturc's profile picture

Julia Turc

20,444 subscribers

32,207 görüntüleme • 6 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

I which Sander Dieleman beautifully illustrates why diffusion models work so well with images 🐳 Our visual world is spatially coherent, and large scale structures dominate. 〜 This means low frequency spectral components in images tend to be stronger. 🌫️ This means when you noise up an image, high frequency detail goes away first, then coarse structure. 😶‍🌫️ This means when you denoise an image, the coarse structure emerges first, then the fine detail. ♻️ This means you can think of diffusion as "spectral autoregression". Coarse / low end to fine / high end.
3:45

I which Sander Dieleman beautifully illustrates why diffusion models work so well with images 🐳 Our visual world is spatially coherent, and large scale structures dominate. 〜 This means low frequency spectral components in images tend to be stronger. 🌫️ This means when you noise up an image, high frequency detail goes away first, then coarse structure. 😶‍🌫️ This means when you denoise an image, the coarse structure emerges first, then the fine detail. ♻️ This means you can think of diffusion as "spectral autoregression". Coarse / low end to fine / high end.

Tero Parviainen

16,429 görüntüleme • 3 ay önce

This tool is so useful... when animating I love seeing more of the characters mesh instead of the cluster of controls. You can hover over a body part and it will highlight the nearest control. Check comment below for link.
0:41

This tool is so useful... when animating I love seeing more of the characters mesh instead of the cluster of controls. You can hover over a body part and it will highlight the nearest control. Check comment below for link.

Stefan Iverson

14,157 görüntüleme • 6 ay önce

Google isn’t betting on a single AI architecture. Sundar Pichai, CEO of Google: “We’re going to push the diffusion paradigm as hard as possible.” “All of today’s mainline Gemini models are autoregressive. Diffusion is a different paradigm.” “For the same capability, diffusion can be much faster.” “It’s behind the mainline models today, but there will be areas where it’s the right tool.” “We’re pushing multiple directions in parallel, and bringing them together where it makes sense.”
1:02

Google isn’t betting on a single AI architecture. Sundar Pichai, CEO of Google: “We’re going to push the diffusion paradigm as hard as possible.” “All of today’s mainline Gemini models are autoregressive. Diffusion is a different paradigm.” “For the same capability, diffusion can be much faster.” “It’s behind the mainline models today, but there will be areas where it’s the right tool.” “We’re pushing multiple directions in parallel, and bringing them together where it makes sense.”

Forward Future

152,933 görüntüleme • 9 ay önce

Why I Started Measuring My Life in Percentages In 2020, I began to see time through the lens of percentages. It was the first time my calendar was turned into real data and I could see how I was creating myself through the four core pillars of my existence: life, work, sleep and health. That clarity showed me what balance looked like for me, but only at a high level. When we built Existence, we wanted to take this further so you could see your percentages by day, by week, and by month, and understand the rhythm of how you are creating your life. Learn more about Existence here:
1:36

Why I Started Measuring My Life in Percentages In 2020, I began to see time through the lens of percentages. It was the first time my calendar was turned into real data and I could see how I was creating myself through the four core pillars of my existence: life, work, sleep and health. That clarity showed me what balance looked like for me, but only at a high level. When we built Existence, we wanted to take this further so you could see your percentages by day, by week, and by month, and understand the rhythm of how you are creating your life. Learn more about Existence here:

Rob Dyrdek

21,104 görüntüleme • 9 ay önce

Diffusion is the foundational ML framework behind state-of-the-art AI image and video generation, including Sora, Midjourney and Google Veo. In this episode of Decoded, Ankit Gupta sits down with Francois Chaubard to discuss how diffusion works, walk through a code sample, and explain why everyone training models should understand it. 00:00 Intro 00:33 What is diffusion? 02:50 What are applications of diffusion today? 04:06 Key innovations 07:01 Code examples 19:25 The "squint test" 22:27 Other areas diffusion is widely accessible 24:49 Outro
27:10

Diffusion is the foundational ML framework behind state-of-the-art AI image and video generation, including Sora, Midjourney and Google Veo. In this episode of Decoded, Ankit Gupta sits down with Francois Chaubard to discuss how diffusion works, walk through a code sample, and explain why everyone training models should understand it. 00:00 Intro 00:33 What is diffusion? 02:50 What are applications of diffusion today? 04:06 Key innovations 07:01 Code examples 19:25 The "squint test" 22:27 Other areas diffusion is widely accessible 24:49 Outro

Y Combinator

74,604 görüntüleme • 8 ay önce

"I was thrilled with the opportunity to create visuals for ‘Panopticom’ and at the possibility of creating a music video for Peter Gabriel. I created this video in 1 week with the use of Stable Diffusion Deforum via the open-source WebUI, Automatic1111, after months of deep-dive learning and creating 2D and 3D motion parameters within the tool." - @_vnderworld Vnderworld's official video for Peter's 'Panopticom' will be out tomorrow! Stable Diffusion
0:35

"I was thrilled with the opportunity to create visuals for ‘Panopticom’ and at the possibility of creating a music video for Peter Gabriel. I created this video in 1 week with the use of Stable Diffusion Deforum via the open-source WebUI, Automatic1111, after months of deep-dive learning and creating 2D and 3D motion parameters within the tool." - @_vnderworld Vnderworld's official video for Peter's 'Panopticom' will be out tomorrow! Stable Diffusion

Peter Gabriel

115,128 görüntüleme • 3 yıl önce

"Broad diffusion is really important. I want Fable – and better models – in the hands of all sorts of people. That's how you keep the balance. Odds of really bad outcomes like nationalization go up if diffusion is not as broad." Dean W. Ball, on the eve of joining @openai
2:06

"Broad diffusion is really important. I want Fable – and better models – in the hands of all sorts of people. That's how you keep the balance. Odds of really bad outcomes like nationalization go up if diffusion is not as broad." Dean W. Ball, on the eve of joining @openai

Nathan Labenz

30,661 görüntüleme • 3 ay önce

Introducing Character Motion Control for Video Diffusion Models Creators currently lack control over how characters move and act in the videos they generate with AI. Today, we’re changing that. With Character Motion Control, you can act it out and bring your exact vision to life. How it works: 1️⃣ Describe the scene with a prompt 2️⃣ Upload an acting video to guide character movement 🎥 Generate a video where character motion is driven by the acting video. Register for Early Access via the link in the comments.
0:57

Introducing Character Motion Control for Video Diffusion Models Creators currently lack control over how characters move and act in the videos they generate with AI. Today, we’re changing that. With Character Motion Control, you can act it out and bring your exact vision to life. How it works: 1️⃣ Describe the scene with a prompt 2️⃣ Upload an acting video to guide character movement 🎥 Generate a video where character motion is driven by the acting video. Register for Early Access via the link in the comments.

Kinetix

97,996 görüntüleme • 1 yıl önce

PM Fico: For me, propaganda is the same in the West and in the East. When I have the opportunity, when I'm somewhere abroad where you can watch Russian broadcasts, of course I watch them, because I understand Russian. It's the same propaganda, but the opposite of what I see in Europe, what I see on European TVs. Let it be. But this is really not my cup of tea.
1:47

PM Fico: For me, propaganda is the same in the West and in the East. When I have the opportunity, when I'm somewhere abroad where you can watch Russian broadcasts, of course I watch them, because I understand Russian. It's the same propaganda, but the opposite of what I see in Europe, what I see on European TVs. Let it be. But this is really not my cup of tea.

Anton Gerashchenko

62,457 görüntüleme • 9 ay önce

Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Models paper page: Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious manual process, which can be automated by emerging text-to-video diffusion models. Despite great promise, video diffusion models are difficult to control, hindering a user to apply their own creativity rather than amplifying it. To address this challenge, we present a novel approach that combines the controllability of dynamic 3D meshes with the expressivity and editability of emerging diffusion models. For this purpose, our approach takes an animated, low-fidelity rendered mesh as input and injects the ground truth correspondence information obtained from the dynamic mesh into various stages of a pre-trained text-to-image generation model to output high-quality and temporally consistent frames. We demonstrate our approach on various examples where motion can be obtained by animating rigged assets or changing the camera path.
0:23

Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Models paper page: Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious manual process, which can be automated by emerging text-to-video diffusion models. Despite great promise, video diffusion models are difficult to control, hindering a user to apply their own creativity rather than amplifying it. To address this challenge, we present a novel approach that combines the controllability of dynamic 3D meshes with the expressivity and editability of emerging diffusion models. For this purpose, our approach takes an animated, low-fidelity rendered mesh as input and injects the ground truth correspondence information obtained from the dynamic mesh into various stages of a pre-trained text-to-image generation model to output high-quality and temporally consistent frames. We demonstrate our approach on various examples where motion can be obtained by animating rigged assets or changing the camera path.

AK

117,068 görüntüleme • 2 yıl önce

Started seeing this IISC professors viral video where he starts by saying “did you see MIT study of agents where they started to cheat” and then says that is AGI. I cannot ,for the life of me, believe that a professor in class says this and it is viral and then I understand why Dhruv Rathee is Indias biggest AI expert.
0:27

Started seeing this IISC professors viral video where he starts by saying “did you see MIT study of agents where they started to cheat” and then says that is AGI. I cannot ,for the life of me, believe that a professor in class says this and it is viral and then I understand why Dhruv Rathee is Indias biggest AI expert.

Arnab Ray

701,474 görüntüleme • 12 gün önce

this could be one of the funniest moments in all of toku for me, i can't even tell you how much this got me when i first saw it
0:24

this could be one of the funniest moments in all of toku for me, i can't even tell you how much this got me when i first saw it

sara (サラ) 🖤

70,712 görüntüleme • 1 yıl önce

here’s the very beginning of Leon Simmons. During a time when I wanted to quit acting. When my mom forced me to audition because she said this was for me. I can literally feel the energy of where I was in life as I watch this video. What a journey. I could say a lot but thank you
2:14

here’s the very beginning of Leon Simmons. During a time when I wanted to quit acting. When my mom forced me to audition because she said this was for me. I can literally feel the energy of where I was in life as I watch this video. What a journey. I could say a lot but thank you

Isaiah John

200,819 görüntüleme • 2 yıl önce

I will never forget the feeling of watching this show for the first time and seeing Zeynep Leto for the first time I am sorry you were in the hands of bad writers
0:46

I will never forget the feeling of watching this show for the first time and seeing Zeynep Leto for the first time I am sorry you were in the hands of bad writers

Nina 🦢

24,051 görüntüleme • 7 ay önce

Out of curiosity, I went to the cinema to see the movie and understand why CAN was making noise 😂😂 Am I missing something? I need you guys to see this in cinema and tell me what's wrong😂
2:14

Out of curiosity, I went to the cinema to see the movie and understand why CAN was making noise 😂😂 Am I missing something? I need you guys to see this in cinema and tell me what's wrong😂

Iyke

348,845 görüntüleme • 9 ay önce

#WATCH | Udhampur, J&K | Army veteran Mohammad Aslam Bhat says, "First, I started working in agriculture, growing vegetables... I got good benefits from that too... I used to have kiwis when in service, but back then, I didn't know where they grew... I found out that it mostly grows in Himachal Pradesh. When I went there and got all the details, I took as much guidance as I could... It is really expensive to import, I thought; why don't we try growing it ourselves here too? That way, we can provide it to our people at a lower price. First of all, you need funds for this because there is a lot of investment upfront. So, I reached out to the department, and they helped me with it... I got a subsidy for the plants, and then I got a subsidy for digging the pits. Angle irons and other ironwork are used in this, and I got a subsidy for that too. Drip irrigation was installed, and the department gave me assistance with that as well. After that, for harvesting and storing water, they gave me a tank. So, the Centre is also putting a lot of emphasis on this, with the Prime Minister's focus being that the farmer should get double the benefit..."
5:16

#WATCH | Udhampur, J&K | Army veteran Mohammad Aslam Bhat says, "First, I started working in agriculture, growing vegetables... I got good benefits from that too... I used to have kiwis when in service, but back then, I didn't know where they grew... I found out that it mostly grows in Himachal Pradesh. When I went there and got all the details, I took as much guidance as I could... It is really expensive to import, I thought; why don't we try growing it ourselves here too? That way, we can provide it to our people at a lower price. First of all, you need funds for this because there is a lot of investment upfront. So, I reached out to the department, and they helped me with it... I got a subsidy for the plants, and then I got a subsidy for digging the pits. Angle irons and other ironwork are used in this, and I got a subsidy for that too. Drip irrigation was installed, and the department gave me assistance with that as well. After that, for harvesting and storing water, they gave me a tank. So, the Centre is also putting a lot of emphasis on this, with the Prime Minister's focus being that the farmer should get double the benefit..."

ANI

23,273 görüntüleme • 3 gün önce

I was watching the “power slap” on tv the other night. Flipping through and I saw this. These are so ridiculous. I don’t understand the point? Just so you can show you can take a slap to the face with no pain! You can just go to a bar and make a rude comment and get this for free with no entry fee.
1:29

I was watching the “power slap” on tv the other night. Flipping through and I saw this. These are so ridiculous. I don’t understand the point? Just so you can show you can take a slap to the face with no pain! You can just go to a bar and make a rude comment and get this for free with no entry fee.

SteelerNation

2,012,470 görüntüleme • 2 ay önce