Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

by the way, Atlas does text-to-image too... and it's got style

Ben Mildenhall

11,592 subscribers

19,432 Aufrufe • vor 7 Tagen •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Introducing StyleDrop, a model that allows a significantly higher level of stylized text-to-image synthesis by using a few style reference images that describe the style for text-to-image generation, bypassing the burden of text prompt engineering. More→

Introducing StyleDrop, a model that allows a significantly higher level of stylized text-to-image synthesis by using a few style reference images that describe the style for text-to-image generation, bypassing the burden of text prompt engineering. More→

Google AI

80,379 Aufrufe • vor 2 Jahren

Text to image with midjourney and image to video with gen2 by @commonstyle

Text to image with midjourney and image to video with gen2 by @commonstyle

AK

668,175 Aufrufe • vor 3 Jahren

StyleDrop: Text-to-Image Generation in Any Style introduce StyleDrop, a method that enables the synthesis of images that faithfully follow a specific style using a text-to-image model. The proposed method is extremely versatile and captures nuances and details of a user-provided style, such as color schemes, shading, design patterns, and local and global effects. It efficiently learns a new style by fine-tuning very few trainable parameters (less than 1% of total model parameters) and improving the quality via iterative training with either human or automated feedback. Better yet, StyleDrop is able to deliver impressive results even when the user supplies only a single image that specifies the desired style. An extensive study shows that, for the task of style tuning text-to-image models, StyleDrop implemented on Muse convincingly outperforms other methods, including DreamBooth and textual inversion on Imagen or Stable Diffusion. paper page:

StyleDrop: Text-to-Image Generation in Any Style introduce StyleDrop, a method that enables the synthesis of images that faithfully follow a specific style using a text-to-image model. The proposed method is extremely versatile and captures nuances and details of a user-provided style, such as color schemes, shading, design patterns, and local and global effects. It efficiently learns a new style by fine-tuning very few trainable parameters (less than 1% of total model parameters) and improving the quality via iterative training with either human or automated feedback. Better yet, StyleDrop is able to deliver impressive results even when the user supplies only a single image that specifies the desired style. An extensive study shows that, for the task of style tuning text-to-image models, StyleDrop implemented on Muse convincingly outperforms other methods, including DreamBooth and textual inversion on Imagen or Stable Diffusion. paper page:

AK

56,397 Aufrufe • vor 3 Jahren

Dobsonian Power: BREAKING... New Image Of 3I/ATLAS Look at the latest image of 3I/ATLAS shared by Thiago Dobsonian Power

Dobsonian Power: BREAKING... New Image Of 3I/ATLAS Look at the latest image of 3I/ATLAS shared by Thiago Dobsonian Power

Skywatch Signal

67,188 Aufrufe • vor 10 Monaten

Speedsculpt + AI image gen. What an incredibly powerful combo compared to text to image. Made using Dreams on my PS5, by far the fastest way to sculpt in 3d anywhere. Transformed with Krea ai. Imagine when it's possible to convert this to an actual 3d model, to animate it, and to integrate it into projects. #ThePowerofDreams #kreaai

Speedsculpt + AI image gen. What an incredibly powerful combo compared to text to image. Made using Dreams on my PS5, by far the fastest way to sculpt in 3d anywhere. Transformed with Krea ai. Imagine when it's possible to convert this to an actual 3d model, to animate it, and to integrate it into projects. #ThePowerofDreams #kreaai

Martin Nebelong

56,601 Aufrufe • vor 2 Jahren

MatrixGPT - The state-of-the-art Text to Image AI app 💎An all-in-one #AI solution offering a suite of innovative apps including Text-to-image, Image-to-image, Text-to-speech & Talking face. Let's create art and earn with #MatrixGPT! JOIN US NOW!👉 $MAI

MatrixGPT - The state-of-the-art Text to Image AI app 💎An all-in-one #AI solution offering a suite of innovative apps including Text-to-image, Image-to-image, Text-to-speech & Talking face. Let's create art and earn with #MatrixGPT! JOIN US NOW!👉 $MAI

MatrixGPT

13,534 Aufrufe • vor 3 Jahren

[CLIP] by Hand ✍️ The CLIP (Contrastive Language–Image Pre-training) model, a groundbreaking work by OpenAI, redefines the intersection of computer vision and natural language processing. It is the basis of all the multi-modal foundation models we see today. How does CLIP work? Goal: 🟨 Learn a shared embedding space for text and image [1] Given ↳ A mini batch of 3 text-image pairs ↳ OpenAI used 400 million text-image pairs to train its original CLIP model. Process 1st pair: "big table" [2] 🟪 Text → 2 Vectors (3D) ↳ Look up word embedding vectors using word2vec. [3] 🟩 Image → 2 Vectors (4D) ↳ Divide the image into two patches. ↳ Flatten each patch [4] Process other pairs ↳ Repeat [2]-[3] [5] 🟪 Text Encoder & 🟩 Image Encoder ↳ Encode input vectors into feature vectors ↳ Here, both encoders are simple one layer perceptron (linear + ReLU) ↳ In practice, the encoders are usually transformer models. [6] 🟪 🟩 Mean Pooling: 2 → 1 vector ↳ Average 2 feature vectors into a single vector by averaging across the columns ↳ The goal is to have one vector to represent each image or text [7] 🟪 🟩 -> 🟨 Projection ↳ Note that the text and image feature vectors from the encoders have different dimensions (3D vs. 4D). ↳ Use a linear layer to project image and text vectors to a 2D shared embedding space. 🏋️ Contrastive Pre-training 🏋️ [8] Prepare for MatMul ↳ Copy text vectors (T1,T2,T3) ↳ Copy the transpose of image vectors (I1,I2,I3) ↳ They are all in the 2D shared embedding space. [9] 🟦 MatMul ↳ Multiply T and I matrices. ↳ This is equivalent to taking dot product between every pair of image and text vectors. ↳ The purpose is to use dot product to estimate the similarity between a pair of image-text. [10] 🟦 Softmax: e^x ↳ Raise e to the power of the number in each cell ↳ To simplify hand calculation, we approximate e^□ with 3^□. [11] 🟦 Softmax: ∑ ↳ Sum each row for 🟩 image→🟪 text ↳ Sum each column for 🟪 text→ 🟩 image [12] 🟦 Softmax: 1 / sum ↳ Divide each element by the column sum to obtain a similarity matrix for 🟪 text→🟩 image ↳ Divide each element by the row sum to obtain a similarity matrix for 🟩 image→🟪 text [13] 🟥 Loss Gradients ↳ The "Targets" for the similarity matrices are Identity Matrices. ↳ Why? If I and T come from the same pair (i=j), we want the highest value, which is 1, and 0 otherwise. ↳ Apply the simple equation of [Similarity - Target] to compute gradients of for both directions. ↳ Why so simple? Because when Softmax and Cross-Entropy Loss are used together, the math magically works out that way. ↳ These gradients kick off the backpropagation process to update weights and biases of the encoders and projection layers (red borders).

[CLIP] by Hand ✍️ The CLIP (Contrastive Language–Image Pre-training) model, a groundbreaking work by OpenAI, redefines the intersection of computer vision and natural language processing. It is the basis of all the multi-modal foundation models we see today. How does CLIP work? Goal: 🟨 Learn a shared embedding space for text and image [1] Given ↳ A mini batch of 3 text-image pairs ↳ OpenAI used 400 million text-image pairs to train its original CLIP model. Process 1st pair: "big table" [2] 🟪 Text → 2 Vectors (3D) ↳ Look up word embedding vectors using word2vec. [3] 🟩 Image → 2 Vectors (4D) ↳ Divide the image into two patches. ↳ Flatten each patch [4] Process other pairs ↳ Repeat [2]-[3] [5] 🟪 Text Encoder & 🟩 Image Encoder ↳ Encode input vectors into feature vectors ↳ Here, both encoders are simple one layer perceptron (linear + ReLU) ↳ In practice, the encoders are usually transformer models. [6] 🟪 🟩 Mean Pooling: 2 → 1 vector ↳ Average 2 feature vectors into a single vector by averaging across the columns ↳ The goal is to have one vector to represent each image or text [7] 🟪 🟩 -> 🟨 Projection ↳ Note that the text and image feature vectors from the encoders have different dimensions (3D vs. 4D). ↳ Use a linear layer to project image and text vectors to a 2D shared embedding space. 🏋️ Contrastive Pre-training 🏋️ [8] Prepare for MatMul ↳ Copy text vectors (T1,T2,T3) ↳ Copy the transpose of image vectors (I1,I2,I3) ↳ They are all in the 2D shared embedding space. [9] 🟦 MatMul ↳ Multiply T and I matrices. ↳ This is equivalent to taking dot product between every pair of image and text vectors. ↳ The purpose is to use dot product to estimate the similarity between a pair of image-text. [10] 🟦 Softmax: e^x ↳ Raise e to the power of the number in each cell ↳ To simplify hand calculation, we approximate e^□ with 3^□. [11] 🟦 Softmax: ∑ ↳ Sum each row for 🟩 image→🟪 text ↳ Sum each column for 🟪 text→ 🟩 image [12] 🟦 Softmax: 1 / sum ↳ Divide each element by the column sum to obtain a similarity matrix for 🟪 text→🟩 image ↳ Divide each element by the row sum to obtain a similarity matrix for 🟩 image→🟪 text [13] 🟥 Loss Gradients ↳ The "Targets" for the similarity matrices are Identity Matrices. ↳ Why? If I and T come from the same pair (i=j), we want the highest value, which is 1, and 0 otherwise. ↳ Apply the simple equation of [Similarity - Target] to compute gradients of for both directions. ↳ Why so simple? Because when Softmax and Cross-Entropy Loss are used together, the math magically works out that way. ↳ These gradients kick off the backpropagation process to update weights and biases of the encoders and projection layers (red borders).

Tom Yeh

67,883 Aufrufe • vor 2 Jahren

atlas talks about vtubers and vtuber designs for way too long

atlas talks about vtubers and vtuber designs for way too long

📝 atlas anarchy

52,056 Aufrufe • vor 1 Jahr

Text is often the hardest part of image generation to get right. MAI-Image-2 improves consistency and legibility for in-image text across infographics, diagrams, and slides — reducing the gap between prompt and output. Try it for yourself.

Text is often the hardest part of image generation to get right. MAI-Image-2 improves consistency and legibility for in-image text across infographics, diagrams, and slides — reducing the gap between prompt and output. Try it for yourself.

Microsoft AI

30,849 Aufrufe • vor 5 Monaten

Exactly AI Illustrative Training is now on Runware⚙️ - Train a custom model on your brand's visual style - 10–50 images produces a reusable brand-aligned model - Text-to-image + image-to-image with zero style prompting required - Consistent output across campaigns & products

Runware

578,364 Aufrufe • vor 3 Monaten

Kling O1 is now available in ElevenLabs Image & Video. Multimodal input (text, image or video), precise pace & detail control, consistent style, and strong character fidelity.

Kling O1 is now available in ElevenLabs Image & Video. Multimodal input (text, image or video), precise pace & detail control, consistent style, and strong character fidelity.

ElevenLabs

18,409 Aufrufe • vor 9 Monaten

Run InstantStyle Locally with 1 Click InstantStyle lets you generate images with a style of ANY other image, instantly. No LoRA required. Both text-to-image/image-to-image. I wrote a 1 click launcher for the gradio app from Frank (Haofan) Wang (The author of InstantStyle/InstantId!).

Run InstantStyle Locally with 1 Click InstantStyle lets you generate images with a style of ANY other image, instantly. No LoRA required. Both text-to-image/image-to-image. I wrote a 1 click launcher for the gradio app from Frank (Haofan) Wang (The author of InstantStyle/InstantId!).

cocktail peanut

39,104 Aufrufe • vor 2 Jahren

Brian Atlas gets HARASSED by girls OVERPROTECTIVE KAREN brother?! Is it INAPPROPRIATE to find a public figure's number and text it?!

Sensitive content

Brian Atlas gets HARASSED by girls OVERPROTECTIVE KAREN brother?! Is it INAPPROPRIATE to find a public figure's number and text it?!

whatever

131,427 Aufrufe • vor 1 Jahr

No limits, no boundaries. The infinite datacenter. LLMs, image gen, text-to-speech + more powered by $DIS

No limits, no boundaries. The infinite datacenter. LLMs, image gen, text-to-speech + more powered by $DIS

distribute.ai

98,302 Aufrufe • vor 1 Jahr

We think text-to-image AI is pretty interesting, so here's text-to-BIM! It won’t “create a museum in the style of Zaha Hadid.” (Yet.) But you can describe your building and get an editable 3D model in return. Coming soon from Hypar !

We think text-to-image AI is pretty interesting, so here's text-to-BIM! It won’t “create a museum in the style of Zaha Hadid.” (Yet.) But you can describe your building and get an editable 3D model in return. Coming soon from Hypar !

Hypar

28,752 Aufrufe • vor 3 Jahren

“Time” really does go by way too fast… #BSB30for30

“Time” really does go by way too fast… #BSB30for30

Backstreet Boys

21,155 Aufrufe • vor 2 Jahren