Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Say goodbye to green screens! DiffusionMat is an AI framework that uses a diffusion model to create refined alpha mattes by correcting the output at every denoising step to look more like the original input image.

Dreaming Tulpa 🥓👑

54,815 subscribers

146,570 görüntüleme • 2 yıl önce •via X (Twitter)

Sanat Bilim & Teknoloji Eğitim

Anya Rossi• Live Now

Private livecam show

10 Yorum

Dreaming Tulpa 🥓👑 profil fotoğrafı

Dreaming Tulpa 🥓👑2 yıl önce

If you like Tweets like this, you might enjoy my weekly newsletter, #aiartweekly. A free, once–weekly e-mail round-up of the latest AI art news, interviews with artists and useful tools & resources. Join 2800+ subscribers here:

Thomas H. Chapin IV profil fotoğrafı

Thomas H. Chapin IV2 yıl önce

Where’s the code though? All I’m seeing is a 404 page on the GitHub link?

Dreaming Tulpa 🥓👑 profil fotoğrafı

Dreaming Tulpa 🥓👑2 yıl önce

Works for me. They haven’t released the code yet though.

Sambhav Gupta profil fotoğrafı

Sambhav Gupta2 yıl önce

Gold for Video Editors i guess

(Alex) Compositing Academy profil fotoğrafı

(Alex) Compositing Academy2 yıl önce

The examples show people’s hair over white backgrounds, and near stationary backgrounds. I don’t believe this at all until I see some more impressive demos.

A.I.Warper profil fotoğrafı

A.I.Warper2 yıl önce

Installed everything then quickly realized..... there are no examples of how to even use the damn thing! What are the CLI inputs to get it working? lol

Dreaming Tulpa 🥓👑 profil fotoğrafı

Dreaming Tulpa 🥓👑2 yıl önce

Check under inference in the repo

Uncanny Harry AI profil fotoğrafı

Uncanny Harry AI2 yıl önce

The white paper stuff dropping this week has been insane! Thanks for sharing it with us mate 👍

Dreaming Tulpa 🥓👑 profil fotoğrafı

Dreaming Tulpa 🥓👑2 yıl önce

Yeah, this week has been crazy

skidmarxist profil fotoğrafı

skidmarxist2 yıl önce

goodbye

Benzer Videolar

When creating ingredient images, try to create stylistically consistent images. If you use input images that are too disparate, the output may lead to a cut scene. For example, when generating a reference image, try using a prompt like: “Create the next scene in this storyboard, now show a roadside diner with the same look and feel as the original image.”

When creating ingredient images, try to create stylistically consistent images. If you use input images that are too disparate, the output may lead to a cut scene. For example, when generating a reference image, try using a prompt like: “Create the next scene in this storyboard, now show a roadside diner with the same look and feel as the original image.”

Google AI

23,526 görüntüleme • 8 ay önce

3DTopia-XL High-Quality 3D PBR Asset Generation via Primitive Diffusion demo: model: 3DTopia-XL scales high-quality 3D asset generation using Diffusion Transformer (DiT) built upon an expressive and efficient 3D representation, PrimX. The denoising process takes 5 seconds to generate a 3D PBR asset from text/image input which is ready for the graphics pipeline to use.

3DTopia-XL High-Quality 3D PBR Asset Generation via Primitive Diffusion demo: model: 3DTopia-XL scales high-quality 3D asset generation using Diffusion Transformer (DiT) built upon an expressive and efficient 3D representation, PrimX. The denoising process takes 5 seconds to generate a 3D PBR asset from text/image input which is ready for the graphics pipeline to use.

AK

87,086 görüntüleme • 1 yıl önce

In Prompt Engineering for Vision Models, taught by Abby Jacques Verre and Caleb Kaiser of Comet , you’ll learn how to prompt and fine-tune vision models for personalized image generation, image editing, object detection and segmentation. The prompts you'll use for vision models could be text, point coordinates, or bounding boxes, depending on the model. You'll also learn to tune hyperparameters to shape the output. Models you'll use include Segment-Anything Model (SAM), OWL-ViT, and Stable Diffusion. You'll also learn to fine-tune Stable Diffusion to generate personalized images (say, an image of a specific person), using a handful of images for training. As an example of a multi-step workflow, you'll use OWL-ViT to detect an object based on a text prompt, then pass the bounding box to SAM to create a segmentation mask, and input that mask into Stable Diffusion to replace the original object with a new one based on a text prompt. Controlling vision models can be tricky; this course will teach prompting and fine-tuning techniques to get precise control over their output. Get started here:

In Prompt Engineering for Vision Models, taught by Abby Jacques Verre and Caleb Kaiser of Comet , you’ll learn how to prompt and fine-tune vision models for personalized image generation, image editing, object detection and segmentation. The prompts you'll use for vision models could be text, point coordinates, or bounding boxes, depending on the model. You'll also learn to tune hyperparameters to shape the output. Models you'll use include Segment-Anything Model (SAM), OWL-ViT, and Stable Diffusion. You'll also learn to fine-tune Stable Diffusion to generate personalized images (say, an image of a specific person), using a handful of images for training. As an example of a multi-step workflow, you'll use OWL-ViT to detect an object based on a text prompt, then pass the bounding box to SAM to create a segmentation mask, and input that mask into Stable Diffusion to replace the original object with a new one based on a text prompt. Controlling vision models can be tricky; this course will teach prompting and fine-tuning techniques to get precise control over their output. Get started here:

Andrew Ng

151,198 görüntüleme • 2 yıl önce

TurboEdit Instant text-based image editing discuss: We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input image and the reconstructed image from the previous step, allowing for correction of the next reconstruction towards the input image. We demonstrate that disentangled controls can be easily achieved in the few-step diffusion model by conditioning on an (automatically generated) detailed text prompt. To manipulate the inverted image, we freeze the noise maps and modify one attribute in the text prompt (either manually or via instruction based editing driven by an LLM), resulting in the generation of a new image similar to the input image with only one attribute changed. It can further control the editing strength and accept instructive text prompt. Our approach facilitates realistic text-guided image edits in real-time, requiring only 8 number of functional evaluations (NFEs) in inversion (one-time cost) and 4 NFEs per edit. Our method is not only fast, but also significantly outperforms state-of-the-art multi-step diffusion editing techniques.

TurboEdit Instant text-based image editing discuss: We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input image and the reconstructed image from the previous step, allowing for correction of the next reconstruction towards the input image. We demonstrate that disentangled controls can be easily achieved in the few-step diffusion model by conditioning on an (automatically generated) detailed text prompt. To manipulate the inverted image, we freeze the noise maps and modify one attribute in the text prompt (either manually or via instruction based editing driven by an LLM), resulting in the generation of a new image similar to the input image with only one attribute changed. It can further control the editing strength and accept instructive text prompt. Our approach facilitates realistic text-guided image edits in real-time, requiring only 8 number of functional evaluations (NFEs) in inversion (one-time cost) and 4 NFEs per edit. Our method is not only fast, but also significantly outperforms state-of-the-art multi-step diffusion editing techniques.

AK

16,062 görüntüleme • 1 yıl önce

How can we help *any* image-input policy generalize better? 👉 Meet PEEK 🤖 — a framework that uses VLMs to decide *where* to look and *what* to do, so downstream policies — from ACT, 3D-DA, or even π₀ — generalize more effectively! 🧵

How can we help any image-input policy generalize better? 👉 Meet PEEK 🤖 — a framework that uses VLMs to decide where to look and what to do, so downstream policies — from ACT, 3D-DA, or even π₀ — generalize more effectively! 🧵

Jesse Zhang

13,700 görüntüleme • 9 ay önce

OpenAI President Greg Brockman on coming bi-directional voice models: "The obvious thing that you want to accomplish is a model in AI that works much more like you and I do... that's able to process input at the same time it's processing output.. It's going to be very, very exciting as you move to these natural, very human fluid-like conversational interfaces." At Big Technology AI Summit

OpenAI President Greg Brockman on coming bi-directional voice models: "The obvious thing that you want to accomplish is a model in AI that works much more like you and I do... that's able to process input at the same time it's processing output.. It's going to be very, very exciting as you move to these natural, very human fluid-like conversational interfaces." At Big Technology AI Summit

Alex Kantrowitz

21,424 görüntüleme • 16 gün önce

🤯DiffIR2VR-Zero: Zero-shot video restoration to high-resolution using pre-trained image restoration diffusion models. - Framework can handle video denoising and up to 8x super-resolution - outperforms trained models in generalizing across diverse datasets and extreme degradations - Compatible with every 2D restoration model

🤯DiffIR2VR-Zero: Zero-shot video restoration to high-resolution using pre-trained image restoration diffusion models. - Framework can handle video denoising and up to 8x super-resolution - outperforms trained models in generalizing across diverse datasets and extreme degradations - Compatible with every 2D restoration model

Gradio

20,342 görüntüleme • 2 yıl önce

🖼️🎞️🔊📄Excited to introduce Composable Diffusion (CoDi), a new generative-AI foundation model that can take any combo of input modalities & generate any combo of output modalities (text, audio, image, video)! Ziyi Yang Chenguang Zhu Mohit Bansal 🧵👇 #CoDi

🖼️🎞️🔊📄Excited to introduce Composable Diffusion (CoDi), a new generative-AI foundation model that can take any combo of input modalities & generate any combo of output modalities (text, audio, image, video)! Ziyi Yang Chenguang Zhu Mohit Bansal 🧵👇 #CoDi

Zineng Tang

105,269 görüntüleme • 3 yıl önce

Imagine a world where every image has a ZK verified checkmark, proving that the image came from an authentic camera, not generated by an AI model. threadguy wants to know, "Who's building this? I want to invest."

Imagine a world where every image has a ZK verified checkmark, proving that the image came from an authentic camera, not generated by an AI model. threadguy wants to know, "Who's building this? I want to invest."

Succinct

19,382 görüntüleme • 10 ay önce

Did you know you can create captivating motion sync videos on Yapper Follow the steps below and push your creativity boundaries Step 1: Go to on your browser step 2: Click on videos and select Motion Sync Step 3: Select Base Video The video's movement will be used to animate the reference image. Step 4: Add Reference Image Upload an image of a character to be animated by the base video. Step 5: Describe Your Vision Write a prompt that guides the background of the output video. Step 6: Generate Select your model and the output video will be generated in real-time

Did you know you can create captivating motion sync videos on Yapper Follow the steps below and push your creativity boundaries Step 1: Go to on your browser step 2: Click on videos and select Motion Sync Step 3: Select Base Video The video's movement will be used to animate the reference image. Step 4: Add Reference Image Upload an image of a character to be animated by the base video. Step 5: Describe Your Vision Write a prompt that guides the background of the output video. Step 6: Generate Select your model and the output video will be generated in real-time

Kuria | AI

46,344 görüntüleme • 2 ay önce

What you’re seeing Is the truffle learning To express itself Through light Every input (user keystroke, prompt, query) Produces embeddings That are live-diffused To the LED’s The truffle runs a diffusion model In parallel To express itself to the world

What you’re seeing Is the truffle learning To express itself Through light Every input (user keystroke, prompt, query) Produces embeddings That are live-diffused To the LED’s The truffle runs a diffusion model In parallel To express itself to the world

simp 4 satoshi

19,542 görüntüleme • 8 ay önce

From LA to New York, the model continuously impresses me. This time utilizing an Image To World, the consistency in aesthetics from the input image is remarkable.

From LA to New York, the model continuously impresses me. This time utilizing an Image To World, the consistency in aesthetics from the input image is remarkable.

Theoretically Media

34,467 görüntüleme • 5 ay önce

Google researchers just developed GameNGen, an AI that can simulate DOOM at over 20 fps It works by predicting each frame in real time with a diffusion model At scale this could mean AI will be able to create games on the fly, personalized to each player

Google researchers just developed GameNGen, an AI that can simulate DOOM at over 20 fps It works by predicting each frame in real time with a diffusion model At scale this could mean AI will be able to create games on the fly, personalized to each player

Rowan Cheung

880,346 görüntüleme • 1 yıl önce

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.

AK

38,416 görüntüleme • 1 yıl önce

Stable Diffusion 3.5 from Stability AI is now LIVE on Civitai! Stable Diffusion 3.5 Large is a Multimodal Diffusion Transformer text-to-image model that features improved performance in image quality, typography, complex prompt understanding, and resource-efficiency. Generate with SD 3.5 Live on Civitai here👇🏽 All images used to create this video were generated with SD 3.5 by our community 🫶🏽

Stable Diffusion 3.5 from Stability AI is now LIVE on Civitai! Stable Diffusion 3.5 Large is a Multimodal Diffusion Transformer text-to-image model that features improved performance in image quality, typography, complex prompt understanding, and resource-efficiency. Generate with SD 3.5 Live on Civitai here👇🏽 All images used to create this video were generated with SD 3.5 by our community 🫶🏽

Civitai

31,353 görüntüleme • 1 yıl önce

Through the length of SDXL-Turbo you can see the image forming in the activations like an object taking shape in the afternoon clouds. Like David emerging from a block of granite. At two-thirds through the model you can see the image clearly. It's spatially crisp, refined. Then in the last third of the model something strange but predictable happens: the model translates this well-formed image back into noise. By the output of the U-net, the activations are again completely uninterpretable. Why does this happen? Because we're asking the model to predict the noise rather than the clean image. This is awkward. Like Michelangelo visualizing the chips of granite surrounding the David rather than the David itself. Like asking a friend to look at a cloud and imagine not a shape, but the extra bits of cloud that when removed will leave a shape remaining.

Through the length of SDXL-Turbo you can see the image forming in the activations like an object taking shape in the afternoon clouds. Like David emerging from a block of granite. At two-thirds through the model you can see the image clearly. It's spatially crisp, refined. Then in the last third of the model something strange but predictable happens: the model translates this well-formed image back into noise. By the output of the U-net, the activations are again completely uninterpretable. Why does this happen? Because we're asking the model to predict the noise rather than the clean image. This is awkward. Like Michelangelo visualizing the chips of granite surrounding the David rather than the David itself. Like asking a friend to look at a cloud and imagine not a shape, but the extra bits of cloud that when removed will leave a shape remaining.

Rudy Gilman

11,641 görüntüleme • 1 yıl önce

This may look like a game of Counterstrike running slowly, but it actually extraordinary. The entire game is created, frame-by-frame, on my *home computer* by an AI diffusion model in response to my actions. There is no game engine, just a "world model" trained on Counterstrike

This may look like a game of Counterstrike running slowly, but it actually extraordinary. The entire game is created, frame-by-frame, on my home computer by an AI diffusion model in response to my actions. There is no game engine, just a "world model" trained on Counterstrike

Ethan Mollick

376,399 görüntüleme • 1 yıl önce

Excited to share Muse Spark! It's a strong natively multimodal model with many surprising properties that emerged. Here, the model is able to use Python tools to make a playable Sudoku game on the web from an image input of the board. ✨

Excited to share Muse Spark! It's a strong natively multimodal model with many surprising properties that emerged. Here, the model is able to use Python tools to make a playable Sudoku game on the web from an image input of the board. ✨

Matt Deitke

29,332 görüntüleme • 3 ay önce

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →

Common Sense Machines

411,381 görüntüleme • 2 yıl önce