Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Leffa from Meta is a 🆕 unified framework for controllable person image generation that enables precise manipulation of both appearance (i.e., Virtual try-on) and pose (i.e., Pose transfer). Learn more about 📚 Code,🔥 Demo, and 🤗 Model ⬇️

Gradio's profile picture

Gradio

56,274 subscribers

52,913 görüntüleme • 1 yıl önce •via X (Twitter)

SanatEğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

🆕 🔥 AniDoc: Animation Creation Made Easier It can colorize a sequence of sketches based on a character design reference with high fidelity, even when the sketches significantly differ in pose and scale. Explore more ⬇️
0:15

🆕 🔥 AniDoc: Animation Creation Made Easier It can colorize a sequence of sketches based on a character design reference with high fidelity, even when the sketches significantly differ in pose and scale. Explore more ⬇️

Gradio

37,989 görüntüleme • 1 yıl önce

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.
0:12

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,801 görüntüleme • 1 yıl önce

Show-o One Single Transformer to Unify Multimodal Understanding and Generation discuss: We present a unified transformer, i.e., Show-o, that unifies multimodal understanding and generation. Unlike fully autoregressive models, Show-o unifies autoregressive and (discrete) diffusion modeling to adaptively handle inputs and outputs of various and mixed modalities. The unified model flexibly supports a wide range of vision-language tasks including visual question-answering, text-to-image generation, text-guided inpainting/extrapolation, and mixed-modality generation. Across various benchmarks, it demonstrates comparable or superior performance to existing individual models with an equivalent or larger number of parameters tailored for understanding or generation. This significantly highlights its potential as a next-generation foundation model.
0:13

Show-o One Single Transformer to Unify Multimodal Understanding and Generation discuss: We present a unified transformer, i.e., Show-o, that unifies multimodal understanding and generation. Unlike fully autoregressive models, Show-o unifies autoregressive and (discrete) diffusion modeling to adaptively handle inputs and outputs of various and mixed modalities. The unified model flexibly supports a wide range of vision-language tasks including visual question-answering, text-to-image generation, text-guided inpainting/extrapolation, and mixed-modality generation. Across various benchmarks, it demonstrates comparable or superior performance to existing individual models with an equivalent or larger number of parameters tailored for understanding or generation. This significantly highlights its potential as a next-generation foundation model.

AK

124,042 görüntüleme • 1 yıl önce

GPT Image 2.0 is now available on Akool 🚀 This isn’t just an upgrade—it’s a major leap in AI image generation. With GPT Image 2.0, you get: • Sharper, high-resolution outputs with improved detail and realism • Much stronger text rendering (finally, text in images that actually looks right) • Better prompt understanding for more accurate and controllable results • Improved consistency across variations and multi-image generations • More precise editing & refinement for iterative creative workflows Whether you're creating marketing visuals, product images, or storytelling assets, GPT Image 2.0 delivers cleaner, more reliable, and production-ready results. Now live on Akool, try the latest in AI image generation today.
0:10

GPT Image 2.0 is now available on Akool 🚀 This isn’t just an upgrade—it’s a major leap in AI image generation. With GPT Image 2.0, you get: • Sharper, high-resolution outputs with improved detail and realism • Much stronger text rendering (finally, text in images that actually looks right) • Better prompt understanding for more accurate and controllable results • Improved consistency across variations and multi-image generations • More precise editing & refinement for iterative creative workflows Whether you're creating marketing visuals, product images, or storytelling assets, GPT Image 2.0 delivers cleaner, more reliable, and production-ready results. Now live on Akool, try the latest in AI image generation today.

Akool Inc

1,541,129 görüntüleme • 1 ay önce

A lot of people mistake the frog pose to dog pose Watch and learn
0:14

A lot of people mistake the frog pose to dog pose Watch and learn

BERNARDO 🏴‍☠️

39,094 görüntüleme • 5 ay önce

How can we address the scarcity of data required for specialized AI? Learn about Simula, a framework that reframes synthetic data generation as dataset-level mechanism design. By using reasoning to architect datasets from first principles, Simula enables fine-grained control over coverage, complexity, and quality. More →
0:18

How can we address the scarcity of data required for specialized AI? Learn about Simula, a framework that reframes synthetic data generation as dataset-level mechanism design. By using reasoning to architect datasets from first principles, Simula enables fine-grained control over coverage, complexity, and quality. More →

Google Research

142,219 görüntüleme • 2 ay önce

Try new poses and angles! 3D drawing figures are ideal for when you have a pose in mind but can't find that perfect reference image. Learn how to apply poses and other fun additions like BVH files to your 3D model in this tutorial: #clipstudio
0:16

Try new poses and angles! 3D drawing figures are ideal for when you have a pose in mind but can't find that perfect reference image. Learn how to apply poses and other fun additions like BVH files to your 3D model in this tutorial: #clipstudio

CLIP STUDIO PAINT

165,643 görüntüleme • 1 yıl önce

As announced in partnership with NVIDIA at CES, we’re excited to introduce Stable Point Aware 3D (SPAR3D), setting a new standard in 3D generation. Ideal for running on NVIDIA RTX AI PCs, SPAR3D enables real-time editing and complete structure generation of 3D objects from a single image in under a second. You can download the weights on Hugging Face and code on GitHub, or access the model through the Stability AI API. Learn more here: (1/3)
0:13

As announced in partnership with NVIDIA at CES, we’re excited to introduce Stable Point Aware 3D (SPAR3D), setting a new standard in 3D generation. Ideal for running on NVIDIA RTX AI PCs, SPAR3D enables real-time editing and complete structure generation of 3D objects from a single image in under a second. You can download the weights on Hugging Face and code on GitHub, or access the model through the Stability AI API. Learn more here: (1/3)

Stability AI

181,402 görüntüleme • 1 yıl önce

If you don’t know about Dog pose or Frog pose then watch this and learn
0:14

If you don’t know about Dog pose or Frog pose then watch this and learn

Alone🐯

16,688 görüntüleme • 12 gün önce

The next generation of #PhotoshopAI is here. Learn more about the latest features and capabilities in Photoshop (beta) and Photoshop, powered by #AdobeFirefly Image 3 Model. Questions? Let's dive in. 💙
0:10

The next generation of #PhotoshopAI is here. Learn more about the latest features and capabilities in Photoshop (beta) and Photoshop, powered by #AdobeFirefly Image 3 Model. Questions? Let's dive in. 💙

Adobe Photoshop

25,448 görüntüleme • 2 yıl önce

BEN2: Background Erase Network Remove background from images as well as videos cleanly!🔥 Learn more about the model 👇
0:13

BEN2: Background Erase Network Remove background from images as well as videos cleanly!🔥 Learn more about the model 👇

Gradio

27,214 görüntüleme • 1 yıl önce

Wrote a new version of my mesh decal system, this one runs completely on the GPU (i.e. all geometry generation, rendering and pooling).
0:19

Wrote a new version of my mesh decal system, this one runs completely on the GPU (i.e. all geometry generation, rendering and pooling).

Mr F

52,450 görüntüleme • 2 yıl önce

Switti -- a new scale-wise transformer for text-to-image generation 🦾 🔥 Improved generation of fine-grained details. Outperforms existing T2I AR models and competes with state-of-the-art T2I diffusion models while being up to 7x faster.
0:16

Switti -- a new scale-wise transformer for text-to-image generation 🦾 🔥 Improved generation of fine-grained details. Outperforms existing T2I AR models and competes with state-of-the-art T2I diffusion models while being up to 7x faster.

Gradio

29,267 görüntüleme • 1 yıl önce

Native image generation with Gemini is live 🚀🔥 You can generate interleaved text and images and edit uploaded images all in a unified model. Big congrats to Robert Riachi Kaushik Shivakumar Fabian Mentzer and many more amazing folks who built this! Try it out and tell us what you think:
0:15

Native image generation with Gemini is live 🚀🔥 You can generate interleaved text and images and edit uploaded images all in a unified model. Big congrats to Robert Riachi Kaushik Shivakumar Fabian Mentzer and many more amazing folks who built this! Try it out and tell us what you think:

Tim Brooks

14,128 görüntüleme • 1 yıl önce

DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion TL;DR: Create 3/4DGS from Video Diffusion Note: Some first inference code released (not all yet). Contributions (cited): • We present DimensionX, a novel framework for generating photorealistic 3D and 4D scenes from only a single image using controllable video diffusion. • We propose ST-Director, which decouples the spatial and temporal priors in video diffusion models by learning (spatial and temporal) dimension-aware modules with our curated datasets. We further enhance the hybriddimension control with a training-free composition approach according to the essence of video diffusion denoising process. • To bridge the gap between video diffusion and real-world scenes, we design a trajectory-aware mechanism for 3D generation and an identity-preserving denoising approach for 4D generation, enabling more realistic and controllable scene synthesis. • Extensive experiments manifest that our DimensionX delivers superior performance in video, 3D, and 4D generation compared with baseline methods.
0:18

DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion TL;DR: Create 3/4DGS from Video Diffusion Note: Some first inference code released (not all yet). Contributions (cited): • We present DimensionX, a novel framework for generating photorealistic 3D and 4D scenes from only a single image using controllable video diffusion. • We propose ST-Director, which decouples the spatial and temporal priors in video diffusion models by learning (spatial and temporal) dimension-aware modules with our curated datasets. We further enhance the hybriddimension control with a training-free composition approach according to the essence of video diffusion denoising process. • To bridge the gap between video diffusion and real-world scenes, we design a trajectory-aware mechanism for 3D generation and an identity-preserving denoising approach for 4D generation, enabling more realistic and controllable scene synthesis. • Extensive experiments manifest that our DimensionX delivers superior performance in video, 3D, and 4D generation compared with baseline methods.

MrNeRF

17,028 görüntüleme • 1 yıl önce

We have multi-character pose transfer now 👀 This is a new model implementation called SCAIL from Zhipu AI. Excited to try it out - this example is from a user who ran it locally. (from u/Better-Interview-793)
0:16

We have multi-character pose transfer now 👀 This is a new model implementation called SCAIL from Zhipu AI. Excited to try it out - this example is from a user who ran it locally. (from u/Better-Interview-793)

Justine Moore

50,447 görüntüleme • 6 ay önce

SeamlessExpressive, a new AI translation model by research teams at Meta, enables high-quality speech translation that maintains the speaker's vocal style, tone and unique expressions in translated outputs. Try the demo with your own voice ➡️
0:14

SeamlessExpressive, a new AI translation model by research teams at Meta, enables high-quality speech translation that maintains the speaker's vocal style, tone and unique expressions in translated outputs. Try the demo with your own voice ➡️

AI at Meta

168,999 görüntüleme • 2 yıl önce

Scientists have designed a framework that enables drones to perform sophisticated and aerobatic flight maneuvers autonomously while avoiding obstacles. Learn more in Science Robotics:
0:13

Scientists have designed a framework that enables drones to perform sophisticated and aerobatic flight maneuvers autonomously while avoiding obstacles. Learn more in Science Robotics:

Science Magazine

27,069 görüntüleme • 1 yıl önce

I've been testing with an unreleased WIP LTX 2.3 LoRA by LDWorks and among other things it enables some of the best performance transfer I've seen so far. It has some ghosting issues, but for a one-shot generation with no masking or pose data it's pretty impressive!
0:10

I've been testing with an unreleased WIP LTX 2.3 LoRA by LDWorks and among other things it enables some of the best performance transfer I've seen so far. It has some ghosting issues, but for a one-shot generation with no masking or pose data it's pretty impressive!

Ingi Erlingsson 🪄

32,977 görüntüleme • 1 ay önce