正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

We are also releasing self-contained lecture notes that explain flow matching and diffusion models from scratch. This goes from "zero" to the state-of-the-art in modern Generative AI. 📖 Read the notes here: Joint work with Ezra Erives.

Peter Holderrieth

5,013 subscribers

474,892 次观看 • 3 个月前 •via X (Twitter)

教育新闻政治科学技术

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

This account posting fake community notes in all my posts needs to be banned from X and removed from Community Notes These notes are wrong and I’ve posted proof in the replies to other people already.

This account posting fake community notes in all my posts needs to be banned from X and removed from Community Notes These notes are wrong and I’ve posted proof in the replies to other people already.

Ashton Forbes

25,081 次观看 • 1 年前

Sell art with ZERO fees 🤯 You read that right: ZERO selling fees. When we say we are here to empower artists, we mean it! Keep 100% of the listing price.

Sell art with ZERO fees 🤯 You read that right: ZERO selling fees. When we say we are here to empower artists, we mean it! Keep 100% of the listing price.

Exchange Art

41,810 次观看 • 3 年前

🚨New paper! Generative models are often “miscalibrated”. We calibrate diffusion models, LLMs, and more to meet desired distributional properties. E.g. we finetune protein models to better match the diversity of natural proteins.

🚨New paper! Generative models are often “miscalibrated”. We calibrate diffusion models, LLMs, and more to meet desired distributional properties. E.g. we finetune protein models to better match the diversity of natural proteins.

Brian L Trippe

20,536 次观看 • 8 个月前

New research from BlackForestLabsAI - Unofficial 🥳 Meet Self-Flow: our self-supervised framework for image, audio, video & world models 🤖 Do generative models really need DINO to learn strong representations? We propose teaching them directly via a joint framework instead 🧵

New research from BlackForestLabsAI - Unofficial 🥳 Meet Self-Flow: our self-supervised framework for image, audio, video & world models 🤖 Do generative models really need DINO to learn strong representations? We propose teaching them directly via a joint framework instead 🧵

Hila Chefer

67,648 次观看 • 4 个月前

Harness the power of generative AI without just prompting and hoping for the best. From Unbound Slop to Tripo to Unreal Engine, we love this workflow for generating 3D models.

Harness the power of generative AI without just prompting and hoping for the best. From Unbound Slop to Tripo to Unreal Engine, we love this workflow for generating 3D models.

Unbound

26,381 次观看 • 2 个月前

MaskINT: Video Editing via Interpolative Non-autoregressive Masked Transformers paper page: Recent advances in generative AI have significantly enhanced image and video editing, particularly in the context of text prompt control. State-of-the-art approaches predominantly rely on diffusion models to accomplish these tasks. However, the computational demands of diffusion-based methods are substantial, often necessitating large-scale paired datasets for training, and therefore challenging the deployment in practical applications. This study addresses this challenge by breaking down the text-based video editing process into two separate stages. In the first stage, we leverage an existing text-to-image diffusion model to simultaneously edit a few keyframes without additional fine-tuning. In the second stage, we introduce an efficient model called MaskINT, which is built on non-autoregressive masked generative transformers and specializes in frame interpolation between the keyframes, benefiting from structural guidance provided by intermediate frames. Our comprehensive set of experiments illustrates the efficacy and efficiency of MaskINT when compared to other diffusion-based methodologies. This research offers a practical solution for text-based video editing and showcases the potential of non-autoregressive masked generative transformers in this domain.

MaskINT: Video Editing via Interpolative Non-autoregressive Masked Transformers paper page: Recent advances in generative AI have significantly enhanced image and video editing, particularly in the context of text prompt control. State-of-the-art approaches predominantly rely on diffusion models to accomplish these tasks. However, the computational demands of diffusion-based methods are substantial, often necessitating large-scale paired datasets for training, and therefore challenging the deployment in practical applications. This study addresses this challenge by breaking down the text-based video editing process into two separate stages. In the first stage, we leverage an existing text-to-image diffusion model to simultaneously edit a few keyframes without additional fine-tuning. In the second stage, we introduce an efficient model called MaskINT, which is built on non-autoregressive masked generative transformers and specializes in frame interpolation between the keyframes, benefiting from structural guidance provided by intermediate frames. Our comprehensive set of experiments illustrates the efficacy and efficiency of MaskINT when compared to other diffusion-based methodologies. This research offers a practical solution for text-based video editing and showcases the potential of non-autoregressive masked generative transformers in this domain.

AK

25,449 次观看 • 2 年前

The latent space of earlier generative models like GANS can linearly encode concepts of the data. What if the data was model weights? We present weights2weights, a subspace in diffusion weights that behaves as an interpretable latent space over customized diffusion models.

The latent space of earlier generative models like GANS can linearly encode concepts of the data. What if the data was model weights? We present weights2weights, a subspace in diffusion weights that behaves as an interpretable latent space over customized diffusion models.

Amil Dravid

94,276 次观看 • 2 年前

THIS GUY TURNS NOTES, DOCUMENTS, AND IDEAS INTO AN AI SECOND BRAIN the system stores all the context of your work and helps claude not forget anything how to build one yourself: install obsidian connect claude code keep your projects, notes, and sessions in one vault link similar ideas together use the graph to discover new connections as a result, claude gets memory of your projects and understands the context without you constantly having to explain everything the more you work, the smarter the system gets don’t collect notes build connections between them instead

THIS GUY TURNS NOTES, DOCUMENTS, AND IDEAS INTO AN AI SECOND BRAIN the system stores all the context of your work and helps claude not forget anything how to build one yourself: install obsidian connect claude code keep your projects, notes, and sessions in one vault link similar ideas together use the graph to discover new connections as a result, claude gets memory of your projects and understands the context without you constantly having to explain everything the more you work, the smarter the system gets don’t collect notes build connections between them instead

Marvin

24,954 次观看 • 25 天前

Flow-based generative models trained with flow matching tend to learn curved trajectories, which are challenging to approximate in a few steps. Rectified flows aim to learn straight trajectories, which are easier to simulate with less computation.

Flow-based generative models trained with flow matching tend to learn curved trajectories, which are challenging to approximate in a few steps. Rectified flows aim to learn straight trajectories, which are easier to simulate with less computation.

Alec Helbling

34,778 次观看 • 5 个月前

Just gave my first academic lecture in French at the amazing conference (OK so I had to read from my translated lecture notes, but still!) Covered chlorine dioxide (“dioxy de chlor”) and DMSO in just under an hour too! Vive La France 🇫🇷

Just gave my first academic lecture in French at the amazing conference (OK so I had to read from my translated lecture notes, but still!) Covered chlorine dioxide (“dioxy de chlor”) and DMSO in just under an hour too! Vive La France 🇫🇷

Pierre Kory, MD MPA

29,896 次观看 • 9 个月前

That was quick! Valentine's cross update is available NOW in the Skullgirls 2nd Encore Beta on Steam! Why are we making these changes? The short version is: we had to! For the long version, read the full update notes here:

That was quick! Valentine's cross update is available NOW in the Skullgirls 2nd Encore Beta on Steam! Why are we making these changes? The short version is: we had to! For the long version, read the full update notes here:

Skullgirls

593,092 次观看 • 2 年前

1/ Happy to share UniDisc - Unified Multimodal Discrete Diffusion – We train a 1.5 billion parameter transformer model from scratch on 250 million image/caption pairs using a **discrete diffusion objective**. Our model has all the benefits of diffusion models but now in multimodal space! - flexible compute-quality tradeoff, zero-shot inpainting and editing, better control via classifier-free guidance and lower latency! We open source everything - our code, weights and the training dataset.

1/ Happy to share UniDisc - Unified Multimodal Discrete Diffusion – We train a 1.5 billion parameter transformer model from scratch on 250 million image/caption pairs using a discrete diffusion objective. Our model has all the benefits of diffusion models but now in multimodal space! - flexible compute-quality tradeoff, zero-shot inpainting and editing, better control via classifier-free guidance and lower latency! We open source everything - our code, weights and the training dataset.

Mihir Prabhudesai

104,862 次观看 • 1 年前

The Hidden Language of Diffusion Models paper page: tackle the challenge of understanding concept representations in text-to-image models by decomposing an input text prompt into a small set of interpretable elements. This is achieved by learning a pseudo-token that is a sparse weighted combination of tokens from the model's vocabulary, with the objective of reconstructing the images generated for the given concept. Applied over the state-of-the-art Stable Diffusion model, this decomposition reveals non-trivial and surprising structures in the representations of concepts. For example, we find that some concepts such as "a president" or "a composer" are dominated by specific instances (e.g., "Obama", "Biden") and their interpolations. Other concepts, such as "happiness" combine associated terms that can be concrete ("family", "laughter") or abstract ("friendship", "emotion"). In addition to peering into the inner workings of Stable Diffusion, our method also enables applications such as single-image decomposition to tokens, bias detection and mitigation, and semantic image manipulation

The Hidden Language of Diffusion Models paper page: tackle the challenge of understanding concept representations in text-to-image models by decomposing an input text prompt into a small set of interpretable elements. This is achieved by learning a pseudo-token that is a sparse weighted combination of tokens from the model's vocabulary, with the objective of reconstructing the images generated for the given concept. Applied over the state-of-the-art Stable Diffusion model, this decomposition reveals non-trivial and surprising structures in the representations of concepts. For example, we find that some concepts such as "a president" or "a composer" are dominated by specific instances (e.g., "Obama", "Biden") and their interpolations. Other concepts, such as "happiness" combine associated terms that can be concrete ("family", "laughter") or abstract ("friendship", "emotion"). In addition to peering into the inner workings of Stable Diffusion, our method also enables applications such as single-image decomposition to tokens, bias detection and mitigation, and semantic image manipulation

AK

41,746 次观看 • 3 年前

Big news from Boltz - our biggest update yet! 🚀 Today we’re releasing two new state-of-the-art models for protein and small molecule design with extensive wet lab validation and a new API to run all of our models on scalable GPUs wherever you (or your agents) work! 🔥

Big news from Boltz - our biggest update yet! 🚀 Today we’re releasing two new state-of-the-art models for protein and small molecule design with extensive wet lab validation and a new API to run all of our models on scalable GPUs wherever you (or your agents) work! 🔥

Gabriele Corso

133,155 次观看 • 17 天前

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:

Stability AI

1,024,438 次观看 • 2 年前

Introducing benchmark tracking across all of arXiv With thousands of models and benchmarks out there, it's impossible to track what's actually state-of-the-art We now index results from millions of papers to surface which models are SOTA according to open source research!

Introducing benchmark tracking across all of arXiv With thousands of models and benchmarks out there, it's impossible to track what's actually state-of-the-art We now index results from millions of papers to surface which models are SOTA according to open source research!

alphaXiv

10,892 次观看 • 6 个月前

Okay, this is seriously cool. A team from Google DeepMind, including DeepMind Cofounder Shane Legg, published a paper "From AGI to ASI". In the paper, they include instructions for an AI agent to read along with you. You can open the paper in Codex's in-app browser and have GPT-5.5 read it with you and explain all the concepts. This is the future. AI agents will be part of the target audience, and help us to understand anything we want.

Okay, this is seriously cool. A team from Google DeepMind, including DeepMind Cofounder Shane Legg, published a paper "From AGI to ASI". In the paper, they include instructions for an AI agent to read along with you. You can open the paper in Codex's in-app browser and have GPT-5.5 read it with you and explain all the concepts. This is the future. AI agents will be part of the target audience, and help us to understand anything we want.

Dan McAteer

52,815 次观看 • 19 天前

Also the day of this 🫠🫠 The tongue and we know those hips are moving too and just think he goes from this to so pookie adorable in the GIFS 🥹💙

Also the day of this 🫠🫠 The tongue and we know those hips are moving too and just think he goes from this to so pookie adorable in the GIFS 🥹💙

InAWhisper 🌨️❄️⛄️

11,583 次观看 • 1 年前

Announced by Mark Zuckerberg this morning — today we're releasing DINOv2, the first method for training computer vision models that uses self-supervised learning to achieve results matching or exceeding industry standards. More on this new work ➡️

Announced by Mark Zuckerberg this morning — today we're releasing DINOv2, the first method for training computer vision models that uses self-supervised learning to achieve results matching or exceeding industry standards. More on this new work ➡️

AI at Meta

1,224,208 次观看 • 3 年前