Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

This is a new diffusion-based language model from Inception. I don't know how well it works compared to an autoregressive LM of a similar size, but the inference process looks badass:

BURKOV

52,262 subscribers

58,434 просмотров • 1 год назад •via X (Twitter)

Наука и технологии Новости и политика Образование

Anya Rossi• Live Now

Private livecam show

Комментарии: 11

Фото профиля wabalabadubd

wabalabadubd1 год назад

@InceptionAILabs Finally something which is not just one upping the benchmarks.

Фото профиля Malarkey Roofing Products

Malarkey Roofing Products1 год назад

A little more thought, a little more effort, a little more care. If there’s a better, more sustainable way to make a shingle, we intend to find it. #AnythingButStandard #Innovate #EcoFriendlyRoofing #Greener #SustainableInnovation #SustainableRoofing #SustainableShingles @Holcim

Фото профиля TheFullStackSnack

TheFullStackSnack1 год назад

@InceptionAILabs The fact that approach like "start with a random set of characters and tweak until it works" is working for coding blow my mind.

Фото профиля Dr. Novo 🍌

Dr. Novo 🍌1 год назад

I’m beyond excited by their work! Been working on adapting a GAN model to work with discrete data (since 2023) but it’s been a nightmare! It’s genius actually to use diffusion models to capitalise on noise to boost the quality and speed of outputs in LLMs! I’m just dying to know how they solved the discrete/continuous duality in practice!

Фото профиля Qusai Ismael

Qusai Ismael1 год назад

@InceptionAILabs Look at the way it generates the answer, this would be a large shift from the old way. imagine adding thinking to it too.

Фото профиля John Januszczak

John Januszczak1 год назад

@InceptionAILabs I asked it to create a react component. It queued the request (probably because if everyone on X trying it), but when it started it was lightning fast.

Фото профиля cargo

cargo1 год назад

@InceptionAILabs what is the advantage or disadvantage of using diffusion here?

Фото профиля Tobias Holgersen

Tobias Holgersen1 год назад

@InceptionAILabs They should make it even more like the matrix 💪

Фото профиля Bhaktavaschal Samal

Bhaktavaschal Samal1 год назад

@InceptionAILabs actually, worked on this for a few days, gave up in the end

Фото профиля Midas 霊 👑 (kween/acc)

Midas 霊 👑 (kween/acc)1 год назад

@InceptionAILabs don't miss this one too, also launched on the same day seems like something's in the air with these dllms

Фото профиля Rogerio Chaves

Rogerio Chaves1 год назад

@InceptionAILabs Yeah, I don’t get it, why do you need to enable the “diffusion effects”? Seems like a frontend gimmick otherwise it’s just like other LLMs?

Похожие видео

MinerU-Diffusion A 2.5B diffusion-based OCR model that replaces slow autoregressive decoding with parallel block-wise diffusion, achieving up to 3.2x faster inference while improving robustness on complex documents with tables, formulas, and layouts.

MinerU-Diffusion A 2.5B diffusion-based OCR model that replaces slow autoregressive decoding with parallel block-wise diffusion, achieving up to 3.2x faster inference while improving robustness on complex documents with tables, formulas, and layouts.

DailyPapers

15,304 просмотров • 2 месяцев назад

Results from a failed attempt to train a latent diffusion model on the results of my gabor image fitting process. The model doesn't do what it was supposed to, but I don't really mind what it's doing.

Results from a failed attempt to train a latent diffusion model on the results of my gabor image fitting process. The model doesn't do what it was supposed to, but I don't really mind what it's doing.

Andrew 😵‍💫

55,459 просмотров • 1 месяц назад

Meta announces SceneScript Reconstructing Scenes With An Autoregressive Structured Language Model We introduce SceneScript, a method that directly produces full scene models as a sequence of structured language commands using an autoregressive, token-based approach. Our

Meta announces SceneScript Reconstructing Scenes With An Autoregressive Structured Language Model We introduce SceneScript, a method that directly produces full scene models as a sequence of structured language commands using an autoregressive, token-based approach. Our

AK

46,090 просмотров • 2 лет назад

I don't speak the language but I know "LOOK AT THE F'ING SIZE OF IT!" when I hear it

I don't speak the language but I know "LOOK AT THE F'ING SIZE OF IT!" when I hear it

Ribz of Tik Tok

118,740 просмотров • 4 месяцев назад

Most don't know (1) how easy it is to invert embedding vectors back into sentences, (2) this is a perfect task text diffusion models. Here's a 78M parameter model and live demo that recovers 80% of tokens from Qwen3-Embedding and EmbeddingGemma vectors. Works even on multilingual input.

Most don't know (1) how easy it is to invert embedding vectors back into sentences, (2) this is a perfect task text diffusion models. Here's a 78M parameter model and live demo that recovers 80% of tokens from Qwen3-Embedding and EmbeddingGemma vectors. Works even on multilingual input.

Jina AI

12,805 просмотров • 4 месяцев назад

Block Diffusion Interpolating Between Autoregressive and Diffusion Language Models

Block Diffusion Interpolating Between Autoregressive and Diffusion Language Models

AK

160,553 просмотров • 1 год назад

Diffusion language models are SO FAST!! A new startup, Inception Labs, has released Mercury Coder, "the first commercial-scale diffusion large language model" It's 5-10x faster than current gen LLMs, providing high-quality responses at low costs. And you can try it now!

Diffusion language models are SO FAST!! A new startup, Inception Labs, has released Mercury Coder, "the first commercial-scale diffusion large language model" It's 5-10x faster than current gen LLMs, providing high-quality responses at low costs. And you can try it now!

Tanishq Mathew Abraham, Ph.D.

354,178 просмотров • 1 год назад

New episode of the Information Bottleneck! We talked with Stefano Ermon about why he thinks diffusion LLMs will replace autoregressive ones. Stefano co-invented DDIM, FlashAttention, DPO, and score-based diffusion models. He's a Stanford professor and now runs Inception AI, where they built Mercury II. We go deep but also cover the bigger picture - the startup journey, PhD vs industry, and where AI is heading. A few things that stuck with me: - He thinks of autoregressive models as typewriters and diffusion models as editors. One goes left to right. The other starts messy and refines. - Mercury II (their text difussion model) already beats the fastest autoregressive models on latency-critical stuff as voice agents, code suggestions, anything where you have a tight time budget. And it does it because diffusion generates tokens in parallel instead of one at a time. - We also got into whether AI will actually replace software engineers (his answer: no), PhD vs industry advice, and what it was like going from an ICML best paper to raising money.

New episode of the Information Bottleneck! We talked with Stefano Ermon about why he thinks diffusion LLMs will replace autoregressive ones. Stefano co-invented DDIM, FlashAttention, DPO, and score-based diffusion models. He's a Stanford professor and now runs Inception AI, where they built Mercury II. We go deep but also cover the bigger picture - the startup journey, PhD vs industry, and where AI is heading. A few things that stuck with me: - He thinks of autoregressive models as typewriters and diffusion models as editors. One goes left to right. The other starts messy and refines. - Mercury II (their text difussion model) already beats the fastest autoregressive models on latency-critical stuff as voice agents, code suggestions, anything where you have a tight time budget. And it does it because diffusion generates tokens in parallel instead of one at a time. - We also got into whether AI will actually replace software engineers (his answer: no), PhD vs industry advice, and what it was like going from an ICML best paper to raising money.

Ravid Shwartz Ziv

22,137 просмотров • 2 месяцев назад

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models paper page: github: Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However, these models still encounter difficulties when generating images from prompts that demand spatial or common sense reasoning. We propose to equip diffusion models with enhanced reasoning capabilities by using off-the-shelf pretrained large language models (LLMs) in a novel two-stage generation process. First, we adapt an LLM to be a text-guided layout generator through in-context learning. When provided with an image prompt, an LLM outputs a scene layout in the form of bounding boxes along with corresponding individual descriptions. Second, we steer a diffusion model with a novel controller to generate images conditioned on the layout. Both stages utilize frozen pretrained models without any LLM or diffusion model parameter optimization. We validate the superiority of our design by demonstrating its ability to outperform the base diffusion model in accurately generating images according to prompts that necessitate both language and spatial reasoning. Additionally, our method naturally allows dialog-based scene specification and is able to handle prompts in a language that is not well-supported by the underlying diffusion model.

LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models paper page: github: Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However, these models still encounter difficulties when generating images from prompts that demand spatial or common sense reasoning. We propose to equip diffusion models with enhanced reasoning capabilities by using off-the-shelf pretrained large language models (LLMs) in a novel two-stage generation process. First, we adapt an LLM to be a text-guided layout generator through in-context learning. When provided with an image prompt, an LLM outputs a scene layout in the form of bounding boxes along with corresponding individual descriptions. Second, we steer a diffusion model with a novel controller to generate images conditioned on the layout. Both stages utilize frozen pretrained models without any LLM or diffusion model parameter optimization. We validate the superiority of our design by demonstrating its ability to outperform the base diffusion model in accurately generating images according to prompts that necessitate both language and spatial reasoning. Additionally, our method naturally allows dialog-based scene specification and is able to handle prompts in a language that is not well-supported by the underlying diffusion model.

AK

83,657 просмотров • 2 лет назад

Try the first diffusion language model on the playground. Inception Labs' Mercury Coder generates over 1000 tokens/sec.

Try the first diffusion language model on the playground. Inception Labs' Mercury Coder generates over 1000 tokens/sec.

AI SDK

17,964 просмотров • 1 год назад

Inception Labs just killed the transformer. They released Mercury 2, the world's first "diffusion" reasoning model. It's fast, and it uses a completely new model architecture... just watch this 11 min video to find out more:

Inception Labs just killed the transformer. They released Mercury 2, the world's first "diffusion" reasoning model. It's fast, and it uses a completely new model architecture... just watch this 11 min video to find out more:

David Ondrej

45,692 просмотров • 3 месяцев назад

MotionStreamer announced on Hugging Face Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space

MotionStreamer announced on Hugging Face Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space

AK

43,387 просмотров • 1 год назад

Testing out how well this interactive animated short made in Rive works on the ipad. Looks like I need to make a more touch friendly version, but the new hover feature with the pencil works great!

Testing out how well this interactive animated short made in Rive works on the ipad. Looks like I need to make a more touch friendly version, but the new hover feature with the pencil works great!

Drawsgood

45,567 просмотров • 2 лет назад

Hallucinator I wrote a gradio app to play with Standard Intelligence's Hertz model. Hertz inference works like LLM but purely audio based--the inference happens voice to voice. Hallucinator uses Hertz to autocomplete any speech clip, often resulting in some hilarious hallucinations.

Hallucinator I wrote a gradio app to play with Standard Intelligence's Hertz model. Hertz inference works like LLM but purely audio based--the inference happens voice to voice. Hallucinator uses Hertz to autocomplete any speech clip, often resulting in some hilarious hallucinations.

cocktail peanut

14,745 просмотров • 1 год назад

Is any of this real? HeyGen approached me to try out their new Avatar IV model, at first I was a bit sceptical. But ohh I was quickly turned around. This is absolutely mad This is how it works:

Linus ✦ Ekenstam

176,792 просмотров • 1 год назад

How to match the complexity of the problem you want to solve with the proper model. You want an inference router. In the video, I show you how simple and powerful this is. After this, you'll never talk directly to a model ever again.

How to match the complexity of the problem you want to solve with the proper model. You want an inference router. In the video, I show you how simple and powerful this is. After this, you'll never talk directly to a model ever again.

Santiago

11,861 просмотров • 16 дней назад

This is Audi's new supercar called the Nuvolari. I know it's a V8 hybrid, but I think it looks like an ugly EV! Am I wrong?

This is Audi's new supercar called the Nuvolari. I know it's a V8 hybrid, but I think it looks like an ugly EV! Am I wrong?

Vince Langman

14,634 просмотров • 5 дней назад

Rewrote tiny-diffusion to be 3x smaller! Went from 951 lines to just 364, all contained in one file. As simple as possible, but not simpler. I also added a tiny GPT implementation as a comparison (312 lines, inspired by Andrej Karpathy). The two implementations are ~80% identical. The model architecture, training loop, tokenization, etc, only differ in 19 lines of code. The main differences are contained within two functions (generate and get_batch). The reason to include the GPT implementation was to show how similar autoregressive LMs are to diffusion LMs on an architectural level. Only *1* line of code in the architecture needs to be modified to support masked language diffusion instead of next-token prediction (by disabling causal masking). Link to the repo is in the comments

Rewrote tiny-diffusion to be 3x smaller! Went from 951 lines to just 364, all contained in one file. As simple as possible, but not simpler. I also added a tiny GPT implementation as a comparison (312 lines, inspired by Andrej Karpathy). The two implementations are ~80% identical. The model architecture, training loop, tokenization, etc, only differ in 19 lines of code. The main differences are contained within two functions (generate and get_batch). The reason to include the GPT implementation was to show how similar autoregressive LMs are to diffusion LMs on an architectural level. Only 1 line of code in the architecture needs to be modified to support masked language diffusion instead of next-token prediction (by disabling causal masking). Link to the repo is in the comments

Nathan Barry

161,578 просмотров • 5 месяцев назад

I really want to know how the POLICE recruitment process works in this part of the world.

I really want to know how the POLICE recruitment process works in this part of the world.

YOUR EX 💔🌽🌽🌽🌽

616,038 просмотров • 2 месяцев назад

Just found the dLLM library to create Diffusion Language Models It's still early but it's insanely fun to experiment with diffusion (training, inference, eval) dLLM has the potential of becoming the main library for diffusion LLMs

Just found the dLLM library to create Diffusion Language Models It's still early but it's insanely fun to experiment with diffusion (training, inference, eval) dLLM has the potential of becoming the main library for diffusion LLMs

Maxime Labonne

75,421 просмотров • 7 месяцев назад