Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

I got a diffusion model to run really fast, glued it to a LLM, and it blows my mind how much of the interactivity we expect from software (editing text, dragging things around, clicking on "links") just works™️ in pixel space. The future of software is bright

zan2434's profile picture

Zain Shah

20,451 subscribers

22,392 görüntüleme • 17 gün önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

"In the future, you won't need any software at all. The neural network will completely replace it." - stephen balaban, co-founder of Lambda "Here's the idea: instead of generating a program, just go to ChatGPT and say, 'Hi, please behave like a calculator or a spreadsheet.'" "'Generate an ASCII user interface for me. And I want you to essentially just respond, implement the logic of that program in your mind.'" "This is what I call neural software. Normal software is really brittle. 'Neural software' can't have bugs, only misunderstandings." "Large language models will be the software you interact with." From Stephen's appearance on the show in May.
1:42

"In the future, you won't need any software at all. The neural network will completely replace it." - stephen balaban, co-founder of Lambda "Here's the idea: instead of generating a program, just go to ChatGPT and say, 'Hi, please behave like a calculator or a spreadsheet.'" "'Generate an ASCII user interface for me. And I want you to essentially just respond, implement the logic of that program in your mind.'" "This is what I call neural software. Normal software is really brittle. 'Neural software' can't have bugs, only misunderstandings." "Large language models will be the software you interact with." From Stephen's appearance on the show in May.

TBPN

28,665 görüntüleme • 8 ay önce

Jensen Huang at GTC: "I expect data center build out to reach a trillion dollars, and I am fairly certain we're going to reach that very soon." "General purpose computing has run its course, and that we need a new computing approach." "In the past we wrote the software and we ran it on computers. In the future, the computer is going to generate the tokens for the software." "The computer has become a generator of tokens, not a retrieval of files."
1:47

Jensen Huang at GTC: "I expect data center build out to reach a trillion dollars, and I am fairly certain we're going to reach that very soon." "General purpose computing has run its course, and that we need a new computing approach." "In the past we wrote the software and we ran it on computers. In the future, the computer is going to generate the tokens for the software." "The computer has become a generator of tokens, not a retrieval of files."

vitrupo

55,974 görüntüleme • 1 yıl önce

"In the future, you won't need any software at all. The neural network will completely replace it." - stephen balaban, co-founder of Lambda "Here's the idea: instead of generating a program, just go to ChatGPT and say, 'Hi, please behave like a calculator or a spreadsheet.'" "'Generate an ASCII user interface for me. And I want you to essentially just respond, implement the logic of that program in your mind.'" "This is what I call neural software. Normal software is really brittle. 'Neural software' can't have bugs, only misunderstandings." "Large language models will be the software you interact with."
1:42

"In the future, you won't need any software at all. The neural network will completely replace it." - stephen balaban, co-founder of Lambda "Here's the idea: instead of generating a program, just go to ChatGPT and say, 'Hi, please behave like a calculator or a spreadsheet.'" "'Generate an ASCII user interface for me. And I want you to essentially just respond, implement the logic of that program in your mind.'" "This is what I call neural software. Normal software is really brittle. 'Neural software' can't have bugs, only misunderstandings." "Large language models will be the software you interact with."

TBPN

178,100 görüntüleme • 1 yıl önce

Results from a failed attempt to train a latent diffusion model on the results of my gabor image fitting process. The model doesn't do what it was supposed to, but I don't really mind what it's doing.
0:56

Results from a failed attempt to train a latent diffusion model on the results of my gabor image fitting process. The model doesn't do what it was supposed to, but I don't really mind what it's doing.

Andrew 😵‍💫

58,435 görüntüleme • 2 ay önce

Anish Acharya: We're going to see a "YouTube moment for software": "If you think about YouTube 20 years ago—we had lots of video and lots of television, and it was high production quality, and it wasn't clear that we needed more and 20 years later, YouTube's a $550 billion enterprise that would be one of the biggest companies in the world if it was independent." "I think the same thing is going to happen for software. People want to make software, and for the first time they can—and they can distribute it and they can consume it." "Sometimes it's going to be important software. Sometimes it's going to be totally trivial. It's going to be software for a bachelor party weekend, software for a joke, software for a prompt. We have this sort of seriousness about software that we had about video and television 20 years ago." "Now it's like—I just took a video on my phone. It's going to be like—I just made an app on my phone. Same energy." Anish Acharya on BILLIONS with Guillaume Moubeche
1:30

Anish Acharya: We're going to see a "YouTube moment for software": "If you think about YouTube 20 years ago—we had lots of video and lots of television, and it was high production quality, and it wasn't clear that we needed more and 20 years later, YouTube's a $550 billion enterprise that would be one of the biggest companies in the world if it was independent." "I think the same thing is going to happen for software. People want to make software, and for the first time they can—and they can distribute it and they can consume it." "Sometimes it's going to be important software. Sometimes it's going to be totally trivial. It's going to be software for a bachelor party weekend, software for a joke, software for a prompt. We have this sort of seriousness about software that we had about video and television 20 years ago." "Now it's like—I just took a video on my phone. It's going to be like—I just made an app on my phone. Same energy." Anish Acharya on BILLIONS with Guillaume Moubeche

a16z

102,781 görüntüleme • 4 ay önce

Candace Owens PROVES Brigitte Macron is her brother with SCIENCE (& that she's NOT a conspiracy theorist) - By using the World Economic Forum's FACE++ AI software. Candace: "It's really good software. The more that I use it the more familiar I am with how it works. Candace seconds later: "I don't know how this software works. But I've learned to trust it."
2:40

Candace Owens PROVES Brigitte Macron is her brother with SCIENCE (& that she's NOT a conspiracy theorist) - By using the World Economic Forum's FACE++ AI software. Candace: "It's really good software. The more that I use it the more familiar I am with how it works. Candace seconds later: "I don't know how this software works. But I've learned to trust it."

Nathan Livingstone (MilkBarTV)

175,575 görüntüleme • 11 ay önce

I went a little crazy with my first 360-drone captured gaussian splat. Of a public park I always bring my daughter to It really is so amazing how much detail a person could capture in 3D with just hobbyist hardware and software
0:57

I went a little crazy with my first 360-drone captured gaussian splat. Of a public park I always bring my daughter to It really is so amazing how much detail a person could capture in 3D with just hobbyist hardware and software

Brad Lynch

35,155 görüntüleme • 4 ay önce

“AI is changing the value prop of software.” We spoke with Metronome CEO Scott Woody about why AI requires a new business model. “In the cloud era…the value of the software scales as your org scales.” “In AI, the software is now doing work on your behalf…so the core value of the software is not who in my org has access to the data, it's what can this software do for me? When the value shifts from access to output, the business model has to follow.
1:36

“AI is changing the value prop of software.” We spoke with Metronome CEO Scott Woody about why AI requires a new business model. “In the cloud era…the value of the software scales as your org scales.” “In AI, the software is now doing work on your behalf…so the core value of the software is not who in my org has access to the data, it's what can this software do for me? When the value shifts from access to output, the business model has to follow.

a16z

23,455 görüntüleme • 1 yıl önce

Benedict Evans says AI means more software, not less: "There's going to be a bunch of stuff you could do with software that you just couldn't do before at all. And so there will be more competition." "If you think about the enterprise software fleet today, you've got three buckets... big iron horizontal systems, so SAP and Workday and your CRM... vertical software... and then in the middle, this fuzzy improvised space of Excel and email and the shared file system." "Now you add ChatGPT to that. Do you do that in an LLM? Is there an LLM tool that means you can do that in Salesforce where you couldn't do it before, or you can do it in your vertical app that you couldn't do before?" "All of which is a long way of saying, what does this do to software? And it must be more software. Way more software." Benedict Evans with Erik Torenberg
1:36

Benedict Evans says AI means more software, not less: "There's going to be a bunch of stuff you could do with software that you just couldn't do before at all. And so there will be more competition." "If you think about the enterprise software fleet today, you've got three buckets... big iron horizontal systems, so SAP and Workday and your CRM... vertical software... and then in the middle, this fuzzy improvised space of Excel and email and the shared file system." "Now you add ChatGPT to that. Do you do that in an LLM? Is there an LLM tool that means you can do that in Salesforce where you couldn't do it before, or you can do it in your vertical app that you couldn't do before?" "All of which is a long way of saying, what does this do to software? And it must be more software. Way more software." Benedict Evans with Erik Torenberg

a16z

36,975 görüntüleme • 1 ay önce

Cognition’s Scott Wu: “If anything, there’s going to be a lot more software engineers. Everyone talks about Jevons paradox and how it relates to AI; I think there’s nowhere that it’s more true than software, because we really never seem to run out of demand for more code and more software.”
2:28

Cognition’s Scott Wu: “If anything, there’s going to be a lot more software engineers. Everyone talks about Jevons paradox and how it relates to AI; I think there’s nowhere that it’s more true than software, because we really never seem to run out of demand for more code and more software.”

Stripe

15,177 görüntüleme • 11 ay önce

TurboEdit Instant text-based image editing discuss: We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input image and the reconstructed image from the previous step, allowing for correction of the next reconstruction towards the input image. We demonstrate that disentangled controls can be easily achieved in the few-step diffusion model by conditioning on an (automatically generated) detailed text prompt. To manipulate the inverted image, we freeze the noise maps and modify one attribute in the text prompt (either manually or via instruction based editing driven by an LLM), resulting in the generation of a new image similar to the input image with only one attribute changed. It can further control the editing strength and accept instructive text prompt. Our approach facilitates realistic text-guided image edits in real-time, requiring only 8 number of functional evaluations (NFEs) in inversion (one-time cost) and 4 NFEs per edit. Our method is not only fast, but also significantly outperforms state-of-the-art multi-step diffusion editing techniques.
0:22

TurboEdit Instant text-based image editing discuss: We address the challenges of precise image inversion and disentangled image editing in the context of few-step diffusion models. We introduce an encoder based iterative inversion technique. The inversion network is conditioned on the input image and the reconstructed image from the previous step, allowing for correction of the next reconstruction towards the input image. We demonstrate that disentangled controls can be easily achieved in the few-step diffusion model by conditioning on an (automatically generated) detailed text prompt. To manipulate the inverted image, we freeze the noise maps and modify one attribute in the text prompt (either manually or via instruction based editing driven by an LLM), resulting in the generation of a new image similar to the input image with only one attribute changed. It can further control the editing strength and accept instructive text prompt. Our approach facilitates realistic text-guided image edits in real-time, requiring only 8 number of functional evaluations (NFEs) in inversion (one-time cost) and 4 NFEs per edit. Our method is not only fast, but also significantly outperforms state-of-the-art multi-step diffusion editing techniques.

AK

16,062 görüntüleme • 1 yıl önce

Google just released Muse: a text to image model achieving state of the art performance. It is significantly more efficient than diffusion models. Muse also allows for inpainting, outpainting, and mask-free editing without finetuning or inverting the model.
0:33

Google just released Muse: a text to image model achieving state of the art performance. It is significantly more efficient than diffusion models. Muse also allows for inpainting, outpainting, and mask-free editing without finetuning or inverting the model.

bleedingedge.ai

183,750 görüntüleme • 3 yıl önce

.Amjad Masad : Creating software is going to be one of the most exciting areas. The average person will soon be as capable as what a senior software engineer is today, as we shift from doing the work to directing it. Instead of coding line by line, you’ll run multiple agents in parallel, building the frontend, refactoring the database, shipping features, all in the background. On top of that, you’ll have a clean interface to design and interact with AI more creatively. Software creation is moving from execution to orchestration, and soon, it won’t be a specialised skill, it’ll be the baseline.
0:47

.Amjad Masad : Creating software is going to be one of the most exciting areas. The average person will soon be as capable as what a senior software engineer is today, as we shift from doing the work to directing it. Instead of coding line by line, you’ll run multiple agents in parallel, building the frontend, refactoring the database, shipping features, all in the background. On top of that, you’ll have a clean interface to design and interact with AI more creatively. Software creation is moving from execution to orchestration, and soon, it won’t be a specialised skill, it’ll be the baseline.

Extraordinary

19,241 görüntüleme • 4 ay önce

Former Goldman Sachs executive Raoul Pal explains how AI is going to eat traditional software/SAAS. If your product is just software, agentic AI can reproduce it on demand, optimize it, and redeploy it to a better market. "Agentic AI means it’s like having Fiverr, a website of experts you can ask any question. It’ll go away and do the task.... Agentic AI will build, design the website, code it, register the domain name, figure out the branding, figure out the marketing, figure out the email list, figure out the whole thing. So then you and I are in competition. You’ve built this incredible new website. I just go to my AI and say, “Love Steven’s website. Can you just build it better. Boom. 3 minutes. How can we be entrepreneurs in software? Now there’s this theory going around that AI is going to eat software, and I kind of get it." ---- From 'The Diary Of A CEO and Raoul Pal The Journey Man' YT channel. (link in comment)
1:11

Former Goldman Sachs executive Raoul Pal explains how AI is going to eat traditional software/SAAS. If your product is just software, agentic AI can reproduce it on demand, optimize it, and redeploy it to a better market. "Agentic AI means it’s like having Fiverr, a website of experts you can ask any question. It’ll go away and do the task.... Agentic AI will build, design the website, code it, register the domain name, figure out the branding, figure out the marketing, figure out the email list, figure out the whole thing. So then you and I are in competition. You’ve built this incredible new website. I just go to my AI and say, “Love Steven’s website. Can you just build it better. Boom. 3 minutes. How can we be entrepreneurs in software? Now there’s this theory going around that AI is going to eat software, and I kind of get it." ---- From 'The Diary Of A CEO and Raoul Pal The Journey Man' YT channel. (link in comment)

Rohan Paul

48,418 görüntüleme • 4 ay önce

Former Goldman Sachs executive Raoul Pal explains how AI is going to eat traditional software/SAAS. If your product is just software, agentic AI can reproduce it on demand, optimize it, and redeploy it to a better market. "Agentic AI means it’s like having Fiverr, a website of experts you can ask any question. It’ll go away and do the task.... Agentic AI will build, design the website, code it, register the domain name, figure out the branding, figure out the marketing, figure out the email list, figure out the whole thing. So then you and I are in competition. You’ve built this incredible new website. I just go to my AI and say, “Love Steven’s website. Can you just build it better. Boom. 3 minutes. How can we be entrepreneurs in software? Now there’s this theory going around that AI is going to eat software, and I kind of get it." ---- From 'The Diary Of A CEO and Raoul Pal The Journey Man' YT channel. (link in comment)
1:11

Former Goldman Sachs executive Raoul Pal explains how AI is going to eat traditional software/SAAS. If your product is just software, agentic AI can reproduce it on demand, optimize it, and redeploy it to a better market. "Agentic AI means it’s like having Fiverr, a website of experts you can ask any question. It’ll go away and do the task.... Agentic AI will build, design the website, code it, register the domain name, figure out the branding, figure out the marketing, figure out the email list, figure out the whole thing. So then you and I are in competition. You’ve built this incredible new website. I just go to my AI and say, “Love Steven’s website. Can you just build it better. Boom. 3 minutes. How can we be entrepreneurs in software? Now there’s this theory going around that AI is going to eat software, and I kind of get it." ---- From 'The Diary Of A CEO and Raoul Pal The Journey Man' YT channel. (link in comment)

Rohan Paul

17,215 görüntüleme • 1 ay önce

Standard Intelligence's devansh responds to roon's tweet that "text is the universal interface," and explains why their new foundation model is trained on video: "At some point in the arbitrarily long future, if we only use text models, we could force most things to be text. But I think there are just a lot of things that are much more native when done from a computer-use [perspective]." "GUIs are designed for humans to use. We have this massive long tail of things on the internet that are entirely undoable by LLMs." "For example, when I do ML engineering most of my time is spent doing the grunt work of engineering. It's a lot of looking at graphs, analyzing, and comparing loss curves. You can do this in text, but it's a much larger pain than doing it in the native interface." "There's a reason humans don't interact with a computer purely through text, it would kind of suck."
1:47

Standard Intelligence's devansh responds to roon's tweet that "text is the universal interface," and explains why their new foundation model is trained on video: "At some point in the arbitrarily long future, if we only use text models, we could force most things to be text. But I think there are just a lot of things that are much more native when done from a computer-use [perspective]." "GUIs are designed for humans to use. We have this massive long tail of things on the internet that are entirely undoable by LLMs." "For example, when I do ML engineering most of my time is spent doing the grunt work of engineering. It's a lot of looking at graphs, analyzing, and comparing loss curves. You can do this in text, but it's a much larger pain than doing it in the native interface." "There's a reason humans don't interact with a computer purely through text, it would kind of suck."

TBPN

64,434 görüntüleme • 5 ay önce

This is the craziest model you'll see this week! This model powers Figma. It's also behind Wayfair and a bunch of major e-commerce retailers. This model is a PIXEL-PERFECT image editing model. Literally, "pixel perfect". The model is capable of modifying one image while keeping everything else untouched. It's a model designed, developed, and deployed by the research team at Jasper. This beats OpenAI models, Nano Banana, and every single general image model I've seen so far. It's up to 100x less expensive to run, and up to 10X faster. I recorded a quick video to show you how impressive this is. There's a ton of research behind this model. I'm adding two links below so you can read about how this model works, specifically about "Latent Bridge Matching" and "Flash Diffusion".
4:29

This is the craziest model you'll see this week! This model powers Figma. It's also behind Wayfair and a bunch of major e-commerce retailers. This model is a PIXEL-PERFECT image editing model. Literally, "pixel perfect". The model is capable of modifying one image while keeping everything else untouched. It's a model designed, developed, and deployed by the research team at Jasper. This beats OpenAI models, Nano Banana, and every single general image model I've seen so far. It's up to 100x less expensive to run, and up to 10X faster. I recorded a quick video to show you how impressive this is. There's a ton of research behind this model. I'm adding two links below so you can read about how this model works, specifically about "Latent Bridge Matching" and "Flash Diffusion".

Santiago

25,848 görüntüleme • 9 ay önce

This is a new diffusion-based language model from Inception. I don't know how well it works compared to an autoregressive LM of a similar size, but the inference process looks badass:
0:29

This is a new diffusion-based language model from Inception. I don't know how well it works compared to an autoregressive LM of a similar size, but the inference process looks badass:

BURKOV

58,434 görüntüleme • 1 yıl önce

Dario Amodei just told software engineers exactly how long they have. Six to twelve months. Amodei: “I have engineers within Anthropic who say I don’t write any code anymore. I just let the model write the code, I edit it, I do the things around it.” The people building the most powerful AI in history have already stopped writing code. That is not a forecast. That is the current working condition inside the lab closest to the frontier. Amodei: “We might be six to 12 months away from when the model is doing most, maybe all, of what SWEs do end-to-end.” The tech industry spent a decade making software engineers its highest-paid, most protected class. That era has a last day now. When a model can execute an entire software build end-to-end, the ability to write syntax stops being a skill. It becomes a credential for a job that no longer exists. Amodei: “And then it’s a question of how fast does that loop close.” That is the sentence everyone skipped. The code was never the hard part. The hard part was everything around it. The model just learned everything around it. Writing the code is already nearly gone. Testing is next. Deployment is next. When all three collapse into a single autonomous execution loop, the machine no longer needs a human in the chain at all. The corporation or sovereign state that closes that loop first does not gain a competitive advantage. It gains a category of speed that biological engineers cannot match, track, or reverse. That is not disruption. That is replacement at a systems level. Amodei is not describing a future disruption. He is describing the current state of his own building. The loop is already closing. The only question is whether you are inside it or outside it when it seals.
0:27

Dario Amodei just told software engineers exactly how long they have. Six to twelve months. Amodei: “I have engineers within Anthropic who say I don’t write any code anymore. I just let the model write the code, I edit it, I do the things around it.” The people building the most powerful AI in history have already stopped writing code. That is not a forecast. That is the current working condition inside the lab closest to the frontier. Amodei: “We might be six to 12 months away from when the model is doing most, maybe all, of what SWEs do end-to-end.” The tech industry spent a decade making software engineers its highest-paid, most protected class. That era has a last day now. When a model can execute an entire software build end-to-end, the ability to write syntax stops being a skill. It becomes a credential for a job that no longer exists. Amodei: “And then it’s a question of how fast does that loop close.” That is the sentence everyone skipped. The code was never the hard part. The hard part was everything around it. The model just learned everything around it. Writing the code is already nearly gone. Testing is next. Deployment is next. When all three collapse into a single autonomous execution loop, the machine no longer needs a human in the chain at all. The corporation or sovereign state that closes that loop first does not gain a competitive advantage. It gains a category of speed that biological engineers cannot match, track, or reverse. That is not disruption. That is replacement at a systems level. Amodei is not describing a future disruption. He is describing the current state of his own building. The loop is already closing. The only question is whether you are inside it or outside it when it seals.

Dustin

318,457 görüntüleme • 4 ay önce