Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Open source software is GREAT. But "open source" AI is NOT like software - it's VERY different. Rob Miles cuts through the bullshit: ROB: Oh, hey, Meta. I heard Llama's weights leaked. That's rough, man. Information security's hard. How you holding up? META: Oh, we're great. Yeah, we're fine.... We... actually, that was deliberate. We meant to do that. ROB MILES: Oh, really? META: Yeah... well, the second time anyway. It's called open source. Look it up. ROB MILES: Oh. Well, I love free and open source software, but do those principles really apply to network weights? How does that work? META: Open source is good for users because it lets them read the source code and see what the program is really doing and how it works. ROB MILES: Wait, have you found a way to tell how a model works by looking at its weights? META: No. But, it lets developers all over the world spot bugs in the code and submit patches. ROB: Wait, people are fixing bugs in Llama's weights? META: Well, no. People can fine tune it themselves, though. ROB: ?? Other companies offer fine tuning through APIs. ... So, hang on, if you can't actually read the code and know what it's doing, then network weights are effectively a compiled binary. So, in what sense is this open source? Why not call it like public weights? Why call it open source at all? META: I love open source. ROB: Well, I know a lot of your employees do, but you don't love anything. You're a giant corporation. What's in it for you? META: I love, love open source.show more

AI Notkilleveryoneism Memes ⏸️

143,997 subscribers

107,362 views • 2 years ago •via X (Twitter)

Science & Technology Comedy Education

Anya Rossi• Live Now

Private livecam show

10 Comments

AI Notkilleveryoneism Memes ⏸️2 years ago

Source: Rob Miles' new banger video summarizing the last year and explaining the current situation with AI safety

Rob Miles (in SF)2 years ago

I'm starting to suspect the main reason for open sourcing llama is that "Best 'Open Source' LLM" is much better marketing than "6th Best LLM"

AI Notkilleveryoneism Memes ⏸️2 years ago

It's good marketing. And many people unthinkingly cheer for anything branded 'open source' Zuck has done this many times - he convinces developers to build on his "open" platform (FB), then crushes them when economic logic dictates. (VCs stopped funding startups built on FB.)

PauseAI ⏸2 years ago

@robertskmiles Amazing segment. Entire video is a must-watch!

AI Notkilleveryoneism Memes ⏸️2 years ago

@robertskmiles HE IS RISEN

Bryan Wade2 years ago

@robertskmiles Ok, call it Open Weights. There are still lots of people that benefit from that. It means that I can run this stuff on my own hardware, and a for profit company can't cut me off from the technology overnight. Most of the AI startup scene only exists because of open weights.

Dirk Bruere2 years ago

@robertskmiles Illustrates that secrets cannot be kept by anyone.

Matt Prestifilippo2 years ago

@robertskmiles This is missing the major point that even though they don’t share the training data, it’s still expensive to produce the models. And the permissive license to use those for businesses without fees is useful.

Alex Alarga ⏹️2 years ago

@robertskmiles

Random User2 years ago

@robertskmiles I’d also highlight the aspect of learning how to code well from actual open-source.

Related Videos

Anthropic CEO Dario Amodei on Open-Source AI Models. "I don't think open source works the same way in AI that it has worked in other areas. Primarily because with open source you can see the source code of the model. Here we can't see inside the model, it's often called open weights instead of open source to kind of distinguish that. But a lot of the benefits, which is that many people can work on it and that it's kind of additive, don't quite work in the same way. So I've actually always seen it as a red herring. When I see a new model come out I don't care whether it's open source or not. If we talk about Deep Seek I don't think it mattered that Deep Seek is open source. I think I ask, is it a good model? Is it better than us at the things that matter? That's the only thing that I care about. It actually doesn't matter either way. Because ultimately you have to host it on the cloud. The people who host it on the cloud do inference. These are big models, they're hard to do inference on. When I think about competition I think about which models are good at the tasks that we do. I think open source is actually a red herring. It's not free. You have to run it on inference and someone has to make it fast on inference." --- From 'Alex Kantrowitz' YT channel

Anthropic CEO Dario Amodei on Open-Source AI Models. "I don't think open source works the same way in AI that it has worked in other areas. Primarily because with open source you can see the source code of the model. Here we can't see inside the model, it's often called open weights instead of open source to kind of distinguish that. But a lot of the benefits, which is that many people can work on it and that it's kind of additive, don't quite work in the same way. So I've actually always seen it as a red herring. When I see a new model come out I don't care whether it's open source or not. If we talk about Deep Seek I don't think it mattered that Deep Seek is open source. I think I ask, is it a good model? Is it better than us at the things that matter? That's the only thing that I care about. It actually doesn't matter either way. Because ultimately you have to host it on the cloud. The people who host it on the cloud do inference. These are big models, they're hard to do inference on. When I think about competition I think about which models are good at the tasks that we do. I think open source is actually a red herring. It's not free. You have to run it on inference and someone has to make it fast on inference." --- From 'Alex Kantrowitz' YT channel

Rohan Paul

944,205 views • 7 months ago

"It's not open source, it's open weights!" Geoffrey Hinton warns against releasing "open weights" of large AI models that can be fine tuned to do "nasty things."

"It's not open source, it's open weights!" Geoffrey Hinton warns against releasing "open weights" of large AI models that can be fine tuned to do "nasty things."

vitrupo

26,990 views • 1 year ago

If bitcoin is open source software and the code can be copied, how is it scarce?

If bitcoin is open source software and the code can be copied, how is it scarce?

Joe Burnett, MSBA

148,098 views • 1 year ago

A completely open-source AI Wearable device like Avi’s Tab, Rewind’s pendant, and Humane’s Pin! Not only is it open-source, where you can own your data and switch between foundation models, but you can actually set it up today, not in a few months (oh, and it's cheaper!)

A completely open-source AI Wearable device like Avi’s Tab, Rewind’s pendant, and Humane’s Pin! Not only is it open-source, where you can own your data and switch between foundation models, but you can actually set it up today, not in a few months (oh, and it's cheaper!)

ADAM

271,664 views • 2 years ago

Inferact cofounder Simon Mo: “I fundamentally believe that open source, especially how vLLM itself is structured, is critical to the AI infrastructure in the world. And what we want to do with Inferact is to support, maintain, steward and push forward the open source ecosystem.” “Open source moves so fast that the only way to stay ahead is adopting... And in fact this is exactly why we're staying all in on open source.” Simon Mo

Inferact cofounder Simon Mo: “I fundamentally believe that open source, especially how vLLM itself is structured, is critical to the AI infrastructure in the world. And what we want to do with Inferact is to support, maintain, steward and push forward the open source ecosystem.” “Open source moves so fast that the only way to stay ahead is adopting... And in fact this is exactly why we're staying all in on open source.” Simon Mo

a16z

29,383 views • 4 months ago

.Bill Gurley “I don’t think politicians understand how powerful open source is as a competitive weapon. If you have ten companies all doing open source, the minute an idea is shared, it's available to the other ten and they absorb it immediately. I think the odds that the U.S., with two proprietary models, can stay ahead of China, with ten open source ones, is very low.”

.Bill Gurley “I don’t think politicians understand how powerful open source is as a competitive weapon. If you have ten companies all doing open source, the minute an idea is shared, it's available to the other ten and they absorb it immediately. I think the odds that the U.S., with two proprietary models, can stay ahead of China, with ten open source ones, is very low.”

Codie Sanchez

65,669 views • 2 months ago

Today we are pleased to announce the release of proxy-lite-3b, the first in a series of open source releases happening over the coming weeks. proxy-lite-3b is the first small open weights model that performs well on ui navigation tasks - beating all other open source models so far.

Today we are pleased to announce the release of proxy-lite-3b, the first in a series of open source releases happening over the coming weeks. proxy-lite-3b is the first small open weights model that performs well on ui navigation tasks - beating all other open source models so far.

Convergence

276,962 views • 1 year ago

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”

The All-In Podcast

387,223 views • 7 months ago

✌️ Welp, we’ve received our 100,000th star on GitHub. We’d like to thank you, the open source community, for your love, support, contributions, and impeccable taste. So, how did we do it? Here’s our guide to building super popular open source software.

✌️ Welp, we’ve received our 100,000th star on GitHub. We’d like to thank you, the open source community, for your love, support, contributions, and impeccable taste. So, how did we do it? Here’s our guide to building super popular open source software.

Charm

23,108 views • 2 years ago

You don't need to pay $200 for AI. We're launching Open Operator - an open source reference project that shows how easy it is to add web browsing capabilities to your existing AI tool. It's early, slow, and might not work everywhere. But it's free and open source! 🔗👇

You don't need to pay $200 for AI. We're launching Open Operator - an open source reference project that shows how easy it is to add web browsing capabilities to your existing AI tool. It's early, slow, and might not work everywhere. But it's free and open source! 🔗👇

Paul Klein IV

349,171 views • 1 year ago

ELON MUSK: DON’T TAKE ANYONE’S OPINION….GO TO THE SOURCE MATERIAL AND COMMUNITY NOTES TO SEE WHAT REALLY HAPPENED As soon as any company steps out of line and is willing to actually have the truth debated on their platform, it forces the other platforms to allow things to be more truthful, to not censor. Because their censorship becomes glaringly obvious And, you know, the best thing I found as a rebuttal, like if somebody, if there's a hoax, is just go to the source material. You know, if you think if somebody thinks, you know, it's, you know, Trump said that we should put Liz Cheney in a firing squad, I'm like, let me send you a link to X so you can watch his video. That's the best way. Don't take my opinion for it. Don't take anyone's opinion for it. Go to the source material and Community Notes Yes, and Community Notes is awesome. It's incredible because everybody gets checked, including me. And with Community Notes, all the software is open source, and all the data is open source, so you can recreate any given note independently. That's amazing. Yeah. That's how it should be. Total absolute transparency in every way Sometimes I get asked like, 'Elon, can you remove a note?' You know, mostly by the left, but sometimes by the right. I'm like, I don't even remove notes on my own account. Nothing. And, and by the way, everything is totally open. So if I did that, it would stick out like a sore thumb immediately. Like it's not going to be subtle That is the best counter to misinformation. Yes, absolutely. Like let everybody look at it and say, 'Okay, here's what the actual facts say.' Yes, exactly. The counter to misinformation is better information Not just that, but having it checked in real-time by the community. So you have millions of people that can go over it and debate whether or not this is true or that's true. Yes, and, and like I said, the best way to understand the truth of things is don't take anyone's opinion for it. Look at the source material Look at what someone actually said, look at what someone actually did, look at the real videos of the situation, and then you'll actually know what's real

ELON MUSK: DON’T TAKE ANYONE’S OPINION….GO TO THE SOURCE MATERIAL AND COMMUNITY NOTES TO SEE WHAT REALLY HAPPENED As soon as any company steps out of line and is willing to actually have the truth debated on their platform, it forces the other platforms to allow things to be more truthful, to not censor. Because their censorship becomes glaringly obvious And, you know, the best thing I found as a rebuttal, like if somebody, if there's a hoax, is just go to the source material. You know, if you think if somebody thinks, you know, it's, you know, Trump said that we should put Liz Cheney in a firing squad, I'm like, let me send you a link to X so you can watch his video. That's the best way. Don't take my opinion for it. Don't take anyone's opinion for it. Go to the source material and Community Notes Yes, and Community Notes is awesome. It's incredible because everybody gets checked, including me. And with Community Notes, all the software is open source, and all the data is open source, so you can recreate any given note independently. That's amazing. Yeah. That's how it should be. Total absolute transparency in every way Sometimes I get asked like, 'Elon, can you remove a note?' You know, mostly by the left, but sometimes by the right. I'm like, I don't even remove notes on my own account. Nothing. And, and by the way, everything is totally open. So if I did that, it would stick out like a sore thumb immediately. Like it's not going to be subtle That is the best counter to misinformation. Yes, absolutely. Like let everybody look at it and say, 'Okay, here's what the actual facts say.' Yes, exactly. The counter to misinformation is better information Not just that, but having it checked in real-time by the community. So you have millions of people that can go over it and debate whether or not this is true or that's true. Yes, and, and like I said, the best way to understand the truth of things is don't take anyone's opinion for it. Look at the source material Look at what someone actually said, look at what someone actually did, look at the real videos of the situation, and then you'll actually know what's real

X Freeze

589,152 views • 6 months ago

iOS support for Tether's upcoming AI runtime works well now. Translations are fully local, fully private. Model's weights are downloaded from P2P network (Holepunch) the first time you use the app. Unstoppable, resilient. Write code once in JavaScript ( ) and run it everywhere, on any device. Marian, Llama and Whisper fully supported. Can't wait to open source it.

iOS support for Tether's upcoming AI runtime works well now. Translations are fully local, fully private. Model's weights are downloaded from P2P network (Holepunch) the first time you use the app. Unstoppable, resilient. Write code once in JavaScript ( ) and run it everywhere, on any device. Marian, Llama and Whisper fully supported. Can't wait to open source it.

Paolo Ardoino 🤖

74,039 views • 1 year ago

FROM THE LIVE SHOW: Matt Hicks (Matt Hicks), President & CEO of Red Hat, on open source and collaboration. "I love the model that open source provides because it provides this incredible collaboration." "This is why we're passionate about smaller models, because they allow that collaborative, open source ethos to thrive a little bit better than the frontier models."

FROM THE LIVE SHOW: Matt Hicks (Matt Hicks), President & CEO of Red Hat, on open source and collaboration. "I love the model that open source provides because it provides this incredible collaboration." "This is why we're passionate about smaller models, because they allow that collaborative, open source ethos to thrive a little bit better than the frontier models."

Forward Future

12,538 views • 8 months ago

Local. Open weights. Native 4K. LTX-2 is now a 100% Open Source AI video model, and I tested it on my rig! Installation, VRAM usage, and the prompts I used for this video, below 👇

Local. Open weights. Native 4K. LTX-2 is now a 100% Open Source AI video model, and I tested it on my rig! Installation, VRAM usage, and the prompts I used for this video, below 👇

TechHalla

34,466 views • 5 months ago

Dario Amodei just dismantled the biggest myth in the AI industry. Open source AI isn’t free. It never was. Amodei: “It’s not free. You have to run it on inference and someone has to make it fast on inference.” For decades, open source meant something real. It meant a teenager in a basement could download the same tools as a Fortune 500 company. Could read the code. Could modify it. Could build something that competed with the giants. That was genuine democratization. That actually happened. AI is different. Fundamentally. Physically. In ways the ideology hasn’t caught up to yet. Downloading the weights is the easy part. The part that actually costs something is turning the weights into a running system. Into responses. Into intelligence operating in real time at scale. That requires compute. Power. Infrastructure. The kind measured in billions of dollars and years of construction. Amodei: “These are big models. They’re hard to do inference on. Ultimately you have to host it on the cloud. The people who host it on the cloud do inference.” The open source debate was never about who owns the model. It was always about who owns the cloud. And Amodei goes further. When a competitor drops a new open model, he doesn’t ask whether it’s open or closed. He doesn’t care about the licensing. He doesn’t engage the ideology. Amodei: “I don’t think it mattered that DeepSeek is open source. I think I ask, is it a good model? Is it better than us at the things that matter? That’s the only thing that I care about.” That’s the ruthless clarity of someone actually trying to win. While the media debates licensing frameworks, Amodei is asking one question. Is it better. Everything else is a distraction. Amodei: “I don’t think open source works the same way in AI that it has worked in other areas. Here we can’t see inside the model.” This isn’t Linux. You can’t read it. You can’t fork it. You can’t understand it the way generations of developers understood the tools they inherited. You can download it. And then you need a data center to run it. The teenager in the basement who was supposed to be empowered by this revolution needs a billion dollars of infrastructure before the empowerment starts. The era of the basement coder rewriting civilization on a laptop is over. The future belongs to whoever commands the compute, owns the power grid, and can actually turn the intelligence on. Open weights without infrastructure isn’t democratization. It’s a promise the physics of the universe won’t let us keep.

Dario Amodei just dismantled the biggest myth in the AI industry. Open source AI isn’t free. It never was. Amodei: “It’s not free. You have to run it on inference and someone has to make it fast on inference.” For decades, open source meant something real. It meant a teenager in a basement could download the same tools as a Fortune 500 company. Could read the code. Could modify it. Could build something that competed with the giants. That was genuine democratization. That actually happened. AI is different. Fundamentally. Physically. In ways the ideology hasn’t caught up to yet. Downloading the weights is the easy part. The part that actually costs something is turning the weights into a running system. Into responses. Into intelligence operating in real time at scale. That requires compute. Power. Infrastructure. The kind measured in billions of dollars and years of construction. Amodei: “These are big models. They’re hard to do inference on. Ultimately you have to host it on the cloud. The people who host it on the cloud do inference.” The open source debate was never about who owns the model. It was always about who owns the cloud. And Amodei goes further. When a competitor drops a new open model, he doesn’t ask whether it’s open or closed. He doesn’t care about the licensing. He doesn’t engage the ideology. Amodei: “I don’t think it mattered that DeepSeek is open source. I think I ask, is it a good model? Is it better than us at the things that matter? That’s the only thing that I care about.” That’s the ruthless clarity of someone actually trying to win. While the media debates licensing frameworks, Amodei is asking one question. Is it better. Everything else is a distraction. Amodei: “I don’t think open source works the same way in AI that it has worked in other areas. Here we can’t see inside the model.” This isn’t Linux. You can’t read it. You can’t fork it. You can’t understand it the way generations of developers understood the tools they inherited. You can download it. And then you need a data center to run it. The teenager in the basement who was supposed to be empowered by this revolution needs a billion dollars of infrastructure before the empowerment starts. The era of the basement coder rewriting civilization on a laptop is over. The future belongs to whoever commands the compute, owns the power grid, and can actually turn the intelligence on. Open weights without infrastructure isn’t democratization. It’s a promise the physics of the universe won’t let us keep.

Dustin

627,092 views • 3 months ago

Databricks CEO Ali Ghodsi describes the difficulties of building a business around open source: "You have to hit two home runs, consecutively." "Your first home run - and you're banking on hitting that home run - is that your open source project takes over the world. Everybody wants to download it." If you don't hit that home run, Ali says, you just shot yourself in the foot. You just gave away your IP and got nothing back for it. But even if you hit this home run, you still don't have a monetizable business. You still can't make any money. So you have to hit the second home run: "You need a 10x innovation on top of the open source. That's the proprietary value you'll provide companies. That's why they'll come to you. Otherwise, they can get the open source anywhere." If you don't hit the second home run, the hyperscalers pick up your open source model, and they offer it for almost-free. "Getting into open source and monetizing is not an easy sport. Preferably don't get into it, because you might get hurt."

Databricks CEO Ali Ghodsi describes the difficulties of building a business around open source: "You have to hit two home runs, consecutively." "Your first home run - and you're banking on hitting that home run - is that your open source project takes over the world. Everybody wants to download it." If you don't hit that home run, Ali says, you just shot yourself in the foot. You just gave away your IP and got nothing back for it. But even if you hit this home run, you still don't have a monetizable business. You still can't make any money. So you have to hit the second home run: "You need a 10x innovation on top of the open source. That's the proprietary value you'll provide companies. That's why they'll come to you. Otherwise, they can get the open source anywhere." If you don't hit the second home run, the hyperscalers pick up your open source model, and they offer it for almost-free. "Getting into open source and monetizing is not an easy sport. Preferably don't get into it, because you might get hurt."

TBPN

45,287 views • 5 months ago

ELON: CHINA HAS THE BEST OPEN SOURCE AI MODELS RIGHT NOW “The best open source models are generally from China, which is bizarre. I think the second best one, or maybe it’s better than second best, is Grok 2.5. The open source model is actually very good, and we will continue to open source our models.” Source: The All-In Podcast

ELON: CHINA HAS THE BEST OPEN SOURCE AI MODELS RIGHT NOW “The best open source models are generally from China, which is bizarre. I think the second best one, or maybe it’s better than second best, is Grok 2.5. The open source model is actually very good, and we will continue to open source our models.” Source: The All-In Podcast

Mario Nawfal

1,163,582 views • 7 months ago

ELON: EVEN OPEN-SOURCE AI IS GETTING BETTER HUMAN TESTS THAN HUMANS "We're getting to the point where even open-source AI can pass human captcha tests: 'Are you a human? Identify all the traffic lights in this picture.' You're like, okay, it's going to have no problem doing that. In fact, it'll do it better than a human and faster than a human. So, at the point at which it's better passing human tests than humans, then, what tests actually make sense?" Source: Interview with Rishi Sunak, November 2023

ELON: EVEN OPEN-SOURCE AI IS GETTING BETTER HUMAN TESTS THAN HUMANS "We're getting to the point where even open-source AI can pass human captcha tests: 'Are you a human? Identify all the traffic lights in this picture.' You're like, okay, it's going to have no problem doing that. In fact, it'll do it better than a human and faster than a human. So, at the point at which it's better passing human tests than humans, then, what tests actually make sense?" Source: Interview with Rishi Sunak, November 2023

Mario Nawfal

42,071 views • 1 year ago