Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Open source software is GREAT. But "open source" AI is NOT like software - it's VERY different. Rob Miles cuts through the bullshit: ROB: Oh, hey, Meta. I heard Llama's weights leaked. That's rough, man. Information security's hard. How you holding up? META: Oh, we're great. Yeah, we're fine....

AISafetyMemes's profile picture

AI Notkilleveryoneism Memes ⏸️

143,997 subscribers

107,362 görüntüleme • 2 yıl önce •via X (Twitter)

Bilim & TeknolojiKomediEğitim
LIVE

Anya Rossi• Live Now

Private livecam show

10 Yorum

AI Notkilleveryoneism Memes ⏸️ profil fotoğrafı
AI Notkilleveryoneism Memes ⏸️2 yıl önce

Source: Rob Miles' new banger video summarizing the last year and explaining the current situation with AI safety

Rob Miles (in SF) profil fotoğrafı
Rob Miles (in SF)2 yıl önce

I'm starting to suspect the main reason for open sourcing llama is that "Best 'Open Source' LLM" is much better marketing than "6th Best LLM"

AI Notkilleveryoneism Memes ⏸️ profil fotoğrafı
AI Notkilleveryoneism Memes ⏸️2 yıl önce

It's good marketing. And many people unthinkingly cheer for anything branded 'open source' Zuck has done this many times - he convinces developers to build on his "open" platform (FB), then crushes them when economic logic dictates. (VCs stopped funding startups built on FB.)

PauseAI ⏸ profil fotoğrafı
PauseAI ⏸2 yıl önce

@robertskmiles Amazing segment. Entire video is a must-watch!

AI Notkilleveryoneism Memes ⏸️ profil fotoğrafı
AI Notkilleveryoneism Memes ⏸️2 yıl önce

@robertskmiles HE IS RISEN

Bryan Wade profil fotoğrafı
Bryan Wade2 yıl önce

@robertskmiles Ok, call it Open Weights. There are still lots of people that benefit from that. It means that I can run this stuff on my own hardware, and a for profit company can't cut me off from the technology overnight. Most of the AI startup scene only exists because of open weights.

Dirk Bruere profil fotoğrafı
Dirk Bruere2 yıl önce

@robertskmiles Illustrates that secrets cannot be kept by anyone.

Matt Prestifilippo profil fotoğrafı
Matt Prestifilippo2 yıl önce

@robertskmiles This is missing the major point that even though they don’t share the training data, it’s still expensive to produce the models. And the permissive license to use those for businesses without fees is useful.

Alex Alarga ⏹️ profil fotoğrafı
Alex Alarga ⏹️2 yıl önce

@robertskmiles

Random User profil fotoğrafı
Random User2 yıl önce

@robertskmiles I’d also highlight the aspect of learning how to code well from actual open-source.

Benzer Videolar

What does it mean when an AI model is “open weights” and how is it different than “open source”? Welcome to the next episode of the Open Model Series with merve, Hugging Face AI/ML engineer & open-sourceress! Every week we will discuss open-source & open-weight AI: what it is, how it works, and how you can run them on your own compute. Episode 3 out next week; episode 1 linked below. Please leave all your questions about open-source & open-weight AI in the comments. This is a super important topic that is novel to most people, and it can be challenging to grasp - so your questions are shared with many others.
1:02

What does it mean when an AI model is “open weights” and how is it different than “open source”? Welcome to the next episode of the Open Model Series with merve, Hugging Face AI/ML engineer & open-sourceress! Every week we will discuss open-source & open-weight AI: what it is, how it works, and how you can run them on your own compute. Episode 3 out next week; episode 1 linked below. Please leave all your questions about open-source & open-weight AI in the comments. This is a super important topic that is novel to most people, and it can be challenging to grasp - so your questions are shared with many others.

Harper Carroll

32,624 görüntüleme • 2 ay önce

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.
0:26

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Harper Carroll

30,392 görüntüleme • 3 ay önce

The open-source & open-weight frontier is 7 months behind the closed-model frontier. Let’s talk about it. Check out last week’s episode for the reasons why you might want to consider open-source & open-weight models. Welcome to the fourth episode of the Open Model Series with merve, Hugging Face AI/ML engineer & open-sourceress! We have been discussing open-source & open-weight AI: what it is, how it works, and how you can run them on your own compute. Please leave all your questions about open-source & open-weight AI in the comments! This is a super important topic that is novel to most people, and it can be challenging to grasp - so rest assured your questions are shared with many others!
1:14

The open-source & open-weight frontier is 7 months behind the closed-model frontier. Let’s talk about it. Check out last week’s episode for the reasons why you might want to consider open-source & open-weight models. Welcome to the fourth episode of the Open Model Series with merve, Hugging Face AI/ML engineer & open-sourceress! We have been discussing open-source & open-weight AI: what it is, how it works, and how you can run them on your own compute. Please leave all your questions about open-source & open-weight AI in the comments! This is a super important topic that is novel to most people, and it can be challenging to grasp - so rest assured your questions are shared with many others!

Harper Carroll

17,279 görüntüleme • 2 ay önce

If bitcoin is open source software and the code can be copied, how is it scarce?
3:13

If bitcoin is open source software and the code can be copied, how is it scarce?

Joe Burnett, MSBA

148,155 görüntüleme • 1 yıl önce

A completely open-source AI Wearable device like Avi’s Tab, Rewind’s pendant, and Humane’s Pin! Not only is it open-source, where you can own your data and switch between foundation models, but you can actually set it up today, not in a few months (oh, and it's cheaper!)
6:49

A completely open-source AI Wearable device like Avi’s Tab, Rewind’s pendant, and Humane’s Pin! Not only is it open-source, where you can own your data and switch between foundation models, but you can actually set it up today, not in a few months (oh, and it's cheaper!)

Adam

277,697 görüntüleme • 2 yıl önce

Inferact cofounder Simon Mo: “I fundamentally believe that open source, especially how vLLM itself is structured, is critical to the AI infrastructure in the world. And what we want to do with Inferact is to support, maintain, steward and push forward the open source ecosystem.” “Open source moves so fast that the only way to stay ahead is adopting... And in fact this is exactly why we're staying all in on open source.” Simon Mo
1:23

Inferact cofounder Simon Mo: “I fundamentally believe that open source, especially how vLLM itself is structured, is critical to the AI infrastructure in the world. And what we want to do with Inferact is to support, maintain, steward and push forward the open source ecosystem.” “Open source moves so fast that the only way to stay ahead is adopting... And in fact this is exactly why we're staying all in on open source.” Simon Mo

a16z

29,383 görüntüleme • 9 ay önce

.Bill Gurley “I don’t think politicians understand how powerful open source is as a competitive weapon. If you have ten companies all doing open source, the minute an idea is shared, it's available to the other ten and they absorb it immediately. I think the odds that the U.S., with two proprietary models, can stay ahead of China, with ten open source ones, is very low.”
1:48

.Bill Gurley “I don’t think politicians understand how powerful open source is as a competitive weapon. If you have ten companies all doing open source, the minute an idea is shared, it's available to the other ten and they absorb it immediately. I think the odds that the U.S., with two proprietary models, can stay ahead of China, with ten open source ones, is very low.”

Codie Sanchez

65,669 görüntüleme • 7 ay önce

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”
1:10

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”

The All-In Podcast

387,368 görüntüleme • 1 yıl önce

“We have a crisis of open source models in the Western world. Outside of China, there are no good open source models. We don't even have any in the US now. The talent, the capital and the focus to be best-in-class at pre-training, mid-training, post-training is an extremely scarce skillset. The answer for a lot of countries may just be to take an open weights model from China, post-train or fine-tune their own version, and have that be what they start from." Everett Randle Why does the West have such poor open source models and is it a national security threat to rely on open-source Chinese models Demis Hassabis Yann LeCun Aidan Gomez Lilian Weng Jan Leike
1:20

“We have a crisis of open source models in the Western world. Outside of China, there are no good open source models. We don't even have any in the US now. The talent, the capital and the focus to be best-in-class at pre-training, mid-training, post-training is an extremely scarce skillset. The answer for a lot of countries may just be to take an open weights model from China, post-train or fine-tune their own version, and have that be what they start from." Everett Randle Why does the West have such poor open source models and is it a national security threat to rely on open-source Chinese models Demis Hassabis Yann LeCun Aidan Gomez Lilian Weng Jan Leike

Harry Stebbings

63,738 görüntüleme • 4 ay önce

✌️ Welp, we’ve received our 100,000th star on GitHub. We’d like to thank you, the open source community, for your love, support, contributions, and impeccable taste. So, how did we do it? Here’s our guide to building super popular open source software.
0:24

✌️ Welp, we’ve received our 100,000th star on GitHub. We’d like to thank you, the open source community, for your love, support, contributions, and impeccable taste. So, how did we do it? Here’s our guide to building super popular open source software.

Charm

23,219 görüntüleme • 2 yıl önce

You don't need to pay $200 for AI. We're launching Open Operator - an open source reference project that shows how easy it is to add web browsing capabilities to your existing AI tool. It's early, slow, and might not work everywhere. But it's free and open source! 🔗👇
1:01

You don't need to pay $200 for AI. We're launching Open Operator - an open source reference project that shows how easy it is to add web browsing capabilities to your existing AI tool. It's early, slow, and might not work everywhere. But it's free and open source! 🔗👇

Paul Klein IV

349,578 görüntüleme • 1 yıl önce

Calling a model "open source" because you can use it is like calling a car open source because you can drive it. The real question is whether you can open the hood. Azibi Malawi from DataVLT on what openness at the model layer actually requires.
1:53

Calling a model "open source" because you can use it is like calling a car open source because you can drive it. The real question is whether you can open the hood. Azibi Malawi from DataVLT on what openness at the model layer actually requires.

Cluster Protocol

27,006 görüntüleme • 4 ay önce

Gavin Baker says open source is an absolute godsend for software companies and is the reason private equity is suddenly circling beaten-down names like Workday again. "Hey, there's one thing that broke during the show that we should talk about, and that's Silver Lake may be buying Workday. Workday's up 17%." "And if this is true, this is, I think, a significant moment for the stock market." "Software has been in a death spiral that probably troughed maybe three, four months ago, but it was in a tough spot for 12, 15, 18 months. And the return of a private equity bid for software really changes the investing landscape." "And I don't know what the potential buyers of Workday are thinking, but I do know that the rise of open source and the increasing competitiveness of open source is a godsend for the American software industry. It is an absolute godsend." "But a world where you have one, two, or three dominant frontier models, you can just see the stock went from, we'll call it $300, straight down to $100 in a really short period of time." "And even with this bid, you've only recovered a little bit." "But a world where Anthropic, OpenAI, and maybe even SpaceX are kind of the only model providers that dominate the model layer, that is a hard world for software." "If I were to guess why the private equity bid for software might be coming back, it's because they see what's happening with open source.
1:29

Gavin Baker says open source is an absolute godsend for software companies and is the reason private equity is suddenly circling beaten-down names like Workday again. "Hey, there's one thing that broke during the show that we should talk about, and that's Silver Lake may be buying Workday. Workday's up 17%." "And if this is true, this is, I think, a significant moment for the stock market." "Software has been in a death spiral that probably troughed maybe three, four months ago, but it was in a tough spot for 12, 15, 18 months. And the return of a private equity bid for software really changes the investing landscape." "And I don't know what the potential buyers of Workday are thinking, but I do know that the rise of open source and the increasing competitiveness of open source is a godsend for the American software industry. It is an absolute godsend." "But a world where you have one, two, or three dominant frontier models, you can just see the stock went from, we'll call it $300, straight down to $100 in a really short period of time." "And even with this bid, you've only recovered a little bit." "But a world where Anthropic, OpenAI, and maybe even SpaceX are kind of the only model providers that dominate the model layer, that is a hard world for software." "If I were to guess why the private equity bid for software might be coming back, it's because they see what's happening with open source.

Fireside Alpha

73,782 görüntüleme • 2 ay önce

“It is in America’s interest to actually support open source" - Aravind Srinivas when I asked him yesterday about Washington’s fear of Chinese open AI models His view: Nvidia/Nemotron can help close the gap, but the US should support open weights because affordability is what lets businesses use AI.
2:16

“It is in America’s interest to actually support open source" - Aravind Srinivas when I asked him yesterday about Washington’s fear of Chinese open AI models His view: Nvidia/Nemotron can help close the gap, but the US should support open weights because affordability is what lets businesses use AI.

Deirdre Bosa

92,537 görüntüleme • 3 ay önce

.Josh Wolfe: Anybody Using DeepSeek App Is 'Absolute Fool' "Anybody using the DeepSeek app is an absolute fool. If you're using DeepSeek on companies like Together Compute, one of Lux's companies, which can get rid of the CCP censorship, then it's probably okay. But remember, the open-source movement is something we deeply believe in. Most great technologists, entrepreneurs, and venture capitalists are on the side of open source. The closed-source models that have consumed tens of billions of dollars are the ones that are really going to be at risk. When you look at Hugging Face, a major repository, or Together Compute, Runway ML, and a lot of Lux's companies, they have been pioneers in open source. Now, why am I not worried about open source, even with the DeepSeek model? As long as you don't have the CCP censorship on it, the models with their open weights allow people to run on their proprietary data. This means companies like pharma or defense companies that have their own siloed, proprietary data—think about Bloomberg with their proprietary longitudinal data, or Meta with their data—are the ones who will have the edge. Even as open source takes hold, these companies will still dominate. I’m not worried about open source being the problem. I’m more concerned about people overfunding closed models with no proprietary source. A lot of capital is going to be burned there, and we’re already seeing that with people worried about OpenAI in some aspects."
1:27

.Josh Wolfe: Anybody Using DeepSeek App Is 'Absolute Fool' "Anybody using the DeepSeek app is an absolute fool. If you're using DeepSeek on companies like Together Compute, one of Lux's companies, which can get rid of the CCP censorship, then it's probably okay. But remember, the open-source movement is something we deeply believe in. Most great technologists, entrepreneurs, and venture capitalists are on the side of open source. The closed-source models that have consumed tens of billions of dollars are the ones that are really going to be at risk. When you look at Hugging Face, a major repository, or Together Compute, Runway ML, and a lot of Lux's companies, they have been pioneers in open source. Now, why am I not worried about open source, even with the DeepSeek model? As long as you don't have the CCP censorship on it, the models with their open weights allow people to run on their proprietary data. This means companies like pharma or defense companies that have their own siloed, proprietary data—think about Bloomberg with their proprietary longitudinal data, or Meta with their data—are the ones who will have the edge. Even as open source takes hold, these companies will still dominate. I’m not worried about open source being the problem. I’m more concerned about people overfunding closed models with no proprietary source. A lot of capital is going to be burned there, and we’re already seeing that with people worried about OpenAI in some aspects."

Josh Caplan

40,039 görüntüleme • 1 yıl önce

SITUATION EXPLAINED: What happens to open source when the US restricts access to frontier AI models? We asked Adrian Dittmann: "China is releasing these models [open source] to gain international dominance, people will work on these things and say, 'Hey, maybe I can contribute to this if it's open source.' This is the thing that actually gets them talent." "If you're not allowed into the next GPT release or you're not allowed to use Fable, then what are you gonna do? You're stuck with the existing stuff, or you will have to use an open source model that might have subtly better capabilities." "The United States will catch up to open source in some form as well. They seem to just be maximizing product creation." "The problem with open source models is you have to be kind of a nerd in order to use them properly. Consumer facing, the effects will be minimal because the average person doesn't care about open source models. They only care whether or not they can do a quick search with Gemini or ChatGPT."
2:32

SITUATION EXPLAINED: What happens to open source when the US restricts access to frontier AI models? We asked Adrian Dittmann: "China is releasing these models [open source] to gain international dominance, people will work on these things and say, 'Hey, maybe I can contribute to this if it's open source.' This is the thing that actually gets them talent." "If you're not allowed into the next GPT release or you're not allowed to use Fable, then what are you gonna do? You're stuck with the existing stuff, or you will have to use an open source model that might have subtly better capabilities." "The United States will catch up to open source in some form as well. They seem to just be maximizing product creation." "The problem with open source models is you have to be kind of a nerd in order to use them properly. Consumer facing, the effects will be minimal because the average person doesn't care about open source models. They only care whether or not they can do a quick search with Gemini or ChatGPT."

MTS

14,406 görüntüleme • 4 ay önce

David Sacks: Anthropic Is Trying to Crush Open Source AI and the American Developers Who Use It David Sacks: “I know people don't have a lot of sympathy for Chinese companies, that's fine. I'm not defending Chinese companies. I'm defending American developers who need to be able to use everything in the public domain. And let me give you an example. Cursor rolled out its new product, Composer 2. They were able to post-train that model using Kimi K2.5 on their own proprietary coding data. They started with a Chinese open source model, and then they used their own data, and they came up with a new derivative product. This is the way that open source works. You take things that are in the public domain, you fork them, you make them your own. And by the way, once it's in the public domain, it's not a Chinese model anymore. No data is going back to China, nothing's going back to China. An American company has taken open source contributions in the public domain, made it their own, and then developed their own model. And if you say that American companies can't do that, or that somehow it's tainted with IP theft, you are basically going to put a dagger through the heart of the entire American open source ecosystem. And that is exactly what Anthropic wants, because they do not want to have the competition.”
0:59

David Sacks: Anthropic Is Trying to Crush Open Source AI and the American Developers Who Use It David Sacks: “I know people don't have a lot of sympathy for Chinese companies, that's fine. I'm not defending Chinese companies. I'm defending American developers who need to be able to use everything in the public domain. And let me give you an example. Cursor rolled out its new product, Composer 2. They were able to post-train that model using Kimi K2.5 on their own proprietary coding data. They started with a Chinese open source model, and then they used their own data, and they came up with a new derivative product. This is the way that open source works. You take things that are in the public domain, you fork them, you make them your own. And by the way, once it's in the public domain, it's not a Chinese model anymore. No data is going back to China, nothing's going back to China. An American company has taken open source contributions in the public domain, made it their own, and then developed their own model. And if you say that American companies can't do that, or that somehow it's tainted with IP theft, you are basically going to put a dagger through the heart of the entire American open source ecosystem. And that is exactly what Anthropic wants, because they do not want to have the competition.”

The All-In Podcast

278,741 görüntüleme • 3 ay önce

Matt Bornstein says open source is how AI companies stop being wrappers: "A year ago, a bunch of smaller companies or new application companies were trying to figure out, 'How do I really build an AI without just being a wrapper on top of OpenAI?' The answer to that question turned out to be open source." "This is what Cursor did. This is what Decagon and Harvey are in the process of doing now. A bunch of really strong application-level startups made the determination: we can't build just on closed source." "We need to do our own mid-training, our own post-training, our own inference and deployment tricks. All of that means it must be built on top of open source. The closed-source vendors won't give you the access to do this." "Open source became really central in a way that's not always visible because it's deeply embedded in some of these products. Some of the most innovative products and applications now really depend on this very deeply." Matt Bornstein
1:15

Matt Bornstein says open source is how AI companies stop being wrappers: "A year ago, a bunch of smaller companies or new application companies were trying to figure out, 'How do I really build an AI without just being a wrapper on top of OpenAI?' The answer to that question turned out to be open source." "This is what Cursor did. This is what Decagon and Harvey are in the process of doing now. A bunch of really strong application-level startups made the determination: we can't build just on closed source." "We need to do our own mid-training, our own post-training, our own inference and deployment tricks. All of that means it must be built on top of open source. The closed-source vendors won't give you the access to do this." "Open source became really central in a way that's not always visible because it's deeply embedded in some of these products. Some of the most innovative products and applications now really depend on this very deeply." Matt Bornstein

a16z

40,604 görüntüleme • 2 ay önce