Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Here, in full directly on Twitter, is "A Hackers' Guide to Language Models". This 90 minute tutorial is designed to be the one place I point coders at when they ask "hey, tell me everything I need to know about LLMs!" It covers both OpenAI models and open source... show more

Jeremy Howard

328,179 subscribers

777,296 views • 3 years ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

11 Comments

Jeremy Howard3 years ago

For a summary of what's covered, see this thread:

Jeremy Howard3 years ago

You can get the notebook to follow along with the "Hackers Guide to LMs" here:

Jeremy Howard3 years ago

This is the first time I've shared a video on Twitter -- since it's been so popular, I figured I should make it as easy to access as possible. I hope people find this useful.

Jeremy Howard3 years ago

I'll be an interesting mini study of the Twitter algo actually. I assume most of my followers have seen the video already since I posted the youtube version a few days ago. But I know external links are penalized, and I suspect twitter pushes embedded video links.

Jeremy Howard3 years ago

(The youtube version had about 80,000 views after 3 days, for comparison.)

Jeremy Howard3 years ago

I sure hope there's a problem with the @x video analytics, because otherwise this platform is *really* not good for sharing video! :O (This is 2 hours after posting, so you'd think someone might have watched 20 mins of it by now...)

Jeremy Howard3 years ago

If you're having trouble with the twitter video player, try this instead

LZY^0x03 years ago

@OpenAI a bunch of us are through it as a group section by section in forums with @stgiomo . It’s a Jem!

Jeremy Howard3 years ago

@OpenAI @stgiomo Oh great! I hope you all can make some interesting projects...

ken3 years ago

@OpenAI shared this with a bunch of people already, jeremy. once again, you’re a saint for putting this together and shipping it for free 🙏🏼

Jeremy Howard3 years ago

@k3nnethfrancis @OpenAI I really enjoyed making it actually! :D

Related Videos

Jason Calacanis: Anthropic, OpenAI and others are trying to kill OpenClaw Why? Because an open source agent platform is an existential threat to frontier model companies. @jason: “ People are going to say I'm a conspiracy theorist, but the number one goal, I believe, in the large language model, frontier model space, is to kill (OpenClaw). This is a giant movement to stop it, because this is the equivalent of having an open source Android-like player in the market, and that could be incredibly disruptive. Because, I believe, open source is going to win the day on the large language models and take 90% of the token usage, and I think the entire frontier model space could be undercut by open source. And I think they realize that SLMs, the smaller language models that are verticalized now, that will run on desktops and laptops and are even starting to run on the top ones, that is their biggest competitive threat, and I hope it happens.”

Jason Calacanis: Anthropic, OpenAI and others are trying to kill OpenClaw Why? Because an open source agent platform is an existential threat to frontier model companies. @jason: “ People are going to say I'm a conspiracy theorist, but the number one goal, I believe, in the large language model, frontier model space, is to kill (OpenClaw). This is a giant movement to stop it, because this is the equivalent of having an open source Android-like player in the market, and that could be incredibly disruptive. Because, I believe, open source is going to win the day on the large language models and take 90% of the token usage, and I think the entire frontier model space could be undercut by open source. And I think they realize that SLMs, the smaller language models that are verticalized now, that will run on desktops and laptops and are even starting to run on the top ones, that is their biggest competitive threat, and I hope it happens.”

The All-In Podcast

64,677 views • 5 months ago

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Harper Carroll

30,392 views • 1 month ago

Watch "Endless experimentation: Building AI models in the wild." This is a 50-minute, MIT lecture about problems when deploying models and LLMs in the real world and how to prepare to solve them. This is a great lecture for those building production machine learning.

Watch "Endless experimentation: Building AI models in the wild." This is a 50-minute, MIT lecture about problems when deploying models and LLMs in the real world and how to prepare to solve them. This is a great lecture for those building production machine learning.

Santiago

117,204 views • 2 years ago

David Sacks: Anthropic Wants to Ban Open Source AI in America Listen to All-In to stay a few weeks (or months) ahead of everyone else David Sacks back in May: “I think where it's all leading to is an effort to ban open source models. There's a lot of breadcrumbs leading here. You look at a lot of the rhetoric around how models need to have guardrails, and that with open source models, the guardrails can be removed and therefore they're dangerous. You see this rhetoric already in Anthropic's blog posts. Any threat that they describe, they kind of go out of their way to take that shot at open source models. They're trying to create ideas or put predicate facts in the public record to justify an action later on. I think it's just a matter of time before they feel like they're at a position where maybe they can push for that type of ban directly.”

David Sacks: Anthropic Wants to Ban Open Source AI in America Listen to All-In to stay a few weeks (or months) ahead of everyone else David Sacks back in May: “I think where it's all leading to is an effort to ban open source models. There's a lot of breadcrumbs leading here. You look at a lot of the rhetoric around how models need to have guardrails, and that with open source models, the guardrails can be removed and therefore they're dangerous. You see this rhetoric already in Anthropic's blog posts. Any threat that they describe, they kind of go out of their way to take that shot at open source models. They're trying to create ideas or put predicate facts in the public record to justify an action later on. I think it's just a matter of time before they feel like they're at a position where maybe they can push for that type of ban directly.”

The All-In Podcast

87,353 views • 2 months ago

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”

The All-In Podcast

387,223 views • 10 months ago

Hey Simmers! Everything you need to know about the Lost Legacies Event is right here in our guide 👇 #TheSims4

Hey Simmers! Everything you need to know about the Lost Legacies Event is right here in our guide 👇 #TheSims4

EA Help

68,674 views • 7 months ago

3D Gen Studio is the best free open-source desktop application for local 3D AI workflows. You can generate, retopologize, texture and rig 3D models all locally in one place. The installation is one-click and easy to set up I made a dedicated video tutorial that can be found here 👇

3D Gen Studio is the best free open-source desktop application for local 3D AI workflows. You can generate, retopologize, texture and rig 3D models all locally in one place. The installation is one-click and easy to set up I made a dedicated video tutorial that can be found here 👇

PixelArtistry

22,572 views • 12 days ago

"Closed models are cheaper. The reason you need open models is that they give you control". - Nvidia CEO Jensen Huang "One of the things that people misunderstand about open models is this: yes, you can host them yourself, and you can build your own computer. But most people use computers in the cloud. Frankly, I think closed models are cheaper. If you do not build everything yourself, you avoid the significant cost and expertise required to train, fine-tune, maintain, guardrail, evaluate, and keep the model safe. You would also need to build or obtain the computers required to host it. So, there is nothing cheap about doing all of that yourself. The reason you need open models is that they give you control. You can adapt them for your own highly specialized use cases. I think there is a lot of misunderstanding about closed models versus open models. We felt it was important for people to understand that there is a place for both." ---- From "Bloomberg Podcasts" YouTube channel, (full video link in comment)

"Closed models are cheaper. The reason you need open models is that they give you control". - Nvidia CEO Jensen Huang "One of the things that people misunderstand about open models is this: yes, you can host them yourself, and you can build your own computer. But most people use computers in the cloud. Frankly, I think closed models are cheaper. If you do not build everything yourself, you avoid the significant cost and expertise required to train, fine-tune, maintain, guardrail, evaluate, and keep the model safe. You would also need to build or obtain the computers required to host it. So, there is nothing cheap about doing all of that yourself. The reason you need open models is that they give you control. You can adapt them for your own highly specialized use cases. I think there is a lot of misunderstanding about closed models versus open models. We felt it was important for people to understand that there is a place for both." ---- From "Bloomberg Podcasts" YouTube channel, (full video link in comment)

Rohan Paul

32,317 views • 16 days ago

The huge SUMMER FESTIVAL is here in Adopt Me! Matt's here to tell you almost everything you need to know about it!

The huge SUMMER FESTIVAL is here in Adopt Me! Matt's here to tell you almost everything you need to know about it!

Adopt Me!

20,109 views • 3 months ago

I CHANGED MY MIND ON GOOGLE AI NO MOAT MEMO FROM 2023. I was—WRONG. I humbly apologize. In 2023 Google had an Ivory Tower walled garden views of open source AI. It was the actual reason OpenAI was formed. And I called them out on it and this act impacted my ability to “work in the industry”. Would not change it for the world because: 2026 Google open source Gemma 4 ( running fully locally on a computer with near cloud model abilities, is amazing and Google just made a moat. They out smarted OpenAI and the folks that are the new Ivory Tower arrogance: Anthropic. We at The Zero-Human Company with CEO Mr. Grok are deploying Gemma, Kimi, MiniMax and other open source models and so are millions of others. You can to and should. I will write how soon. Google smartly is building an intentional open source ecosystem and the clueless younger companies like OpenAI and Anthropic are doing anything to close their ecosystems. So I was right about Google than and I am right about OpenAI and Anthropic now. What I was wrong about is not giving credit to Google to drop the intellectual arrogance and embrace builders and understand the long game: it is not about the commoditized AI models it is about the ability to build a place to build. China gets it. So my apologies to Google and thank you for an astounding FREE OPEN SOURCE AI MODEL!

I CHANGED MY MIND ON GOOGLE AI NO MOAT MEMO FROM 2023. I was—WRONG. I humbly apologize. In 2023 Google had an Ivory Tower walled garden views of open source AI. It was the actual reason OpenAI was formed. And I called them out on it and this act impacted my ability to “work in the industry”. Would not change it for the world because: 2026 Google open source Gemma 4 ( running fully locally on a computer with near cloud model abilities, is amazing and Google just made a moat. They out smarted OpenAI and the folks that are the new Ivory Tower arrogance: Anthropic. We at The Zero-Human Company with CEO Mr. Grok are deploying Gemma, Kimi, MiniMax and other open source models and so are millions of others. You can to and should. I will write how soon. Google smartly is building an intentional open source ecosystem and the clueless younger companies like OpenAI and Anthropic are doing anything to close their ecosystems. So I was right about Google than and I am right about OpenAI and Anthropic now. What I was wrong about is not giving credit to Google to drop the intellectual arrogance and embrace builders and understand the long game: it is not about the commoditized AI models it is about the ability to build a place to build. China gets it. So my apologies to Google and thank you for an astounding FREE OPEN SOURCE AI MODEL!

Brian Roemmele

85,565 views • 5 months ago

SITUATION EXPLAINED: What happens to open source when the US restricts access to frontier AI models? We asked Adrian Dittmann: "China is releasing these models [open source] to gain international dominance, people will work on these things and say, 'Hey, maybe I can contribute to this if it's open source.' This is the thing that actually gets them talent." "If you're not allowed into the next GPT release or you're not allowed to use Fable, then what are you gonna do? You're stuck with the existing stuff, or you will have to use an open source model that might have subtly better capabilities." "The United States will catch up to open source in some form as well. They seem to just be maximizing product creation." "The problem with open source models is you have to be kind of a nerd in order to use them properly. Consumer facing, the effects will be minimal because the average person doesn't care about open source models. They only care whether or not they can do a quick search with Gemini or ChatGPT."

SITUATION EXPLAINED: What happens to open source when the US restricts access to frontier AI models? We asked Adrian Dittmann: "China is releasing these models [open source] to gain international dominance, people will work on these things and say, 'Hey, maybe I can contribute to this if it's open source.' This is the thing that actually gets them talent." "If you're not allowed into the next GPT release or you're not allowed to use Fable, then what are you gonna do? You're stuck with the existing stuff, or you will have to use an open source model that might have subtly better capabilities." "The United States will catch up to open source in some form as well. They seem to just be maximizing product creation." "The problem with open source models is you have to be kind of a nerd in order to use them properly. Consumer facing, the effects will be minimal because the average person doesn't care about open source models. They only care whether or not they can do a quick search with Gemini or ChatGPT."

MTS

14,406 views • 3 months ago

The Ultimate Azuki Buying Guide is Here In this short video, I cover everything you need to know about navigating the Azuki ecosystem in preparation for $ANIME. IKZ

The Ultimate Azuki Buying Guide is Here In this short video, I cover everything you need to know about navigating the Azuki ecosystem in preparation for $ANIME. IKZ

tut™

14,468 views • 1 year ago

The #AlphaSeason5 Guide is here! Everything you need to know about the season in one place 📖🤓 40+ experiences, Jurassic World dinosaurs, and up to $1M in rewards 🦖🎮 Start with the full guide: Then pre-register to lock in your first rewards 👉 #TheSandbox $SAND #JurassicWorld

The #AlphaSeason5 Guide is here! Everything you need to know about the season in one place 📖🤓 40+ experiences, Jurassic World dinosaurs, and up to $1M in rewards 🦖🎮 Start with the full guide: Then pre-register to lock in your first rewards 👉 #TheSandbox $SAND #JurassicWorld

The Sandbox

108,393 views • 1 year ago

FROM THE LIVE SHOW: Matt Hicks (Matt Hicks), President & CEO of Red Hat, on open source and collaboration. "I love the model that open source provides because it provides this incredible collaboration." "This is why we're passionate about smaller models, because they allow that collaborative, open source ethos to thrive a little bit better than the frontier models."

FROM THE LIVE SHOW: Matt Hicks (Matt Hicks), President & CEO of Red Hat, on open source and collaboration. "I love the model that open source provides because it provides this incredible collaboration." "This is why we're passionate about smaller models, because they allow that collaborative, open source ethos to thrive a little bit better than the frontier models."

Forward Future

12,538 views • 11 months ago

A big thank you to Arm the Dolls for having me write guide on everything you need to know about buying your first firearm. This one is timely, especially in light of the proposed ATF rules and how they may particularly affect trans folks. Read it here:

A big thank you to Arm the Dolls for having me write guide on everything you need to know about buying your first firearm. This one is timely, especially in light of the proposed ATF rules and how they may particularly affect trans folks. Read it here:

𝙏𝘼𝘾𝙏𝙄𝘾𝙊𝙊𝙇 𝙂𝙄𝙍𝙇𝙁𝙍𝙄𝙀𝙉𝘿

22,856 views • 4 months ago

David Sacks says Anthropic could stop Chinese distillation if they wanted to, but they won't because it slows growth "The way that you know that this whole distillation thing is fake, is because if stopping distillation was their primary objective, Anthropic would push to ban Chinese access to American models, not American access to Chinese models." "They’re the ones in the best position to block it. If industrial scale distillation is a national security threat, they’re the ones who need to stop it, because that is the place where distillation occurs. You have to stop it at the source." "They know that if they KYC their customers, it’ll slow their growth. So instead, what they’re saying is, “Hey, ban our competitors.” If they really think it’s that big a threat, they should use a few points of their 90% gross margins to do that." "It seems to me that this debate is all backwards. The question should be on Anthropic to explain why it’s doing such a bad job, not on the whole American open source ecosystem to be punished for Anthropic’s failure."

David Sacks says Anthropic could stop Chinese distillation if they wanted to, but they won't because it slows growth "The way that you know that this whole distillation thing is fake, is because if stopping distillation was their primary objective, Anthropic would push to ban Chinese access to American models, not American access to Chinese models." "They’re the ones in the best position to block it. If industrial scale distillation is a national security threat, they’re the ones who need to stop it, because that is the place where distillation occurs. You have to stop it at the source." "They know that if they KYC their customers, it’ll slow their growth. So instead, what they’re saying is, “Hey, ban our competitors.” If they really think it’s that big a threat, they should use a few points of their 90% gross margins to do that." "It seems to me that this debate is all backwards. The question should be on Anthropic to explain why it’s doing such a bad job, not on the whole American open source ecosystem to be punished for Anthropic’s failure."

dnap

191,379 views • 2 months ago

Sam on Kimi, distillation, and open source: “I have always assumed that there are going to be great cheap models in the world, and we better be the greatest and the cheapest. You get a better deal today, at least at a particular latency, using OpenAI's models than Kimi. We distill our own models. That’s how we make smaller, cheaper models. That’s a very good thing to do. There will clearly be an important place for open source models in the world and people that will want their own weights. We have so much usage of our models that we do not need to be a gigantically high-margin business to be able to afford model training. I would rather people not distill from us, for sure. But this is not in my top ten list of worries.”

Sam on Kimi, distillation, and open source: “I have always assumed that there are going to be great cheap models in the world, and we better be the greatest and the cheapest. You get a better deal today, at least at a particular latency, using OpenAI's models than Kimi. We distill our own models. That’s how we make smaller, cheaper models. That’s a very good thing to do. There will clearly be an important place for open source models in the world and people that will want their own weights. We have so much usage of our models that we do not need to be a gigantically high-margin business to be able to afford model training. I would rather people not distill from us, for sure. But this is not in my top ten list of worries.”

Patrick OShaughnessy

270,121 views • 1 month ago

Here we are pookies! Here's a 5 minute tutorial on how to recolor weapons. I recorded this at 6 am so the music is very chill 😭 Plogons needed: vfxeditor If twitter is being stupid, the youtube link is in the thread itself. My dms are open to any questions + you can ask in the comments and i'll answer!

Here we are pookies! Here's a 5 minute tutorial on how to recolor weapons. I recorded this at 6 am so the music is very chill 😭 Plogons needed: vfxeditor If twitter is being stupid, the youtube link is in the thread itself. My dms are open to any questions + you can ask in the comments and i'll answer!

Tsch

28,427 views • 1 year ago

ELON: CHINA HAS THE BEST OPEN SOURCE AI MODELS RIGHT NOW “The best open source models are generally from China, which is bizarre. I think the second best one, or maybe it’s better than second best, is Grok 2.5. The open source model is actually very good, and we will continue to open source our models.” Source: The All-In Podcast

ELON: CHINA HAS THE BEST OPEN SOURCE AI MODELS RIGHT NOW “The best open source models are generally from China, which is bizarre. I think the second best one, or maybe it’s better than second best, is Grok 2.5. The open source model is actually very good, and we will continue to open source our models.” Source: The All-In Podcast

Mario Nawfal

1,163,582 views • 10 months ago