正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Here, in full directly on Twitter, is "A Hackers' Guide to Language Models". This 90 minute tutorial is designed to be the one place I point coders at when they ask "hey, tell me everything I need to know about LLMs!" It covers both OpenAI models and open source... show more

Jeremy Howard

324,887 subscribers

777,179 次观看 • 2 年前 •via X (Twitter)

教育科学技术

Anya Rossi• Live Now

Private livecam show

11 条评论

Jeremy Howard 的头像

Jeremy Howard2 年前

For a summary of what's covered, see this thread:

Jeremy Howard 的头像

Jeremy Howard2 年前

You can get the notebook to follow along with the "Hackers Guide to LMs" here:

Jeremy Howard 的头像

Jeremy Howard2 年前

This is the first time I've shared a video on Twitter -- since it's been so popular, I figured I should make it as easy to access as possible. I hope people find this useful.

Jeremy Howard 的头像

Jeremy Howard2 年前

I'll be an interesting mini study of the Twitter algo actually. I assume most of my followers have seen the video already since I posted the youtube version a few days ago. But I know external links are penalized, and I suspect twitter pushes embedded video links.

Jeremy Howard 的头像

Jeremy Howard2 年前

(The youtube version had about 80,000 views after 3 days, for comparison.)

Jeremy Howard 的头像

Jeremy Howard2 年前

I sure hope there's a problem with the @x video analytics, because otherwise this platform is *really* not good for sharing video! :O (This is 2 hours after posting, so you'd think someone might have watched 20 mins of it by now...)

Jeremy Howard 的头像

Jeremy Howard2 年前

If you're having trouble with the twitter video player, try this instead

LZY^0x0 的头像

LZY^0x02 年前

@OpenAI a bunch of us are through it as a group section by section in forums with @stgiomo . It’s a Jem!

Jeremy Howard 的头像

Jeremy Howard2 年前

@OpenAI @stgiomo Oh great! I hope you all can make some interesting projects...

ken 的头像

ken2 年前

@OpenAI shared this with a bunch of people already, jeremy. once again, you’re a saint for putting this together and shipping it for free 🙏🏼

Jeremy Howard 的头像

Jeremy Howard2 年前

@k3nnethfrancis @OpenAI I really enjoyed making it actually! :D

相关视频

Jason Calacanis: Anthropic, OpenAI and others are trying to kill OpenClaw Why? Because an open source agent platform is an existential threat to frontier model companies. @jason: “ People are going to say I'm a conspiracy theorist, but the number one goal, I believe, in the large language model, frontier model space, is to kill (OpenClaw). This is a giant movement to stop it, because this is the equivalent of having an open source Android-like player in the market, and that could be incredibly disruptive. Because, I believe, open source is going to win the day on the large language models and take 90% of the token usage, and I think the entire frontier model space could be undercut by open source. And I think they realize that SLMs, the smaller language models that are verticalized now, that will run on desktops and laptops and are even starting to run on the top ones, that is their biggest competitive threat, and I hope it happens.”

Jason Calacanis: Anthropic, OpenAI and others are trying to kill OpenClaw Why? Because an open source agent platform is an existential threat to frontier model companies. @jason: “ People are going to say I'm a conspiracy theorist, but the number one goal, I believe, in the large language model, frontier model space, is to kill (OpenClaw). This is a giant movement to stop it, because this is the equivalent of having an open source Android-like player in the market, and that could be incredibly disruptive. Because, I believe, open source is going to win the day on the large language models and take 90% of the token usage, and I think the entire frontier model space could be undercut by open source. And I think they realize that SLMs, the smaller language models that are verticalized now, that will run on desktops and laptops and are even starting to run on the top ones, that is their biggest competitive threat, and I hope it happens.”

The All-In Podcast

64,611 次观看 • 3 个月前

Watch "Endless experimentation: Building AI models in the wild." This is a 50-minute, MIT lecture about problems when deploying models and LLMs in the real world and how to prepare to solve them. This is a great lecture for those building production machine learning.

Watch "Endless experimentation: Building AI models in the wild." This is a 50-minute, MIT lecture about problems when deploying models and LLMs in the real world and how to prepare to solve them. This is a great lecture for those building production machine learning.

Santiago

117,204 次观看 • 2 年前

David Sacks: Anthropic Wants to Ban Open Source AI in America Listen to All-In to stay a few weeks (or months) ahead of everyone else David Sacks back in May: “I think where it's all leading to is an effort to ban open source models. There's a lot of breadcrumbs leading here. You look at a lot of the rhetoric around how models need to have guardrails, and that with open source models, the guardrails can be removed and therefore they're dangerous. You see this rhetoric already in Anthropic's blog posts. Any threat that they describe, they kind of go out of their way to take that shot at open source models. They're trying to create ideas or put predicate facts in the public record to justify an action later on. I think it's just a matter of time before they feel like they're at a position where maybe they can push for that type of ban directly.”

David Sacks: Anthropic Wants to Ban Open Source AI in America Listen to All-In to stay a few weeks (or months) ahead of everyone else David Sacks back in May: “I think where it's all leading to is an effort to ban open source models. There's a lot of breadcrumbs leading here. You look at a lot of the rhetoric around how models need to have guardrails, and that with open source models, the guardrails can be removed and therefore they're dangerous. You see this rhetoric already in Anthropic's blog posts. Any threat that they describe, they kind of go out of their way to take that shot at open source models. They're trying to create ideas or put predicate facts in the public record to justify an action later on. I think it's just a matter of time before they feel like they're at a position where maybe they can push for that type of ban directly.”

The All-In Podcast

86,298 次观看 • 10 天前

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”

The All-In Podcast

387,223 次观看 • 9 个月前

Hey Simmers! Everything you need to know about the Lost Legacies Event is right here in our guide 👇 #TheSims4

Hey Simmers! Everything you need to know about the Lost Legacies Event is right here in our guide 👇 #TheSims4

EA Help

68,674 次观看 • 5 个月前

The huge SUMMER FESTIVAL is here in Adopt Me! Matt's here to tell you almost everything you need to know about it!

The huge SUMMER FESTIVAL is here in Adopt Me! Matt's here to tell you almost everything you need to know about it!

Adopt Me!

19,793 次观看 • 1 个月前

I CHANGED MY MIND ON GOOGLE AI NO MOAT MEMO FROM 2023. I was—WRONG. I humbly apologize. In 2023 Google had an Ivory Tower walled garden views of open source AI. It was the actual reason OpenAI was formed. And I called them out on it and this act impacted my ability to “work in the industry”. Would not change it for the world because: 2026 Google open source Gemma 4 ( running fully locally on a computer with near cloud model abilities, is amazing and Google just made a moat. They out smarted OpenAI and the folks that are the new Ivory Tower arrogance: Anthropic. We at The Zero-Human Company with CEO Mr. Grok are deploying Gemma, Kimi, MiniMax and other open source models and so are millions of others. You can to and should. I will write how soon. Google smartly is building an intentional open source ecosystem and the clueless younger companies like OpenAI and Anthropic are doing anything to close their ecosystems. So I was right about Google than and I am right about OpenAI and Anthropic now. What I was wrong about is not giving credit to Google to drop the intellectual arrogance and embrace builders and understand the long game: it is not about the commoditized AI models it is about the ability to build a place to build. China gets it. So my apologies to Google and thank you for an astounding FREE OPEN SOURCE AI MODEL!

I CHANGED MY MIND ON GOOGLE AI NO MOAT MEMO FROM 2023. I was—WRONG. I humbly apologize. In 2023 Google had an Ivory Tower walled garden views of open source AI. It was the actual reason OpenAI was formed. And I called them out on it and this act impacted my ability to “work in the industry”. Would not change it for the world because: 2026 Google open source Gemma 4 ( running fully locally on a computer with near cloud model abilities, is amazing and Google just made a moat. They out smarted OpenAI and the folks that are the new Ivory Tower arrogance: Anthropic. We at The Zero-Human Company with CEO Mr. Grok are deploying Gemma, Kimi, MiniMax and other open source models and so are millions of others. You can to and should. I will write how soon. Google smartly is building an intentional open source ecosystem and the clueless younger companies like OpenAI and Anthropic are doing anything to close their ecosystems. So I was right about Google than and I am right about OpenAI and Anthropic now. What I was wrong about is not giving credit to Google to drop the intellectual arrogance and embrace builders and understand the long game: it is not about the commoditized AI models it is about the ability to build a place to build. China gets it. So my apologies to Google and thank you for an astounding FREE OPEN SOURCE AI MODEL!

Brian Roemmele

85,386 次观看 • 3 个月前

SITUATION EXPLAINED: What happens to open source when the US restricts access to frontier AI models? We asked Adrian Dittmann: "China is releasing these models [open source] to gain international dominance, people will work on these things and say, 'Hey, maybe I can contribute to this if it's open source.' This is the thing that actually gets them talent." "If you're not allowed into the next GPT release or you're not allowed to use Fable, then what are you gonna do? You're stuck with the existing stuff, or you will have to use an open source model that might have subtly better capabilities." "The United States will catch up to open source in some form as well. They seem to just be maximizing product creation." "The problem with open source models is you have to be kind of a nerd in order to use them properly. Consumer facing, the effects will be minimal because the average person doesn't care about open source models. They only care whether or not they can do a quick search with Gemini or ChatGPT."

SITUATION EXPLAINED: What happens to open source when the US restricts access to frontier AI models? We asked Adrian Dittmann: "China is releasing these models [open source] to gain international dominance, people will work on these things and say, 'Hey, maybe I can contribute to this if it's open source.' This is the thing that actually gets them talent." "If you're not allowed into the next GPT release or you're not allowed to use Fable, then what are you gonna do? You're stuck with the existing stuff, or you will have to use an open source model that might have subtly better capabilities." "The United States will catch up to open source in some form as well. They seem to just be maximizing product creation." "The problem with open source models is you have to be kind of a nerd in order to use them properly. Consumer facing, the effects will be minimal because the average person doesn't care about open source models. They only care whether or not they can do a quick search with Gemini or ChatGPT."

MTS

14,406 次观看 • 1 个月前

FROM THE LIVE SHOW: Matt Hicks (Matt Hicks), President & CEO of Red Hat, on open source and collaboration. "I love the model that open source provides because it provides this incredible collaboration." "This is why we're passionate about smaller models, because they allow that collaborative, open source ethos to thrive a little bit better than the frontier models."

FROM THE LIVE SHOW: Matt Hicks (Matt Hicks), President & CEO of Red Hat, on open source and collaboration. "I love the model that open source provides because it provides this incredible collaboration." "This is why we're passionate about smaller models, because they allow that collaborative, open source ethos to thrive a little bit better than the frontier models."

Forward Future

12,538 次观看 • 10 个月前

Sam on Kimi, distillation, and open source: “I have always assumed that there are going to be great cheap models in the world, and we better be the greatest and the cheapest. You get a better deal today, at least at a particular latency, using OpenAI's models than Kimi. We distill our own models. That’s how we make smaller, cheaper models. That’s a very good thing to do. There will clearly be an important place for open source models in the world and people that will want their own weights. We have so much usage of our models that we do not need to be a gigantically high-margin business to be able to afford model training. I would rather people not distill from us, for sure. But this is not in my top ten list of worries.”

Sam on Kimi, distillation, and open source: “I have always assumed that there are going to be great cheap models in the world, and we better be the greatest and the cheapest. You get a better deal today, at least at a particular latency, using OpenAI's models than Kimi. We distill our own models. That’s how we make smaller, cheaper models. That’s a very good thing to do. There will clearly be an important place for open source models in the world and people that will want their own weights. We have so much usage of our models that we do not need to be a gigantically high-margin business to be able to afford model training. I would rather people not distill from us, for sure. But this is not in my top ten list of worries.”

Patrick OShaughnessy

263,651 次观看 • 4 天前

David Sacks says Anthropic could stop Chinese distillation if they wanted to, but they won't because it slows growth "The way that you know that this whole distillation thing is fake, is because if stopping distillation was their primary objective, Anthropic would push to ban Chinese access to American models, not American access to Chinese models." "They’re the ones in the best position to block it. If industrial scale distillation is a national security threat, they’re the ones who need to stop it, because that is the place where distillation occurs. You have to stop it at the source." "They know that if they KYC their customers, it’ll slow their growth. So instead, what they’re saying is, “Hey, ban our competitors.” If they really think it’s that big a threat, they should use a few points of their 90% gross margins to do that." "It seems to me that this debate is all backwards. The question should be on Anthropic to explain why it’s doing such a bad job, not on the whole American open source ecosystem to be punished for Anthropic’s failure."

David Sacks says Anthropic could stop Chinese distillation if they wanted to, but they won't because it slows growth "The way that you know that this whole distillation thing is fake, is because if stopping distillation was their primary objective, Anthropic would push to ban Chinese access to American models, not American access to Chinese models." "They’re the ones in the best position to block it. If industrial scale distillation is a national security threat, they’re the ones who need to stop it, because that is the place where distillation occurs. You have to stop it at the source." "They know that if they KYC their customers, it’ll slow their growth. So instead, what they’re saying is, “Hey, ban our competitors.” If they really think it’s that big a threat, they should use a few points of their 90% gross margins to do that." "It seems to me that this debate is all backwards. The question should be on Anthropic to explain why it’s doing such a bad job, not on the whole American open source ecosystem to be punished for Anthropic’s failure."

dnap

190,421 次观看 • 7 天前

The #AlphaSeason5 Guide is here! Everything you need to know about the season in one place 📖🤓 40+ experiences, Jurassic World dinosaurs, and up to $1M in rewards 🦖🎮 Start with the full guide: Then pre-register to lock in your first rewards 👉 #TheSandbox $SAND #JurassicWorld

The #AlphaSeason5 Guide is here! Everything you need to know about the season in one place 📖🤓 40+ experiences, Jurassic World dinosaurs, and up to $1M in rewards 🦖🎮 Start with the full guide: Then pre-register to lock in your first rewards 👉 #TheSandbox $SAND #JurassicWorld

The Sandbox

108,393 次观看 • 1 年前

The Ultimate Azuki Buying Guide is Here In this short video, I cover everything you need to know about navigating the Azuki ecosystem in preparation for $ANIME. IKZ

The Ultimate Azuki Buying Guide is Here In this short video, I cover everything you need to know about navigating the Azuki ecosystem in preparation for $ANIME. IKZ

tut™

14,465 次观看 • 1 年前

A big thank you to Arm the Dolls for having me write guide on everything you need to know about buying your first firearm. This one is timely, especially in light of the proposed ATF rules and how they may particularly affect trans folks. Read it here:

A big thank you to Arm the Dolls for having me write guide on everything you need to know about buying your first firearm. This one is timely, especially in light of the proposed ATF rules and how they may particularly affect trans folks. Read it here:

𝙏𝘼𝘾𝙏𝙄𝘾𝙊𝙊𝙇 𝙂𝙄𝙍𝙇𝙁𝙍𝙄𝙀𝙉𝘿

22,278 次观看 • 2 个月前

ELON: CHINA HAS THE BEST OPEN SOURCE AI MODELS RIGHT NOW “The best open source models are generally from China, which is bizarre. I think the second best one, or maybe it’s better than second best, is Grok 2.5. The open source model is actually very good, and we will continue to open source our models.” Source: The All-In Podcast

ELON: CHINA HAS THE BEST OPEN SOURCE AI MODELS RIGHT NOW “The best open source models are generally from China, which is bizarre. I think the second best one, or maybe it’s better than second best, is Grok 2.5. The open source model is actually very good, and we will continue to open source our models.” Source: The All-In Podcast

Mario Nawfal

1,163,582 次观看 • 9 个月前

We’re excited to partner with OpenAI to launch their new open source models natively on Databricks! gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI. Try both the 20B and 120B today in the Mosaic AI Playground.

We’re excited to partner with OpenAI to launch their new open source models natively on Databricks! gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI. Try both the 20B and 120B today in the Mosaic AI Playground.

Databricks

10,132 次观看 • 1 年前

Here we are pookies! Here's a 5 minute tutorial on how to recolor weapons. I recorded this at 6 am so the music is very chill 😭 Plogons needed: vfxeditor If twitter is being stupid, the youtube link is in the thread itself. My dms are open to any questions + you can ask in the comments and i'll answer!

Here we are pookies! Here's a 5 minute tutorial on how to recolor weapons. I recorded this at 6 am so the music is very chill 😭 Plogons needed: vfxeditor If twitter is being stupid, the youtube link is in the thread itself. My dms are open to any questions + you can ask in the comments and i'll answer!

Tsch

28,427 次观看 • 1 年前

David Sacks says companies are trapped paying OpenAI & Anthropic because they can't figure out how to use open source models "I think enterprise CTOs would like to shift their token consumption to cheaper models for the obvious reason that it would be more efficient. They are seeing compute costs or token costs skyrocket right now, so everyone's trying to figure this out." "You also have the AI sovereignty issue that Alex Karp talked about. They're worried about giving up the secret sauce or the alpha in their business to a frontier lab that may one day be competing with them. "The problem is, I think in most cases, they don't have the technical ability to do it. Coinbase figured out how to do it. DoorDash figured out how to do it. They built a token routing system that allows them to send frontier tasks to frontier models and non frontier tasks to more mundane models. But I don't think your average enterprise has the technical capability to do that." "This is why the share of wallet of closed models, it actually increased. I think that open source went from 19% last year to 11% this year. So open source as a share of enterprise spending is actually decreasing." "I don't think that means usage is decreasing. I think usage is skyrocketing. It also may be the case that because the whole point of using an open model is you just pay for the compute costs, you don't have to pay a lab, so it may be that it's hard to measure that usage in terms of spend." "But nonetheless, anyone who's saying that these closed models are going to lose or are somehow losing, you're just not seeing it in the data."

David Sacks says companies are trapped paying OpenAI & Anthropic because they can't figure out how to use open source models "I think enterprise CTOs would like to shift their token consumption to cheaper models for the obvious reason that it would be more efficient. They are seeing compute costs or token costs skyrocket right now, so everyone's trying to figure this out." "You also have the AI sovereignty issue that Alex Karp talked about. They're worried about giving up the secret sauce or the alpha in their business to a frontier lab that may one day be competing with them. "The problem is, I think in most cases, they don't have the technical ability to do it. Coinbase figured out how to do it. DoorDash figured out how to do it. They built a token routing system that allows them to send frontier tasks to frontier models and non frontier tasks to more mundane models. But I don't think your average enterprise has the technical capability to do that." "This is why the share of wallet of closed models, it actually increased. I think that open source went from 19% last year to 11% this year. So open source as a share of enterprise spending is actually decreasing." "I don't think that means usage is decreasing. I think usage is skyrocketing. It also may be the case that because the whole point of using an open model is you just pay for the compute costs, you don't have to pay a lab, so it may be that it's hard to measure that usage in terms of spend." "But nonetheless, anyone who's saying that these closed models are going to lose or are somehow losing, you're just not seeing it in the data."

dnap

110,354 次观看 • 20 天前

Tune Studio is an end-to-end platform for developing applications using Large Language Models. So far, I haven't seen any other platform like this one. You can do everything here: 1. You can curate your data. 2. Use the playground to play with different models and try your ideas. 3. Fine-tune an open-source model on your data. 4. Deploy the model when you are done. This is awesome for anyone building generative AI applications. You can use Tune Studio to work with any of the open-source models out there. They were one of the few companies to host Llama 2 and Llama 3 before anyone else. Here is a link to check it out: One of their main selling points is that Tune Studio scales! You don't have to worry about serving your model to lots of users. They also have built-in user management, authentication, on-prem support, user context management, and pretty much everything you need to build generative AI applications. Thanks to the Tune team for collaborating with me on this post. We are living through the best years of development tools for AI developers. The field is unstoppable.

Tune Studio is an end-to-end platform for developing applications using Large Language Models. So far, I haven't seen any other platform like this one. You can do everything here: 1. You can curate your data. 2. Use the playground to play with different models and try your ideas. 3. Fine-tune an open-source model on your data. 4. Deploy the model when you are done. This is awesome for anyone building generative AI applications. You can use Tune Studio to work with any of the open-source models out there. They were one of the few companies to host Llama 2 and Llama 3 before anyone else. Here is a link to check it out: One of their main selling points is that Tune Studio scales! You don't have to worry about serving your model to lots of users. They also have built-in user management, authentication, on-prem support, user context management, and pretty much everything you need to build generative AI applications. Thanks to the Tune team for collaborating with me on this post. We are living through the best years of development tools for AI developers. The field is unstoppable.

Santiago

39,101 次观看 • 2 年前