正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Finally read through Sam Rose's blog on LLM quantization. It's incredible. For many (even in tech) the understanding of how LLMs work stops at the surface level. Sam is helping us all go deeper, digging into the interesting facets of how AI models truly work. Read it!

Ben Dicken

40,843 subscribers

272,448 次观看 • 3 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

New course! Generative AI with Large Language Models, created with Amazon Web Services and hosted on Coursera. This course goes deep into the technical foundations of LLMs and how to use them. You can sign up here: You’ll work through the full life-cycle of a generative AI project, and learn specific techniques like RLHF; zero-shot, one-shot, and few-shot learning with LLMs; advanced prompting frameworks like ReAct; even fine-tuning LLMs, and gain hands-on practice with all of these techniques. Instructors Antje Barth Chris Fregly Shelbee Eigenbrode and Mike G Chambers all do incredible Generative AI work at AWS, and have supported many companies to build creative LLM applications. They bring tremendous practical LLM expertise to this course. I'm confident you’ll finish this course with a deeper understanding of how LLMs work, and how to use them. I hope you enjoy the course!

New course! Generative AI with Large Language Models, created with Amazon Web Services and hosted on Coursera. This course goes deep into the technical foundations of LLMs and how to use them. You can sign up here: You’ll work through the full life-cycle of a generative AI project, and learn specific techniques like RLHF; zero-shot, one-shot, and few-shot learning with LLMs; advanced prompting frameworks like ReAct; even fine-tuning LLMs, and gain hands-on practice with all of these techniques. Instructors Antje Barth Chris Fregly Shelbee Eigenbrode and Mike G Chambers all do incredible Generative AI work at AWS, and have supported many companies to build creative LLM applications. They bring tremendous practical LLM expertise to this course. I'm confident you’ll finish this course with a deeper understanding of how LLMs work, and how to use them. I hope you enjoy the course!

Andrew Ng

467,882 次观看 • 3 年前

The lack of understanding of how current AI/ large language models work makes us susceptible to thinking that AI is more powerful and all-knowing than it actually is. That’s what concerns me the most.

The lack of understanding of how current AI/ large language models work makes us susceptible to thinking that AI is more powerful and all-knowing than it actually is. That’s what concerns me the most.

Sinead Bovell

143,642 次观看 • 3 年前

The age of AI agents is here. Models can read, see, talk, and now, even use a computer— all by themselves. One of the first out of the gates is Anthropic’s Claude Computer Use. YC's Garry Tan dives into how it works, what it can do, and how it may change AI forever.

The age of AI agents is here. Models can read, see, talk, and now, even use a computer— all by themselves. One of the first out of the gates is Anthropic’s Claude Computer Use. YC's Garry Tan dives into how it works, what it can do, and how it may change AI forever.

Y Combinator

265,897 次观看 • 1 年前

The Sam Altman Interview You know him as the CEO of OpenAI — but he's also an avid writer. We spoke not once but twice about how Sam captures ideas, clarifies his thinking, edits his writing, decides what to work on, and uses ChatGPT. Timestamps: 1:47 Will LLMs change how we write? 8:39 How does Sam use ChatGPT? 11:26 How Sam became less anxious 17:24 Sam once dreamed of being a novelist 18:37 Lessons from Peter Thiel 21:35 Lessons from Paul Graham 26:02 The book Sam Altman wants to write 28:37 Advice for startup founders 30:20 How Y Combinator shapes OpenAI 35:55 How Sam chose to work on AGI 37:35 Writing strategy memos at OpenAI 41:34 Why isn’t ChatGPT a better storyteller? 44:20 Sam's obsessive note-taking method 47:12 Will AI put writers out of work?

The Sam Altman Interview You know him as the CEO of OpenAI — but he's also an avid writer. We spoke not once but twice about how Sam captures ideas, clarifies his thinking, edits his writing, decides what to work on, and uses ChatGPT. Timestamps: 1:47 Will LLMs change how we write? 8:39 How does Sam use ChatGPT? 11:26 How Sam became less anxious 17:24 Sam once dreamed of being a novelist 18:37 Lessons from Peter Thiel 21:35 Lessons from Paul Graham 26:02 The book Sam Altman wants to write 28:37 Advice for startup founders 30:20 How Y Combinator shapes OpenAI 35:55 How Sam chose to work on AGI 37:35 Writing strategy memos at OpenAI 41:34 Why isn’t ChatGPT a better storyteller? 44:20 Sam's obsessive note-taking method 47:12 Will AI put writers out of work?

David Perell

239,660 次观看 • 1 年前

🚨 We’re hiring in NYC!!! 🚨 We’re looking for curious minds with a dash of explorer and a lot of grit. If you want to work on truly frontier AI (not just an LLM wrapper) and deploy it in some of the most interesting places in the world – join us in the Arena! Apply for open roles here:

🚨 We’re hiring in NYC!!! 🚨 We’re looking for curious minds with a dash of explorer and a lot of grit. If you want to work on truly frontier AI (not just an LLM wrapper) and deploy it in some of the most interesting places in the world – join us in the Arena! Apply for open roles here:

Pratap Ranade

17,520 次观看 • 2 年前

"How many times does [Sam Darnold] have to win a game for us to give him the benefit of the doubt?" Peter Schrager and Stephen A Smith disagree on how much they believe in Sam Darnold 🍿

"How many times does [Sam Darnold] have to win a game for us to give him the benefit of the doubt?" Peter Schrager and Stephen A Smith disagree on how much they believe in Sam Darnold 🍿

First Take

75,858 次观看 • 8 个月前

It's amazing to see how many leftists - and even folks on the right - who have absolutely zero understanding of what modern manufacturing looks like. Yes, it's work boots and dirty hands. It's also machine learning, AI algorithms, statistics, and high level thinking. We are the Military Industrial Complex, and we are made in America.

It's amazing to see how many leftists - and even folks on the right - who have absolutely zero understanding of what modern manufacturing looks like. Yes, it's work boots and dirty hands. It's also machine learning, AI algorithms, statistics, and high level thinking. We are the Military Industrial Complex, and we are made in America.

Feni𝕏 Ammunition

98,332 次观看 • 1 年前

Announcing How Transformer LLMs Work, created with Jay Alammar and Maarten Grootendorst, co-authors of the beautifully illustrated book, “Hands-On Large Language Models.” This course offers a deep dive into the inner workings of the transformer architecture that powers large language models (LLMs). The transformer architecture revolutionized generative AI; in fact, the "GPT" in ChatGPT stands for "Generative Pre-Trained Transformer." Originally introduced in the Google Brain team's groundbreaking 2017 paper "Attention Is All You Need," by Vaswani and others, transformers were a highly scalable model for machine translation tasks. Variants of this architecture now power today’s LLMs such as those from OpenAI, Google, Meta, Cohere, Anthropic and DeepSeek. In this course, you’ll learn in detail how LLMs process text. You'll also work through code examples that illustrate that transformer's individual components. In details, you’ll learn: - How the representation of language has evolved, from Bag-of-Words to Word2Vec embeddings to the transformer architecture that captures a word's meanings taking into account the context of other words in the input. - How inputs are broken down into tokens before they are sent to the language model. - The details of a transformer's main stages: Tokenization and embedding, the stack of transformer blocks, and the language model head. - The inner workings of the transformer block, including attention, which calculates relevance scores, and the feedforward layer, which incorporates stored information learned in training. - How cached calculations make transformers faster. - Some of the most recent ideas in the latest models such as Mixture-of-Experts (MoE) which uses multiple sub-models and a router on each layer to improve the quality of LLMs. By the end of this course, you’ll have a deep understanding of how LLMs actually process text and be able to read through papers describing the latest models and understand the details. Gaining this intuition will improve your approach to building LLM applications. Please sign up here:

Announcing How Transformer LLMs Work, created with Jay Alammar and Maarten Grootendorst, co-authors of the beautifully illustrated book, “Hands-On Large Language Models.” This course offers a deep dive into the inner workings of the transformer architecture that powers large language models (LLMs). The transformer architecture revolutionized generative AI; in fact, the "GPT" in ChatGPT stands for "Generative Pre-Trained Transformer." Originally introduced in the Google Brain team's groundbreaking 2017 paper "Attention Is All You Need," by Vaswani and others, transformers were a highly scalable model for machine translation tasks. Variants of this architecture now power today’s LLMs such as those from OpenAI, Google, Meta, Cohere, Anthropic and DeepSeek. In this course, you’ll learn in detail how LLMs process text. You'll also work through code examples that illustrate that transformer's individual components. In details, you’ll learn: - How the representation of language has evolved, from Bag-of-Words to Word2Vec embeddings to the transformer architecture that captures a word's meanings taking into account the context of other words in the input. - How inputs are broken down into tokens before they are sent to the language model. - The details of a transformer's main stages: Tokenization and embedding, the stack of transformer blocks, and the language model head. - The inner workings of the transformer block, including attention, which calculates relevance scores, and the feedforward layer, which incorporates stored information learned in training. - How cached calculations make transformers faster. - Some of the most recent ideas in the latest models such as Mixture-of-Experts (MoE) which uses multiple sub-models and a router on each layer to improve the quality of LLMs. By the end of this course, you’ll have a deep understanding of how LLMs actually process text and be able to read through papers describing the latest models and understand the details. Gaining this intuition will improve your approach to building LLM applications. Please sign up here:

Andrew Ng

253,812 次观看 • 1 年前

The worst thing is it doesn’t matter how corrupt this is, how illegal it is or how many people protest – even if it’s 99.6% of Australia – Finklestein is still going to get his $200,000 for doing SFA. It’s the cabal at work, right in front of us and we can’t do anything about it.

The worst thing is it doesn’t matter how corrupt this is, how illegal it is or how many people protest – even if it’s 99.6% of Australia – Finklestein is still going to get his $200,000 for doing SFA. It’s the cabal at work, right in front of us and we can’t do anything about it.

Eddy Jokovich

30,932 次观看 • 1 个月前

📣 A New 1517 Academy Course: Reading and Interpreting the Bible How should we read the Bible? In our new free course, Reading & Interpreting the Bible, Chad Bird walks through the grand story of Scripture from Genesis to Revelation and equips you with tools to read it with clarity and confidence. Learn how context and genre shape meaning, how the many voices of Scripture proclaim one unified story, and how all of it leads us to Christ. Enroll for free at the link in bio.

📣 A New 1517 Academy Course: Reading and Interpreting the Bible How should we read the Bible? In our new free course, Reading & Interpreting the Bible, Chad Bird walks through the grand story of Scripture from Genesis to Revelation and equips you with tools to read it with clarity and confidence. Learn how context and genre shape meaning, how the many voices of Scripture proclaim one unified story, and how all of it leads us to Christ. Enroll for free at the link in bio.

1517

10,042 次观看 • 4 个月前

After two years of work, The Santiago Boys is finally live - you can listen to all the episodes on the main podcasting platforms. For an even deeper experience, do it on its website:

After two years of work, The Santiago Boys is finally live - you can listen to all the episodes on the main podcasting platforms. For an even deeper experience, do it on its website:

Evgeny Morozov

293,655 次观看 • 3 年前

What happens when a community-owned AI reaches 1+ million users? For the first time in history, AI doesn’t just get smarter. The people helping build it get stronger too. Not just investors. Not just board members. Not just billionaires. Ordinary people helping train the model share in the value it creates. That’s how the future of AI should work. That’s when things get truly interesting.

What happens when a community-owned AI reaches 1+ million users? For the first time in history, AI doesn’t just get smarter. The people helping build it get stronger too. Not just investors. Not just board members. Not just billionaires. Ordinary people helping train the model share in the value it creates. That’s how the future of AI should work. That’s when things get truly interesting.

Action Model

21,026 次观看 • 1 个月前

Applied Intuition CEO Qasar Younis says the market for physical AI is "way, way bigger" than the market for white-collar AI: "I used to be at Y Combinator. I was the COO, ran the firm, and funded lots of interesting companies. And one of the analogies I used to use to help founders understand market potential and size is: I grew up in Detroit. You're sitting in the Detroit metro airport at a gate, and you look around. How many of those people are using Claude Code? Frankly speaking, not many." "But how many of those people drive? How many people work at construction sites? How many of those people ride in buses? How many of those people serve in our armed forces? The point is: a much, much larger group." "The market for physical AI is way, way bigger. Purely because the surface area is much bigger."

Applied Intuition CEO Qasar Younis says the market for physical AI is "way, way bigger" than the market for white-collar AI: "I used to be at Y Combinator. I was the COO, ran the firm, and funded lots of interesting companies. And one of the analogies I used to use to help founders understand market potential and size is: I grew up in Detroit. You're sitting in the Detroit metro airport at a gate, and you look around. How many of those people are using Claude Code? Frankly speaking, not many." "But how many of those people drive? How many people work at construction sites? How many of those people ride in buses? How many of those people serve in our armed forces? The point is: a much, much larger group." "The market for physical AI is way, way bigger. Purely because the surface area is much bigger."

TBPN

67,366 次观看 • 3 个月前

How do people make decisions? It works pretty much the same way for all of us. Your brain takes in information and puts it through a set of criteria that determine action. Those criteria are the cause-effect relationships that exist all around us. Understanding how they work is critical, because causes lead to effects. And if you understand the causes, you can bet on the effects.

How do people make decisions? It works pretty much the same way for all of us. Your brain takes in information and puts it through a set of criteria that determine action. Those criteria are the cause-effect relationships that exist all around us. Understanding how they work is critical, because causes lead to effects. And if you understand the causes, you can bet on the effects.

Ray Dalio

67,300 次观看 • 5 个月前

My friend applied to 200 tech jobs in two years. No PhD. No Stanford. Last month Anthropic offered him $750,000. I asked him how he broke in from zero. He sent me a course that was never supposed to get out. A 3-hour video to build a full LLM from scratch. A developer teaches you exactly how LLMs like ChatGPT and Claude are actually built. I watched it last night. Halfway through, I realized it's embarrassingly simple to break into an AI lab. Bookmark this and read the article below. • 00:00 - intro to LLMs • 05:43 - LLM transformer architecture • 40:24 - training the LLM • 1:30:27 - modernizing the LLM • 2:33:53 - scaling the LLM

My friend applied to 200 tech jobs in two years. No PhD. No Stanford. Last month Anthropic offered him $750,000. I asked him how he broke in from zero. He sent me a course that was never supposed to get out. A 3-hour video to build a full LLM from scratch. A developer teaches you exactly how LLMs like ChatGPT and Claude are actually built. I watched it last night. Halfway through, I realized it's embarrassingly simple to break into an AI lab. Bookmark this and read the article below. • 00:00 - intro to LLMs • 05:43 - LLM transformer architecture • 40:24 - training the LLM • 1:30:27 - modernizing the LLM • 2:33:53 - scaling the LLM

Roan

270,385 次观看 • 7 天前

"I'm not a believer that this is the end of work at all." Sam Altman and Azeem Azhar discuss the potential impact of AI on workers in the future Stream Exponentially with Azeem Azhar Wednesdays 8pm ET

"I'm not a believer that this is the end of work at all." Sam Altman and Azeem Azhar discuss the potential impact of AI on workers in the future Stream Exponentially with Azeem Azhar Wednesdays 8pm ET

Bloomberg Originals

14,852 次观看 • 2 年前

Richard Sutton says that the current dominance of LLMs is a "momentary fixation" the real breakthroughs will come from scaling computation, not building AI systems based on how humans think they work. LLMs will not be the leading edge of AI for more than another decade, perhaps even half a decade.

Richard Sutton says that the current dominance of LLMs is a "momentary fixation" the real breakthroughs will come from scaling computation, not building AI systems based on how humans think they work. LLMs will not be the leading edge of AI for more than another decade, perhaps even half a decade.

Haider.

137,573 次观看 • 1 年前

Meta FAIR and Rothschild Foundation Hospital present a groundbreaking study mapping how language representations emerge in the brain, revealing striking parallels with LLMs. This research offers unprecedented insights into the neural development of language, showing how AI models like wav2vec 2.0 and Llama 4 mirror the brain's language processing. Discover how these findings pave the way for new frameworks in understanding human intelligence and developing clinical tools for language support. 📄 Read the full research paper: ➡️

Meta FAIR and Rothschild Foundation Hospital present a groundbreaking study mapping how language representations emerge in the brain, revealing striking parallels with LLMs. This research offers unprecedented insights into the neural development of language, showing how AI models like wav2vec 2.0 and Llama 4 mirror the brain's language processing. Discover how these findings pave the way for new frameworks in understanding human intelligence and developing clinical tools for language support. 📄 Read the full research paper: ➡️

AI at Meta

28,761 次观看 • 1 年前

AI could, in theory, automate 57% of US work hours. Yet most human skills remain relevant. The future of work is not human or machine – but a partnership between people, agents, and robots. Read our latest research on skill partnerships in the age of AI:

AI could, in theory, automate 57% of US work hours. Yet most human skills remain relevant. The future of work is not human or machine – but a partnership between people, agents, and robots. Read our latest research on skill partnerships in the age of AI:

McKinsey Global Institute

16,233 次观看 • 6 个月前