Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

How do we cache prompts with LLMs? Interview with Tanishq Singh. This is a real interview question from a big tech company, asked to a candidate in their technical interview round. The video explains the answer in roughly 6 minutes. 00:00 Question - Prompt Caching with LLMs 00:39 Exact... show more

Gaurav Sen

73,634 subscribers

94,211 Aufrufe • vor 29 Tagen •via X (Twitter)

Wissenschaft & Technologie Bildung Gesundheit & Wellness

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

How do we run evals with LLMs? Interview with Tanishq Singh. This is a real interview question from a big tech company, asked to a candidate in their technical interview round. The video explains the answer in roughly 11 minutes. 00:00 Question - Reliability with LLMs 01:00 Observability & Evals 02:50 What are evals? 06:41 Who does evals? 08:11 Answer relevancy, groundedness, tool sequence 10:39 Bloopers :p AI engineering program for software engineers:

How do we run evals with LLMs? Interview with Tanishq Singh. This is a real interview question from a big tech company, asked to a candidate in their technical interview round. The video explains the answer in roughly 11 minutes. 00:00 Question - Reliability with LLMs 01:00 Observability & Evals 02:50 What are evals? 06:41 Who does evals? 08:11 Answer relevancy, groundedness, tool sequence 10:39 Bloopers :p AI engineering program for software engineers:

Gaurav Sen

35,079 Aufrufe • vor 20 Tagen

What's better? LLMs or Agents? This is a real interview question from a big tech company. For more questions, subscribe to the channel! AI engineering program for software engineers: 00:00 Question - LLMs vs. Agents 01:02 Basic Answer 02:16 Follow-up question 03:47 Context Management 05:08 Bloopers #LLMs #AI #InterviewReady

What's better? LLMs or Agents? This is a real interview question from a big tech company. For more questions, subscribe to the channel! AI engineering program for software engineers: 00:00 Question - LLMs vs. Agents 01:02 Basic Answer 02:16 Follow-up question 03:47 Context Management 05:08 Bloopers #LLMs #AI #InterviewReady

Gaurav Sen

18,889 Aufrufe • vor 1 Monat

RAG vs. Agents Interview with Tanishq Singh. This is a real interview question from a big tech company, asked to a candidate in their technical interview round. The video explains the answer in roughly 4 minutes. 00:00 Question - RAG vs Agents 00:35 Difference between RAG and Agents 01:45 What can RAG make tool calls 02:54 Agentic RAG 03:47 Bloopers :p AI engineering program for software engineers:

RAG vs. Agents Interview with Tanishq Singh. This is a real interview question from a big tech company, asked to a candidate in their technical interview round. The video explains the answer in roughly 4 minutes. 00:00 Question - RAG vs Agents 00:35 Difference between RAG and Agents 01:45 What can RAG make tool calls 02:54 Agentic RAG 03:47 Bloopers :p AI engineering program for software engineers:

Gaurav Sen

28,949 Aufrufe • vor 11 Tagen

Don't waste 2 years learning to use LLMs like Claude & ChatGPT. Andrej Karpathy, the godfather of AI, dropped a 2 hour course on how he personally uses LLMs daily. • 00:00 - LLMs simplified • 22:49 - which LLM to actually use • 42:00 - one prompt for full research • 1:13:57 - how to code with LLMs • 1:37:04 - NotebookLM podcast generation This course will teach you more about using LLMs than most AI engineers learn in their entire career. Bookmark this & give 2 hours today, no matter what. Then read the article below.

Don't waste 2 years learning to use LLMs like Claude & ChatGPT. Andrej Karpathy, the godfather of AI, dropped a 2 hour course on how he personally uses LLMs daily. • 00:00 - LLMs simplified • 22:49 - which LLM to actually use • 42:00 - one prompt for full research • 1:13:57 - how to code with LLMs • 1:37:04 - NotebookLM podcast generation This course will teach you more about using LLMs than most AI engineers learn in their entire career. Bookmark this & give 2 hours today, no matter what. Then read the article below.

Roan

56,378 Aufrufe • vor 25 Tagen

Don't waste 2 years learning to use LLMs like Claude & ChatGPT. Andrej Karpathy one of the clearest minds in AI just released a 2‑hour breakdown of how he actually uses LLMs every day. • 00:00 — LLMs, explained like you’re busy • 22:49 — picking the right model (for real) • 42:00 — the single prompt that powers deep research • 1:13:57 — writing code with LLMs without the chaos • 1:37:04 — turning NotebookLM into a podcast machine If you watch this end to end, you’ll walk away with more practical LLM skill than many “AI engineers” collect over years. Save it. Carve out two hours today—no excuses. Then hit the article below.

Don't waste 2 years learning to use LLMs like Claude & ChatGPT. Andrej Karpathy one of the clearest minds in AI just released a 2‑hour breakdown of how he actually uses LLMs every day. • 00:00 — LLMs, explained like you’re busy • 22:49 — picking the right model (for real) • 42:00 — the single prompt that powers deep research • 1:13:57 — writing code with LLMs without the chaos • 1:37:04 — turning NotebookLM into a podcast machine If you watch this end to end, you’ll walk away with more practical LLM skill than many “AI engineers” collect over years. Save it. Carve out two hours today—no excuses. Then hit the article below.

CyrilXBT

51,835 Aufrufe • vor 24 Tagen

Pingo - AI language learning app. Scaled to $500k/mo in 14 months from a college dorm, via organic TikTok (400M+ views) Full interview deep dive into their distribution & creator scaling strategy 👇 00:00 Intro to Pingo 05:02 LLMs in Language Learning 10:16 Viral TikTok Formats 15:02 Content Strategy 20:11 Creator Recruitment 28:04 Targeting International Markets 34:00 VC Portfolio Approach to Creator Team 40:50 Creator Coaching, Paywall Optimization 52:03 Y Combinator Experience

Pingo - AI language learning app. Scaled to $500k/mo in 14 months from a college dorm, via organic TikTok (400M+ views) Full interview deep dive into their distribution & creator scaling strategy 👇 00:00 Intro to Pingo 05:02 LLMs in Language Learning 10:16 Viral TikTok Formats 15:02 Content Strategy 20:11 Creator Recruitment 28:04 Targeting International Markets 34:00 VC Portfolio Approach to Creator Team 40:50 Creator Coaching, Paywall Optimization 52:03 Y Combinator Experience

Joseph Choi

76,811 Aufrufe • vor 4 Monaten

Stanford just dropped a 1 hour course on how it teaches its AI engineers to train LLMs from scratch. This is the exact way LLMs like ChatGPT & Claude are trained. • 00:00 - LLM Policy Gradient basics • 23:24 - PPO for LLM training • 56:20 - how LLMs learn Chain of Thought • 1:03:50- LLM architecture explained Anthropic pays $750,000/year to engineers who understand this exact knowledge of LLMs. Bookmark this & give 1 hours today, no matter what. It'll be the most productive thing you do this week.

Stanford just dropped a 1 hour course on how it teaches its AI engineers to train LLMs from scratch. This is the exact way LLMs like ChatGPT & Claude are trained. • 00:00 - LLM Policy Gradient basics • 23:24 - PPO for LLM training • 56:20 - how LLMs learn Chain of Thought • 1:03:50- LLM architecture explained Anthropic pays $750,000/year to engineers who understand this exact knowledge of LLMs. Bookmark this & give 1 hours today, no matter what. It'll be the most productive thing you do this week.

Roan

37,436 Aufrufe • vor 28 Tagen

John: why aren't LLMs caching answers to common questions to increase response time? "I've asked ChatGPT, ‘When was OpenAI founded?’ three different times. It's the exact same query." "It doesn't need to light the GPUs on fire for that question. So cache those results and give them to the user instantly." "LLMs felt slow for a really long time. They actually got slower once the reasoning models came out. It was like: close your phone and come back in 20 minutes. That doesn't have to be the end state."

John: why aren't LLMs caching answers to common questions to increase response time? "I've asked ChatGPT, ‘When was OpenAI founded?’ three different times. It's the exact same query." "It doesn't need to light the GPUs on fire for that question. So cache those results and give them to the user instantly." "LLMs felt slow for a really long time. They actually got slower once the reasoning models came out. It was like: close your phone and come back in 20 minutes. That doesn't have to be the end state."

TBPN

301,136 Aufrufe • vor 6 Monaten

Met a guy making $1.6 million/year as an LLM engineer. I asked him how he learned LLMs from scratch. He sent me the exact video that got him in. A 1 hour course on how LLMs actually work. He shows how transformers inside LLMs like ChatGPT & Claude are actually built. I watched it last night. Halfway through, I realized LLM architecture is way simpler than they make it look. Bookmark this and read the article below. • 00:00 - LLM foundations • 04:21 - LLM tokenization • 05:43 - LLMs vector embeddings • 22:16 - attention mechanism of LLM • 43:42 - LLM multi head attention

Met a guy making $1.6 million/year as an LLM engineer. I asked him how he learned LLMs from scratch. He sent me the exact video that got him in. A 1 hour course on how LLMs actually work. He shows how transformers inside LLMs like ChatGPT & Claude are actually built. I watched it last night. Halfway through, I realized LLM architecture is way simpler than they make it look. Bookmark this and read the article below. • 00:00 - LLM foundations • 04:21 - LLM tokenization • 05:43 - LLMs vector embeddings • 22:16 - attention mechanism of LLM • 43:42 - LLM multi head attention

Roan

80,961 Aufrufe • vor 1 Monat

Don't waste 2 years learning to build LLMs like Claude & ChatGPT. MIT dropped a 3 hour course on building LLMs from scratch for free. Training → Architecture → Scale. It covers everything about LLMs. • 00:00 - training an LLM • 1:20:46 - LLM architecture from scratch • 2:34:56 - scaling laws for LLMs Anthropic pays $750,000/year to AI engineers in 2026 who master this exact knowledge. Bookmark this & skip Netflix. Give it 4 hours today. Then read the article below.

Don't waste 2 years learning to build LLMs like Claude & ChatGPT. MIT dropped a 3 hour course on building LLMs from scratch for free. Training → Architecture → Scale. It covers everything about LLMs. • 00:00 - training an LLM • 1:20:46 - LLM architecture from scratch • 2:34:56 - scaling laws for LLMs Anthropic pays $750,000/year to AI engineers in 2026 who master this exact knowledge. Bookmark this & skip Netflix. Give it 4 hours today. Then read the article below.

Roan

85,618 Aufrufe • vor 21 Tagen

Core Memory podcast with Suzanne Gildert on the hunt for AI consciousness in the quantum realm. The theory being that LLMs are too constrained to really get to robots and AIs that are really like us 00:00:00 – Consciousness: The First AI Training Model? 00:02:03 – Exploring the Quantum Mind with AI 00:04:42 – Will Robots Ever Have Rights? 00:07:54 – The AI Paradox: Fear vs. Progress 00:13:20 – Can Language Models Teach Robots? 00:17:29 – Why Today’s AI Feels Like a Zombie 00:23:47 – Quantum Computing Meets Artificial Consciousness 00:29:50 – Free Will, Entanglement, and Decision Making 00:38:21 – Teaching a Robot to Think, Not Just React 00:52:51 – Will Conscious AI Power Space Exploration?

Core Memory podcast with Suzanne Gildert on the hunt for AI consciousness in the quantum realm. The theory being that LLMs are too constrained to really get to robots and AIs that are really like us 00:00:00 – Consciousness: The First AI Training Model? 00:02:03 – Exploring the Quantum Mind with AI 00:04:42 – Will Robots Ever Have Rights? 00:07:54 – The AI Paradox: Fear vs. Progress 00:13:20 – Can Language Models Teach Robots? 00:17:29 – Why Today’s AI Feels Like a Zombie 00:23:47 – Quantum Computing Meets Artificial Consciousness 00:29:50 – Free Will, Entanglement, and Decision Making 00:38:21 – Teaching a Robot to Think, Not Just React 00:52:51 – Will Conscious AI Power Space Exploration?

Ashlee Vance

17,189 Aufrufe • vor 1 Jahr

Don't waste 2 years learning to build LLMs like Claude & ChatGPT. Stanford just dropped a 2 hour course on how to build LLMs from scratch. 00:00 - break text into tokens 25:44 - decode a user prompt 35:40 - train the model end to end 1:16:47 - build the architecture from scratch Anthropic pays $750,000/year to engineers who understand this exact knowledge of LLMs. Watch it, then go further with the step-by-step guide below on how to build a system that improves itself.

Don't waste 2 years learning to build LLMs like Claude & ChatGPT. Stanford just dropped a 2 hour course on how to build LLMs from scratch. 00:00 - break text into tokens 25:44 - decode a user prompt 35:40 - train the model end to end 1:16:47 - build the architecture from scratch Anthropic pays $750,000/year to engineers who understand this exact knowledge of LLMs. Watch it, then go further with the step-by-step guide below on how to build a system that improves itself.

Anatoli Kopadze

105,443 Aufrufe • vor 10 Tagen

EPISODE 142: Understanding the AI Wave Joe Lonsdale sits down with 8VC Partners Alex Kolicich & Jack Moshkovich Why is AI fundamentally disruptive? What does it mean for large software incumbents? Will LLMs become commodities? And are we entering a bubble, or just getting started? (00:00) Episode intro (01:40) Smart enterprise thesis (04:00) Did enterprise software dramatically boost productivity? (08:30) Understanding the AI wave (11:45) Will LLMs become commodities? (17:10) OpenAI vs Anthropic vs Meta vs Grok (20:30) Frontier models vs enterprise incumbents (25:27) What did Palantir get right? (32:30) AI case studies/new possibilities (43:00) The most surprising aspect of the AI wave (46:12) Are we entering a bubble? Or just getting started? (52:40) Biggest concern with AI (58:00) Biggest reason for optimism

EPISODE 142: Understanding the AI Wave Joe Lonsdale sits down with 8VC Partners Alex Kolicich & Jack Moshkovich Why is AI fundamentally disruptive? What does it mean for large software incumbents? Will LLMs become commodities? And are we entering a bubble, or just getting started? (00:00) Episode intro (01:40) Smart enterprise thesis (04:00) Did enterprise software dramatically boost productivity? (08:30) Understanding the AI wave (11:45) Will LLMs become commodities? (17:10) OpenAI vs Anthropic vs Meta vs Grok (20:30) Frontier models vs enterprise incumbents (25:27) What did Palantir get right? (32:30) AI case studies/new possibilities (43:00) The most surprising aspect of the AI wave (46:12) Are we entering a bubble? Or just getting started? (52:40) Biggest concern with AI (58:00) Biggest reason for optimism

American Optimist

417,594 Aufrufe • vor 6 Monaten

Andrew Ng just dropped a 3-hour course on how to become an AI Engineer in 2026: • 00:00 - How to build agentic AI systems • 04:25 - Future of AI engineering • 23:38 - AI Prompting full course • 2:52:17 - Creating an app with AI in 30 minutes This 3-hour watch could replace 10 AI engineering courses on the internet. Watch it today, then read how to run a self-improving system in the article below.

Andrew Ng just dropped a 3-hour course on how to become an AI Engineer in 2026: • 00:00 - How to build agentic AI systems • 04:25 - Future of AI engineering • 23:38 - AI Prompting full course • 2:52:17 - Creating an app with AI in 30 minutes This 3-hour watch could replace 10 AI engineering courses on the internet. Watch it today, then read how to run a self-improving system in the article below.

Dhairya

242,612 Aufrufe • vor 1 Monat

Andrew Ng just dropped a 3-hour course on how to become an AI Engineer in 2026: • 00:00 - How to build agentic AI systems • 04:25 - Future of AI engineering • 23:38 - AI Prompting full course • 2:52:17 - Creating an app with AI in 30 minutes This 3-hour watch could replace 10 AI engineering courses on the internet. Watch it today, then read how to run a self-improving system in the article below.

Andrew Ng just dropped a 3-hour course on how to become an AI Engineer in 2026: • 00:00 - How to build agentic AI systems • 04:25 - Future of AI engineering • 23:38 - AI Prompting full course • 2:52:17 - Creating an app with AI in 30 minutes This 3-hour watch could replace 10 AI engineering courses on the internet. Watch it today, then read how to run a self-improving system in the article below.

Movez

894,150 Aufrufe • vor 1 Monat

AI has a trust problem. Verifiability is the solution. Our GM of AI Nima Vaziri sat down with a16z’s Ali Yahya and Dan Boneh of Stanford University to map the deepest fault lines in AI today. ☁️ Models we can’t trust ☁️ Current providers can censor, shut down, or shift rules overnight. Outsourced training hides backdoors. Even “open” weights don’t prove what’s actually running. Trust. Backdoors. Black boxes. The path forward is clear: 🔥 Verifiable evals 🔥 Verifiable inference 🔥 TEEs for hardware-backed integrity 🔥 Infra beyond single points of control 🔥 Blockchains as coordination layers for AI From “trust us” to “verify yourself.” That’s the shift. That’s the unlock. The frontier is here. The builders decide what comes next. Create and use AI that’s incentive aligned with you. Timestamps: 00:00:00 Introduction: AI & Crypto Intersection Overview 00:01:58 Four Major AI-Crypto Trends 00:02:44 AI Agents Need Financial Infrastructure 00:04:03 Proof of Humanity: Fighting AI-Generated Content 00:04:17 Decentralizing AI Infrastructure Networks 00:04:44 Synthetic Life: Autonomous AI Agents 00:06:20 Verifiable AI 00:10:16 Current Performance Numbers for AI Proofs 00:13:18 The Era of Experience in AI Learning 00:14:56 AI Agents Having Life of its Own 00:18:21 Algorithmic Fairness & Verifiable Models 00:23:18 Privacy in AI: Trusted Execution Environments 00:25:47 Economic Incentive for Open Weight Models 00:31:39 Attribution Problem: Who Gets Paid for AI Training? 00:35:52 Content Provenance & Authentication (C2PA) 00:48:03 AI Security: Finding Exploits & Vulnerabilities 00:54:53 Educational Applications: LLMs as Learning Partner 00:58:29 Reliance on LLMs and Cognitive Abilities 01:03:57 Content Providers’ Fear of LLM Training

AI has a trust problem. Verifiability is the solution. Our GM of AI Nima Vaziri sat down with a16z’s Ali Yahya and Dan Boneh of Stanford University to map the deepest fault lines in AI today. ☁️ Models we can’t trust ☁️ Current providers can censor, shut down, or shift rules overnight. Outsourced training hides backdoors. Even “open” weights don’t prove what’s actually running. Trust. Backdoors. Black boxes. The path forward is clear: 🔥 Verifiable evals 🔥 Verifiable inference 🔥 TEEs for hardware-backed integrity 🔥 Infra beyond single points of control 🔥 Blockchains as coordination layers for AI From “trust us” to “verify yourself.” That’s the shift. That’s the unlock. The frontier is here. The builders decide what comes next. Create and use AI that’s incentive aligned with you. Timestamps: 00:00:00 Introduction: AI & Crypto Intersection Overview 00:01:58 Four Major AI-Crypto Trends 00:02:44 AI Agents Need Financial Infrastructure 00:04:03 Proof of Humanity: Fighting AI-Generated Content 00:04:17 Decentralizing AI Infrastructure Networks 00:04:44 Synthetic Life: Autonomous AI Agents 00:06:20 Verifiable AI 00:10:16 Current Performance Numbers for AI Proofs 00:13:18 The Era of Experience in AI Learning 00:14:56 AI Agents Having Life of its Own 00:18:21 Algorithmic Fairness & Verifiable Models 00:23:18 Privacy in AI: Trusted Execution Environments 00:25:47 Economic Incentive for Open Weight Models 00:31:39 Attribution Problem: Who Gets Paid for AI Training? 00:35:52 Content Provenance & Authentication (C2PA) 00:48:03 AI Security: Finding Exploits & Vulnerabilities 00:54:53 Educational Applications: LLMs as Learning Partner 00:58:29 Reliance on LLMs and Cognitive Abilities 01:03:57 Content Providers’ Fear of LLM Training

EigenCloud

62,099 Aufrufe • vor 11 Monaten

In this episode of the Lightcone Podcast, we sat down with Mukund Jha and Madhav Jha, the founders of Emergent - an AI platform that lets anyone build and ship production-ready software. In just eight months, users have created more than 7 million apps on Emergent, with the number doubling in just the last 45 days. We discuss how they built one of the most powerful AI coding agents, why they focused on non-technical users and what it's like building for a global audience from India. 00:00 - Intro 01:06 - What Is Emergent? 01:18 - Founder Backstory 02:09 - From AI Testing to General Coding Agents 02:52 - Getting Ahead of the Market 04:18 - The Pivot to Non-Technical Users 05:22 - Why Second Movers Can Win in AI 09:04 - Building for Production, Not Just Prototypes 18:21 - Live Demo: Building Apps with Emergent 24:40 - How Emergent Hires and Runs a Lean Team 29:04 - Is SaaS Dead? The Rise of Personalized Software 34:04 - The Future: Niche Apps, Solo Builders and AI Agency

In this episode of the Lightcone Podcast, we sat down with Mukund Jha and Madhav Jha, the founders of Emergent - an AI platform that lets anyone build and ship production-ready software. In just eight months, users have created more than 7 million apps on Emergent, with the number doubling in just the last 45 days. We discuss how they built one of the most powerful AI coding agents, why they focused on non-technical users and what it's like building for a global audience from India. 00:00 - Intro 01:06 - What Is Emergent? 01:18 - Founder Backstory 02:09 - From AI Testing to General Coding Agents 02:52 - Getting Ahead of the Market 04:18 - The Pivot to Non-Technical Users 05:22 - Why Second Movers Can Win in AI 09:04 - Building for Production, Not Just Prototypes 18:21 - Live Demo: Building Apps with Emergent 24:40 - How Emergent Hires and Runs a Lean Team 29:04 - Is SaaS Dead? The Rise of Personalized Software 34:04 - The Future: Niche Apps, Solo Builders and AI Agency

Y Combinator

107,673 Aufrufe • vor 5 Monaten

In this video, we break down the Model Context Protocol — a massively underrated concept in AI that's quietly redefining what large language models can do. While most people are distracted by the hype, MCP is solving a core problem: LLMs that can perform actions. We dive into: 1. The limitations of current AI systems 2. What makes MCP different 3. How MCP can reduce engineering overhead 4. Real-world scenarios where MCP shines 00:00 What is MCP? 01:48 Usecase - SEO 03:50 Usecase - RAG 04:50 Usecase - Apps 06:30 Conclusion 07:00 The future? #MCP #AI #LLM

In this video, we break down the Model Context Protocol — a massively underrated concept in AI that's quietly redefining what large language models can do. While most people are distracted by the hype, MCP is solving a core problem: LLMs that can perform actions. We dive into: 1. The limitations of current AI systems 2. What makes MCP different 3. How MCP can reduce engineering overhead 4. Real-world scenarios where MCP shines 00:00 What is MCP? 01:48 Usecase - SEO 03:50 Usecase - RAG 04:50 Usecase - Apps 06:30 Conclusion 07:00 The future? #MCP #AI #LLM

Gaurav Sen

41,154 Aufrufe • vor 1 Jahr

Don't waste 2 years learning to become an AI researcher in 2026. This is the exact 3 hour course on the math & architecture behind every LLM. • 00:00 - what an AI researcher does • 46:07 - the math behind LLMs • 1:54:00 - neural networks from scratch • 2:14:14 - LLM attention mechanism • 3:04:15 - LLM tokenization explained Anthropic pays $850,000/year to AI researchers who master this exact knowledge. Bookmark & give it 3 hours, no matter what. It will be the most productive thing you do this weekend.

Don't waste 2 years learning to become an AI researcher in 2026. This is the exact 3 hour course on the math & architecture behind every LLM. • 00:00 - what an AI researcher does • 46:07 - the math behind LLMs • 1:54:00 - neural networks from scratch • 2:14:14 - LLM attention mechanism • 3:04:15 - LLM tokenization explained Anthropic pays $850,000/year to AI researchers who master this exact knowledge. Bookmark & give it 3 hours, no matter what. It will be the most productive thing you do this weekend.

Roan

87,964 Aufrufe • vor 24 Tagen