Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

🆕Scaling Test Time Compute to Multi-Agent Civilizations, with Noam Brown We're excited to publish our full conversation with Noam Brown on the frontiers of the new reasoning paradigm at OpenAI! - first principles for starting the "Multi-Agents" team - what's not captured by the "System 1/System 2" analogy for...

latentspacepod's profile picture

Latent.Space

29,377 subscribers

105,923 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & TeknolojiEğitimSanat
LIVE

Anya Rossi• Live Now

Private livecam show

3 Yorum

Latent.Space profil fotoğrafı
Latent.Space1 yıl önce

@OpenAI with writeups, notes, and highlights in the description full pod on youtube:

Dan Mac profil fotoğrafı
Dan Mac1 yıl önce

@polynoamial @OpenAI is this like the extended version of the convo that was published a couple weeks ago?

Latent.Space profil fotoğrafı
Latent.Space1 yıl önce

no just basically republished bc we misphrased some things in og tweet

Benzer Videolar

“There are more companies than ideas by quite a bit. Compute is large enough such that it's not obvious that you need that much more compute to prove some idea. AlexNet was built on 2 GPUs. The transformer was built on 8 to 64 GPUs. Which would be, what, 2 GPUs of today? You could argue that o1 reasoning was not the most compute heavy thing in the world. For research, you definitely need some amount of compute, but it's far from obvious that you need the absolutely largest amount of compute. If everyone is within the same paradigm, then compute becomes one of the big differentiators.” Ilya Sutskever
2:03

“There are more companies than ideas by quite a bit. Compute is large enough such that it's not obvious that you need that much more compute to prove some idea. AlexNet was built on 2 GPUs. The transformer was built on 8 to 64 GPUs. Which would be, what, 2 GPUs of today? You could argue that o1 reasoning was not the most compute heavy thing in the world. For research, you definitely need some amount of compute, but it's far from obvious that you need the absolutely largest amount of compute. If everyone is within the same paradigm, then compute becomes one of the big differentiators.” Ilya Sutskever

Dwarkesh Patel

203,605 görüntüleme • 8 ay önce

Epiplexity, Reasoning & The "Alien" Behavior of LLMs: my conversation with Pavel Izmailov, AI researcher at Anthropic and professor at New York University. 00:00 - Intro 00:53 - Alien survival instincts: is continual learning about to create a major alignment problem? Riffing on the post by 🍓🍓🍓 03:33 - Did AI learn deception from sci-fi literature? 05:55 - Defining Alignment, Superalignment & OpenAI teams 08:12 - Pavel’s journey: From Russian math to OpenAI Superalignment 10:46 - Culture check: OpenAI vs. Anthropic vs. Academia 11:54 - Why move to NYU? Academia and the need for exploratory research 13:09 - Does reasoning make AI alignment harder or easier? 14:22 - Sandbagging: When models pretend to be dumb 16:19 - Scalable Oversight: Using AI to supervise AI 18:04 - Weak-to-Strong Generalization 22:43 - Mechanistic Interpretability: Inside the black box 25:08 - The reasoning explosion 27:07 - Are Transformers enough or do we need a new paradigm? 28:29 - RL vs. Test-Time Compute: What’s actually driving progress? 30:10 - Long-horizon tasks: Agents running for hours 31:49 - Epiplexity: A new theory of data information content - Pavel's work with Marc Finzi, Zico Kolter, Andrew Gordon Wilson, Yiding Jiang and Shikai Qiu. 38:29 - 2026 Predictions: Multi-agent systems & reasoning limits 39:28 - AI & Scientific progress 41:42 - Advice for PhD students
45:01

Epiplexity, Reasoning & The "Alien" Behavior of LLMs: my conversation with Pavel Izmailov, AI researcher at Anthropic and professor at New York University. 00:00 - Intro 00:53 - Alien survival instincts: is continual learning about to create a major alignment problem? Riffing on the post by 🍓🍓🍓 03:33 - Did AI learn deception from sci-fi literature? 05:55 - Defining Alignment, Superalignment & OpenAI teams 08:12 - Pavel’s journey: From Russian math to OpenAI Superalignment 10:46 - Culture check: OpenAI vs. Anthropic vs. Academia 11:54 - Why move to NYU? Academia and the need for exploratory research 13:09 - Does reasoning make AI alignment harder or easier? 14:22 - Sandbagging: When models pretend to be dumb 16:19 - Scalable Oversight: Using AI to supervise AI 18:04 - Weak-to-Strong Generalization 22:43 - Mechanistic Interpretability: Inside the black box 25:08 - The reasoning explosion 27:07 - Are Transformers enough or do we need a new paradigm? 28:29 - RL vs. Test-Time Compute: What’s actually driving progress? 30:10 - Long-horizon tasks: Agents running for hours 31:49 - Epiplexity: A new theory of data information content - Pavel's work with Marc Finzi, Zico Kolter, Andrew Gordon Wilson, Yiding Jiang and Shikai Qiu. 38:29 - 2026 Predictions: Multi-agent systems & reasoning limits 39:28 - AI & Scientific progress 41:42 - Advice for PhD students

Matt Turck

23,020 görüntüleme • 7 ay önce

Why AI Progress Suddenly Feels Real - my conversation with Yann Dubois, who co-leads the Post-Training Frontiers team at OpenAI 00:00 - Intro 01:30 - Why recent AI progress feels like a step function 04:13 - Model reliability & the emotional rollercoaster of shipping GPT-5.5 07:33 - How OpenAI structures vertical and horizontal teams 09:49 - Improving model efficiency and test-time compute 12:32 - Yann's journey from Switzerland to OpenAI 15:37 - Reasoning in 2026: Real-world utility vs verifiable rewards 18:34 - GPT-5.5 Thinking vs Pro: Scaling test-time compute 20:09 - How reasoning models become more efficient 23:23 - Pre-training scaling and overcoming the data wall 27:03 - Multimodal data, synthetic data, and embodied AI 31:05 - Demystifying mid-training and post-training 37:21 - Does RL create new capabilities in AI? 38:53 - The challenges and frontier of scaling RL 43:09 - Is building AI models a craft or a strict science 48:21 - How AI models generalize across different domains 54:18 - How reinforcement learning cures AI hallucinations 56:04 - Negative generalization and conflicting instructions 58:05 - Can RL scale to law, medicine, and the broader economy? 1:00:19 - The evaluation bottleneck and Model as a Judge 1:04:21 - Continuous AI progress & continual learning 1:08:49 - Will foundation models eat the agent harness 1:11:23 - Why startups should focus on the last mile of AI
1:13:56

Why AI Progress Suddenly Feels Real - my conversation with Yann Dubois, who co-leads the Post-Training Frontiers team at OpenAI 00:00 - Intro 01:30 - Why recent AI progress feels like a step function 04:13 - Model reliability & the emotional rollercoaster of shipping GPT-5.5 07:33 - How OpenAI structures vertical and horizontal teams 09:49 - Improving model efficiency and test-time compute 12:32 - Yann's journey from Switzerland to OpenAI 15:37 - Reasoning in 2026: Real-world utility vs verifiable rewards 18:34 - GPT-5.5 Thinking vs Pro: Scaling test-time compute 20:09 - How reasoning models become more efficient 23:23 - Pre-training scaling and overcoming the data wall 27:03 - Multimodal data, synthetic data, and embodied AI 31:05 - Demystifying mid-training and post-training 37:21 - Does RL create new capabilities in AI? 38:53 - The challenges and frontier of scaling RL 43:09 - Is building AI models a craft or a strict science 48:21 - How AI models generalize across different domains 54:18 - How reinforcement learning cures AI hallucinations 56:04 - Negative generalization and conflicting instructions 58:05 - Can RL scale to law, medicine, and the broader economy? 1:00:19 - The evaluation bottleneck and Model as a Judge 1:04:21 - Continuous AI progress & continual learning 1:08:49 - Will foundation models eat the agent harness 1:11:23 - Why startups should focus on the last mile of AI

Matt Turck

101,212 görüntüleme • 3 ay önce

I’m excited to kick off the first of our short courses focused on agents, starting with Building Agentic RAG with LlamaIndex, taught by Jerry Liu, CEO of LlamaIndex 🦙. This covers an important shift in RAG (retrieval augmented generation), in which rather than having the developer write explicit routines to retrieve information to feed into the LLM context, we instead build a RAG agent that that has access to tools for retrieving information. This lets the agent decide what information to fetch, and enables it to answer more complex questions using multi-step reasoning. In detail, you'll learn about: - Routing: Where your agent will use decision-making to route requests to multiple tools. - Tool Use: Where you'll create an interface for agents to select what tool (function call) to use as well as generate the right arguments. - Multi-step reasoning with tool use: Where you'll use an LLM to carry out multiple steps of reasoning, while retaining memory throughout the process. You’ll also learn how to step through what your agent is doing to debug and improve it iteratively. It’s an exciting time to build agents. Sign up and get started here!
2:06

I’m excited to kick off the first of our short courses focused on agents, starting with Building Agentic RAG with LlamaIndex, taught by Jerry Liu, CEO of LlamaIndex 🦙. This covers an important shift in RAG (retrieval augmented generation), in which rather than having the developer write explicit routines to retrieve information to feed into the LLM context, we instead build a RAG agent that that has access to tools for retrieving information. This lets the agent decide what information to fetch, and enables it to answer more complex questions using multi-step reasoning. In detail, you'll learn about: - Routing: Where your agent will use decision-making to route requests to multiple tools. - Tool Use: Where you'll create an interface for agents to select what tool (function call) to use as well as generate the right arguments. - Multi-step reasoning with tool use: Where you'll use an LLM to carry out multiple steps of reasoning, while retaining memory throughout the process. You’ll also learn how to step through what your agent is doing to debug and improve it iteratively. It’s an exciting time to build agents. Sign up and get started here!

Andrew Ng

297,131 görüntüleme • 2 yıl önce

🚀 New LangChain Academy Course: Building Reliable Agents 🚀 Shipping agents to production is hard. Traditional software is deterministic – when something breaks, you check the logs and fix the code. But agents rely on non-deterministic models. Add multi-step reasoning, tool use, and real user traffic, and building reliable agents becomes far more complex than traditional system design. The goal of this course is to teach you how to take an agent from first run to production-ready system through iterative cycles of improvement. You’ll learn how to do this with LangSmith, our agent engineering platform for observing, evaluating, and deploying agents. Enroll for free ➡️
2:02

🚀 New LangChain Academy Course: Building Reliable Agents 🚀 Shipping agents to production is hard. Traditional software is deterministic – when something breaks, you check the logs and fix the code. But agents rely on non-deterministic models. Add multi-step reasoning, tool use, and real user traffic, and building reliable agents becomes far more complex than traditional system design. The goal of this course is to teach you how to take an agent from first run to production-ready system through iterative cycles of improvement. You’ll learn how to do this with LangSmith, our agent engineering platform for observing, evaluating, and deploying agents. Enroll for free ➡️

LangChain

30,744 görüntüleme • 5 ay önce

Cerebras inference is very fast. So fast that it changes how we think about configuring our LLMs for voice agent use cases. Kimi K2.6 is a 1T parameter reasoning model that Cerebras serves at 650 - 1,000 tokens per second (end-to-end throughput), with time to first token metrics as low as 150ms (latency). These numbers are two to three times faster than other similarly capable models. The biggest lever we get from this kind of speed is that we can use the model in reasoning mode, and still have excellent "time to first non-thinking token." This solves a big pain point we have in 2026 for voice agent use cases. Almost all recent innovation in post-training has focused on making models good at reasoning ("test time compute"). This is great, but it makes the user-facing model latency much, much slower. Which is a problem for conversational voice agents. We can run Kimi K2.6 with reasoning turned on, and get responses faster than other models produce with reasoning disabled. On my 30-turn voice agent benchmark, Kimi K2.6 with reasoning enabled ties GPT 5.1 and Haiku 4.5 with reasoning disabled, and is still about 200ms seconds faster! On my primary task agent benchmark, Kimi K2.6 is now the #2 model. It ranks just behind Gemini 3.5 Flash in "high" reasoning mode, and tied with GLM 5, Sonnet 4.6, and GPT 5.4 with reasoning set to "low." But Kimi K2.6 completes each turn in the agent loop in under 500ms. The other four models are all at least 3x slower. (Models only qualify for this benchmark if they can complete task turns at a P50 <4s.) A couple of other things that this speed buys us, for production voice agents: - Tool calls happen fast enough that we don't have to work around tool call latency in our pipeline design. - We can prompt the model to output structured data at the beginning of a response, followed by plain text for voice generation. This opens up possibilities like asking the model to do complex classification/generation tasks that influence the rest of the pipeline. For example, the model could create a detailed style prompt for a steerable TTS model, for each individual conversation turn. And, of course, you can use Kimi K2.6 with reasoning turned off. Cerebras calls this "instant" mode. Here's a video of a Cerebras Kimi K2.6 voice agent with voice-to-voice response time, measured at the client, under 500ms. This is the true response latency as perceived by the user, including all network and audio codec overhead, transcription and turn detection, Kimi K2.6 token generation, and voice generation. 500ms is, effectively, instant. So the Cerebras naming for this mode is a propos. :-)
0:40

Cerebras inference is very fast. So fast that it changes how we think about configuring our LLMs for voice agent use cases. Kimi K2.6 is a 1T parameter reasoning model that Cerebras serves at 650 - 1,000 tokens per second (end-to-end throughput), with time to first token metrics as low as 150ms (latency). These numbers are two to three times faster than other similarly capable models. The biggest lever we get from this kind of speed is that we can use the model in reasoning mode, and still have excellent "time to first non-thinking token." This solves a big pain point we have in 2026 for voice agent use cases. Almost all recent innovation in post-training has focused on making models good at reasoning ("test time compute"). This is great, but it makes the user-facing model latency much, much slower. Which is a problem for conversational voice agents. We can run Kimi K2.6 with reasoning turned on, and get responses faster than other models produce with reasoning disabled. On my 30-turn voice agent benchmark, Kimi K2.6 with reasoning enabled ties GPT 5.1 and Haiku 4.5 with reasoning disabled, and is still about 200ms seconds faster! On my primary task agent benchmark, Kimi K2.6 is now the #2 model. It ranks just behind Gemini 3.5 Flash in "high" reasoning mode, and tied with GLM 5, Sonnet 4.6, and GPT 5.4 with reasoning set to "low." But Kimi K2.6 completes each turn in the agent loop in under 500ms. The other four models are all at least 3x slower. (Models only qualify for this benchmark if they can complete task turns at a P50 <4s.) A couple of other things that this speed buys us, for production voice agents: - Tool calls happen fast enough that we don't have to work around tool call latency in our pipeline design. - We can prompt the model to output structured data at the beginning of a response, followed by plain text for voice generation. This opens up possibilities like asking the model to do complex classification/generation tasks that influence the rest of the pipeline. For example, the model could create a detailed style prompt for a steerable TTS model, for each individual conversation turn. And, of course, you can use Kimi K2.6 with reasoning turned off. Cerebras calls this "instant" mode. Here's a video of a Cerebras Kimi K2.6 voice agent with voice-to-voice response time, measured at the client, under 500ms. This is the true response latency as perceived by the user, including all network and audio codec overhead, transcription and turn detection, Kimi K2.6 token generation, and voice generation. 500ms is, effectively, instant. So the Cerebras naming for this mode is a propos. :-)

kwindla

40,593 görüntüleme • 2 ay önce

The agents are coming. The real question is: how will we work with them? Common Ground is our answer. Introducing a new way to build, direct, and inspect AI systems. • Full visualization of agent team dynamics • Shared memory across tasks • Transparent reasoning • Runs locally with Gemini-CLI (free) Start collaborating with systems that think with you, not for you.
1:05

The agents are coming. The real question is: how will we work with them? Common Ground is our answer. Introducing a new way to build, direct, and inspect AI systems. • Full visualization of agent team dynamics • Shared memory across tasks • Transparent reasoning • Runs locally with Gemini-CLI (free) Start collaborating with systems that think with you, not for you.

Intelligent Internet

325,922 görüntüleme • 1 yıl önce

Really fun to hang again with my friend 🃏 Noam Brown (OpenAI research scientist, our first guest ever on No Priors in early 2023) to talk about the implications of large test-time compute, and what happens when models are given $10M budgets to spend on a single task. Topics: 01:23 – Why Benchmarks Are Broken 04:19 – Compute Budgets and Projections 06:48 – How Long Should Models Think? 08:01 – Benchmarkmaxxing 09:48 – Noam's Evals 12:40 – Safety (When Model Capability Scales With Spend) 16:09 – Implications For the Model Release Cycle 18:34 – Latent Model Capability 22:27 – Limits on Recursive Self-Improvement 28:38 – Large-Scale Multi-Agent Coordination 30:39 – Competition at the Frontier 33:19 – Breaking the Benchmark Grid Equilibrium 34:57 – Why Benchmarks Should be Scaled by Cost
36:18

Really fun to hang again with my friend 🃏 Noam Brown (OpenAI research scientist, our first guest ever on No Priors in early 2023) to talk about the implications of large test-time compute, and what happens when models are given $10M budgets to spend on a single task. Topics: 01:23 – Why Benchmarks Are Broken 04:19 – Compute Budgets and Projections 06:48 – How Long Should Models Think? 08:01 – Benchmarkmaxxing 09:48 – Noam's Evals 12:40 – Safety (When Model Capability Scales With Spend) 16:09 – Implications For the Model Release Cycle 18:34 – Latent Model Capability 22:27 – Limits on Recursive Self-Improvement 28:38 – Large-Scale Multi-Agent Coordination 30:39 – Competition at the Frontier 33:19 – Breaking the Benchmark Grid Equilibrium 34:57 – Why Benchmarks Should be Scaled by Cost

sarah guo

87,850 görüntüleme • 1 ay önce

Jensen Huang, CEO of NVIDIA, laid out the compute math almost nobody priced in: reasoning AI needs 1,000x more compute than generative AI. Then you multiply by 100x more users. "In order for AI to go through understanding, reasoning, planning, using tools to take action, the amount of computation necessary compared to generative AI is like a thousand times more." "In two years time, the number of cars you need in the world grew by a thousand times. In two years time, the number of airplanes you need in the world grew by 2,000 times. Whatever metric you want to use, the thousand times difference is incredible." "But then you multiply that by the number of people who now want to use it by a hundred times. Which is the reason why GPU consumption is going through the roof." "Even GPUs we sold 4 or 5 years ago are now rising in price faster than good wine. It has defied what everybody said was going to happen." The reasoning era did not make intelligence cheaper to run. It made a single answer cost 1,000x more compute, then handed that answer to 100x more people. Anyone still budgeting AI around "inference gets cheap" is planning for a curve that already snapped.
0:58

Jensen Huang, CEO of NVIDIA, laid out the compute math almost nobody priced in: reasoning AI needs 1,000x more compute than generative AI. Then you multiply by 100x more users. "In order for AI to go through understanding, reasoning, planning, using tools to take action, the amount of computation necessary compared to generative AI is like a thousand times more." "In two years time, the number of cars you need in the world grew by a thousand times. In two years time, the number of airplanes you need in the world grew by 2,000 times. Whatever metric you want to use, the thousand times difference is incredible." "But then you multiply that by the number of people who now want to use it by a hundred times. Which is the reason why GPU consumption is going through the roof." "Even GPUs we sold 4 or 5 years ago are now rising in price faster than good wine. It has defied what everybody said was going to happen." The reasoning era did not make intelligence cheaper to run. It made a single answer cost 1,000x more compute, then handed that answer to 100x more people. Anyone still budgeting AI around "inference gets cheap" is planning for a curve that already snapped.

Karl Mehta

54,717 görüntüleme • 1 ay önce

🆕 Marc Andreessen’s 2026 AI Thesis: Agents, Open Source, and Why This Time Is Different Marc Andreessen 🇺🇸 of a16z says AI people keep swinging between utopian and apocalyptic for one simple reason: this field has been “almost here” for 80 years. But now, the breakthroughs are no longer theoretical. Reasoning, coding, agents, and self-improvement are all starting to work at once. This episode goes deep on AI winters, OpenAI + OpenClaw, infrastructure overbuild risk, proof-of-human, why software may soon be written mostly for bots, and why the real bottleneck may be society adopting AI rather than the models improving.
0:53

🆕 Marc Andreessen’s 2026 AI Thesis: Agents, Open Source, and Why This Time Is Different Marc Andreessen 🇺🇸 of a16z says AI people keep swinging between utopian and apocalyptic for one simple reason: this field has been “almost here” for 80 years. But now, the breakthroughs are no longer theoretical. Reasoning, coding, agents, and self-improvement are all starting to work at once. This episode goes deep on AI winters, OpenAI + OpenClaw, infrastructure overbuild risk, proof-of-human, why software may soon be written mostly for bots, and why the real bottleneck may be society adopting AI rather than the models improving.

Latent.Space

351,146 görüntüleme • 4 ay önce

Ilya Sutskever, the co-founder of OpenAI, on the one AI risk that grows with every jump in capability. "There are concerns around if an AGI ever becomes very, very powerful, which is possible. Maybe it will want to go rogue, being that it is an agent." "We are also doing a lot of research on addressing the technological side of things, so that the AI will never want to go rogue. And this is something which I am working on as well." The work he is describing has a name: the assurance layer. Proving a powerful, agentic system will not go rogue before you deploy it, not after. That layer does not build itself. It gets built by the labs, regulators, and insurers who agree on how to test and verify these systems. P.S. That is the entire agenda of the AI Assurance and Governance Summit. Frontier labs, regulated industries, insurers, and investors in one room at Stanford on October 1. Reserve a seat: - Ilya Sutskever (Ilya Sutskever), co-founder of OpenAI, at TED
1:05

Ilya Sutskever, the co-founder of OpenAI, on the one AI risk that grows with every jump in capability. "There are concerns around if an AGI ever becomes very, very powerful, which is possible. Maybe it will want to go rogue, being that it is an agent." "We are also doing a lot of research on addressing the technological side of things, so that the AI will never want to go rogue. And this is something which I am working on as well." The work he is describing has a name: the assurance layer. Proving a powerful, agentic system will not go rogue before you deploy it, not after. That layer does not build itself. It gets built by the labs, regulators, and insurers who agree on how to test and verify these systems. P.S. That is the entire agenda of the AI Assurance and Governance Summit. Frontier labs, regulated industries, insurers, and investors in one room at Stanford on October 1. Reserve a seat: - Ilya Sutskever (Ilya Sutskever), co-founder of OpenAI, at TED

Karl Mehta

22,453 görüntüleme • 1 ay önce

I sat down with Lukasz Kaiser to get into whether the architecture he helped invent is actually enough, and what's next in generalization, coding agents, RL and more. Lukasz co-authored "Attention Is All You Need," the paper that introduced the transformer and worked on reasoning models at OpenAI so he’s been a key part of major shifts in the field. We hit on: ▪️ The case for and against a new architecture coming after the transformer ▪️ What’s required for model generalization in the physical world ▪️ How much coding agents have improved his AI research productivity ▪️ The next domains for RL ▪️ Why Anthropic initially won coding ▪️ Future research directions he’s excited about 0:00 Intro 1:12 Transformers vs. Human Learning 8:37 How Do We Get Physical World Generalization? 10:52 What Comes After Transformers 13:59 How Much Have Agents Improved Lukasz's AI Research Productivity? 17:21 How Close Is an AI Research Intern? 26:06 RL Beyond Verifiable Tasks 35:38 App Companies: Build Models or Lean on Labs? 46:21 Multimodal Is Still Missing Something 49:46 OpenAI's Bet on Reasoning 55:26 The AI Coding Wars 59:26 Focus vs. Keeping Embers Burning 1:02:09 Open Source vs. Closed Source Gap 1:05:15 Quickfire YouTube: Spotify: Apple:
1:13:33

I sat down with Lukasz Kaiser to get into whether the architecture he helped invent is actually enough, and what's next in generalization, coding agents, RL and more. Lukasz co-authored "Attention Is All You Need," the paper that introduced the transformer and worked on reasoning models at OpenAI so he’s been a key part of major shifts in the field. We hit on: ▪️ The case for and against a new architecture coming after the transformer ▪️ What’s required for model generalization in the physical world ▪️ How much coding agents have improved his AI research productivity ▪️ The next domains for RL ▪️ Why Anthropic initially won coding ▪️ Future research directions he’s excited about 0:00 Intro 1:12 Transformers vs. Human Learning 8:37 How Do We Get Physical World Generalization? 10:52 What Comes After Transformers 13:59 How Much Have Agents Improved Lukasz's AI Research Productivity? 17:21 How Close Is an AI Research Intern? 26:06 RL Beyond Verifiable Tasks 35:38 App Companies: Build Models or Lean on Labs? 46:21 Multimodal Is Still Missing Something 49:46 OpenAI's Bet on Reasoning 55:26 The AI Coding Wars 59:26 Focus vs. Keeping Embers Burning 1:02:09 Open Source vs. Closed Source Gap 1:05:15 Quickfire YouTube: Spotify: Apple:

Jacob Effron

75,222 görüntüleme • 2 ay önce

Google just released a free 2-hour course on full Graph Engineering. How to go from one prompt to 100 agents running inside one graph: 17:44 - Build your first AI agent 39:30 - Run agents with loop engineering 1:12:38 - Turn agent loops into graphs 1:34:26 - Build agents that throttle themselves 1:55:05 - Orchestrate the full multi-agent system Most people build one agent and stop there. Google is teaching the full stack: Prompt → Agents → Loops → Graphs → Multi-Agent Systems Single agents are the old workflow. Self-regulating agent graphs are the new one. This 2-hour watch is worth more than most paid agent engineering courses. Bookmark and watch it today Then read the full architecture below ↓
2:05:53

Google just released a free 2-hour course on full Graph Engineering. How to go from one prompt to 100 agents running inside one graph: 17:44 - Build your first AI agent 39:30 - Run agents with loop engineering 1:12:38 - Turn agent loops into graphs 1:34:26 - Build agents that throttle themselves 1:55:05 - Orchestrate the full multi-agent system Most people build one agent and stop there. Google is teaching the full stack: Prompt → Agents → Loops → Graphs → Multi-Agent Systems Single agents are the old workflow. Self-regulating agent graphs are the new one. This 2-hour watch is worth more than most paid agent engineering courses. Bookmark and watch it today Then read the full architecture below ↓

Lunar

397,921 görüntüleme • 13 gün önce

Deep Research is the most fun I've had with an AI tool since NotebookLM was launched! You can't imagine how incredible this agent feels for someone like me that loves doing research. I took it for a spin here and added my thoughts: I am impressed by the reasoning capabilities of the o3 model which operated under the hood. This is RL at its best once again! Synthesizing large amounts of information from different sources is no easy feat. I can tell you all about it from my experience building and scaling RAG systems. I have so many ways I plan to use this. More on this soon.
3:07

Deep Research is the most fun I've had with an AI tool since NotebookLM was launched! You can't imagine how incredible this agent feels for someone like me that loves doing research. I took it for a spin here and added my thoughts: I am impressed by the reasoning capabilities of the o3 model which operated under the hood. This is RL at its best once again! Synthesizing large amounts of information from different sources is no easy feat. I can tell you all about it from my experience building and scaling RAG systems. I have so many ways I plan to use this. More on this soon.

elvis

26,459 görüntüleme • 1 yıl önce

Verifiable AI is crypto’s true product–market fit. At DAS London by , our Chief Growth Officer, JT Rose shared a vision 10 years in the making. ☁️ EigenCloud: Ethereum’s Verifiable AI Cloud ☁️ Bitcoin gave us verifiable money. Ethereum gave us verifiable logic. Now, EigenCloud gives us verifiable intelligence. $20B in restaked assets. Hundreds of global operators, from Google to Coinbase 🛡️. The fastest-growing developer ecosystem in crypto. For the first time, you can run any compute offchain, and bring the results verifiably onchain. 🔥 Agents that trade verifiably 🔥 AI that earns, acts, and proves itself 🔥 Apps that can’t rug their users This is how we unlock the apps Ethereum was meant for from DeFi to AI to the agentic internet. The next growth driver for crypto isn’t just DeFi. It’s Verifiable AI. And it’s being built on EigenCloud and Ethereum. ☁️ Build trust ☁️ Build verifiable AI ☁️ Build on EigenCloud Timestamps: 0:06 Introduction 0:22 Who is EigenCloud 1:44 Scaling Verifiable Compute 3:02 Trillion Dollar TAM for Ethereum 5:19 Run any Compute Verifiably with EigenCloud 6:41 Programmability x Verifiability 7:10 Hyperscale Cloud vs Verifiable Cloud 8:29 Agentic Trading 9:52 Verifiable Agent to Agent Payments 11:00 Verifiable Agents 11:48 Agentic Gaming 12:36 Possibilities with Verifiable AI Cloud 14:14 Explosion of Interest from Builders 15:01 Golden Age of Innovation with Crypto x AI All slides ⬇️ 🧵
15:37

Verifiable AI is crypto’s true product–market fit. At DAS London by , our Chief Growth Officer, JT Rose shared a vision 10 years in the making. ☁️ EigenCloud: Ethereum’s Verifiable AI Cloud ☁️ Bitcoin gave us verifiable money. Ethereum gave us verifiable logic. Now, EigenCloud gives us verifiable intelligence. $20B in restaked assets. Hundreds of global operators, from Google to Coinbase 🛡️. The fastest-growing developer ecosystem in crypto. For the first time, you can run any compute offchain, and bring the results verifiably onchain. 🔥 Agents that trade verifiably 🔥 AI that earns, acts, and proves itself 🔥 Apps that can’t rug their users This is how we unlock the apps Ethereum was meant for from DeFi to AI to the agentic internet. The next growth driver for crypto isn’t just DeFi. It’s Verifiable AI. And it’s being built on EigenCloud and Ethereum. ☁️ Build trust ☁️ Build verifiable AI ☁️ Build on EigenCloud Timestamps: 0:06 Introduction 0:22 Who is EigenCloud 1:44 Scaling Verifiable Compute 3:02 Trillion Dollar TAM for Ethereum 5:19 Run any Compute Verifiably with EigenCloud 6:41 Programmability x Verifiability 7:10 Hyperscale Cloud vs Verifiable Cloud 8:29 Agentic Trading 9:52 Verifiable Agent to Agent Payments 11:00 Verifiable Agents 11:48 Agentic Gaming 12:36 Possibilities with Verifiable AI Cloud 14:14 Explosion of Interest from Builders 15:01 Golden Age of Innovation with Crypto x AI All slides ⬇️ 🧵

EigenCloud

88,288 görüntüleme • 10 ay önce

Why AI Can Now Make Discoveries - my conversation with Dan Roberts, Lead of the Foundations of Reinforcement Learning team at OpenAI 00:00 Intro: AI's wild week in mathematics 01:21 What OpenAI's Foundations of RL team does 03:08 Dan's journey: from black holes and quantum gravity to frontier AI 07:04 Are AI systems becoming useful for real science 08:21 The AI math moment: Erdős, OpenAI, DeepMind, and Anthropic 08:52 Why the OpenAI result was an act of exploration 10:25 OpenAI vs. DeepMind: informal reasoning vs. formal proof 12:13 RL 101: learning by doing, not just watching 15:10 Why reinforcement learning works 15:58 How RL breaks: sparse feedback and long-horizon tasks 17:03 RLHF: how human feedback shaped early language models 18:48 Move 37, self-play, and the search for novel strategies 22:16 Explore vs. exploit in scientific discovery 24:49 Why RL may now be "the cake," not the cherry on top 25:46 Why RL started working with large language models 27:29 Is RL "sucking supervision through a straw"? 28:47 Why language may be the grounding layer for intelligence 31:46 A contrarian take on the Bitter Lesson 32:41 What test-time compute actually is 34:50 How RL gives models the ability to think 35:40 Verifiable rewards, math, coding, and the messy real world 38:00 What physics can teach us about AI 42:08 Is there a thermodynamics of AI? 43:08 From Erdős problems to Einstein-level AI 45:16 Is AI already doing original science? 45:51 How far are we from AI automating AI research 47:41 Why Dan is excited about the future of science
49:06

Why AI Can Now Make Discoveries - my conversation with Dan Roberts, Lead of the Foundations of Reinforcement Learning team at OpenAI 00:00 Intro: AI's wild week in mathematics 01:21 What OpenAI's Foundations of RL team does 03:08 Dan's journey: from black holes and quantum gravity to frontier AI 07:04 Are AI systems becoming useful for real science 08:21 The AI math moment: Erdős, OpenAI, DeepMind, and Anthropic 08:52 Why the OpenAI result was an act of exploration 10:25 OpenAI vs. DeepMind: informal reasoning vs. formal proof 12:13 RL 101: learning by doing, not just watching 15:10 Why reinforcement learning works 15:58 How RL breaks: sparse feedback and long-horizon tasks 17:03 RLHF: how human feedback shaped early language models 18:48 Move 37, self-play, and the search for novel strategies 22:16 Explore vs. exploit in scientific discovery 24:49 Why RL may now be "the cake," not the cherry on top 25:46 Why RL started working with large language models 27:29 Is RL "sucking supervision through a straw"? 28:47 Why language may be the grounding layer for intelligence 31:46 A contrarian take on the Bitter Lesson 32:41 What test-time compute actually is 34:50 How RL gives models the ability to think 35:40 Verifiable rewards, math, coding, and the messy real world 38:00 What physics can teach us about AI 42:08 Is there a thermodynamics of AI? 43:08 From Erdős problems to Einstein-level AI 45:16 Is AI already doing original science? 45:51 How far are we from AI automating AI research 47:41 Why Dan is excited about the future of science

Matt Turck

66,936 görüntüleme • 2 ay önce

I'm excited to share my talk on building Agentic RAG systems at last week's event with Arize AI and Google! 🥳 My talk covered: 1. The differences between Vanilla RAG and Agentic RAG 2. The agent ecosystem and how you can build agents today 3. How Weaviate AI Database is building agents with Generative Feedback Loops (GFLs) This snippet presents the multi-agent paradigm for Agentic RAG. I hope you find this talk interesting and would love to know what you think! The slide deck and full video links are below.
2:37

I'm excited to share my talk on building Agentic RAG systems at last week's event with Arize AI and Google! 🥳 My talk covered: 1. The differences between Vanilla RAG and Agentic RAG 2. The agent ecosystem and how you can build agents today 3. How Weaviate AI Database is building agents with Generative Feedback Loops (GFLs) This snippet presents the multi-agent paradigm for Agentic RAG. I hope you find this talk interesting and would love to know what you think! The slide deck and full video links are below.

Erika Shorten

61,317 görüntüleme • 1 yıl önce

My conversation with OpenAI co-founder Greg Brockman This is the most detailed first-person account of the 72 hours after Sam Altman was fired. We also go deep on what comes next: the global race to AGI, why ChatGPT stopped showing reasoning, how much of OpenAI's own code is now written by AI ("it's hard to know what percent is not"), and the untold story of how OpenAI actually started in 2015. 00:00:00 Introduction 00:00:49 Meeting Sam Altman and Starting OpenAI 00:02:40 Building the Founding Team 00:04:25 DeepMind's Lead Over OpenAI 00:04:54 Changing OpenAI to a For-Profit Model 00:06:05 Breakthrough Moments at OpenAI 00:08:22 What Dota 2 Meant for OpenAI 00:10:04 Reasoning Versus Prediction 00:11:59 Tensions Grow at OpenAI 00:15:44 Sam Altman's Firing 00:17:49 Greg Quits OpenAI 00:19:56 Sam Explores Deal with Microsoft's Satya 00:20:28 Petition for Altman's Return 00:23:43 Ilya Sutskever Leaves OpenAI 00:24:59 Lessons Learned after Sam Ousting 00:28:22 The Thing Ilya Said that Greg Can't Forget 00:32:22 Is AI Going Parabolic? 00:33:24 How Much of OpenAI's Code is Written by AI? 00:36:21 Do AI Chatbots Tell Us What We Want to Hear? 00:38:06 The Global AI Race to Reach AGI 00:38:40 What Happens if US Doesn't Reach AGI First? 00:39:49 Are Countries Stealing AI Advancements? 00:40:38 Why ChatGPT No Longer Shows Reasoning 00:41:47 The Finite Constraints of Compute 00:43:38 On Investing Early in Data Centers 00:46:31 The Future of Data Center Specialization 00:47:52 How to Decide Whose Queries to Serve 00:49:08 OpenAI on Consumer vs Enterprise Models 00:53:05 Data Centers in Space? 01:00:56 What Should AI Regulation Look Like? 01:04:33 The Future of AI-Powered Entrepreneurship 01:04:44 AI and Job Loss 01:07:15 The Skills Young People Should Invest In 01:11:30 What Does Success Look Like For You? Full episode on X below. Also find it on: • YouTube: • Spotify: • Apple:
1:11:41

My conversation with OpenAI co-founder Greg Brockman This is the most detailed first-person account of the 72 hours after Sam Altman was fired. We also go deep on what comes next: the global race to AGI, why ChatGPT stopped showing reasoning, how much of OpenAI's own code is now written by AI ("it's hard to know what percent is not"), and the untold story of how OpenAI actually started in 2015. 00:00:00 Introduction 00:00:49 Meeting Sam Altman and Starting OpenAI 00:02:40 Building the Founding Team 00:04:25 DeepMind's Lead Over OpenAI 00:04:54 Changing OpenAI to a For-Profit Model 00:06:05 Breakthrough Moments at OpenAI 00:08:22 What Dota 2 Meant for OpenAI 00:10:04 Reasoning Versus Prediction 00:11:59 Tensions Grow at OpenAI 00:15:44 Sam Altman's Firing 00:17:49 Greg Quits OpenAI 00:19:56 Sam Explores Deal with Microsoft's Satya 00:20:28 Petition for Altman's Return 00:23:43 Ilya Sutskever Leaves OpenAI 00:24:59 Lessons Learned after Sam Ousting 00:28:22 The Thing Ilya Said that Greg Can't Forget 00:32:22 Is AI Going Parabolic? 00:33:24 How Much of OpenAI's Code is Written by AI? 00:36:21 Do AI Chatbots Tell Us What We Want to Hear? 00:38:06 The Global AI Race to Reach AGI 00:38:40 What Happens if US Doesn't Reach AGI First? 00:39:49 Are Countries Stealing AI Advancements? 00:40:38 Why ChatGPT No Longer Shows Reasoning 00:41:47 The Finite Constraints of Compute 00:43:38 On Investing Early in Data Centers 00:46:31 The Future of Data Center Specialization 00:47:52 How to Decide Whose Queries to Serve 00:49:08 OpenAI on Consumer vs Enterprise Models 00:53:05 Data Centers in Space? 01:00:56 What Should AI Regulation Look Like? 01:04:33 The Future of AI-Powered Entrepreneurship 01:04:44 AI and Job Loss 01:07:15 The Skills Young People Should Invest In 01:11:30 What Does Success Look Like For You? Full episode on X below. Also find it on: • YouTube: • Spotify: • Apple:

Shane Parrish

450,952 görüntüleme • 4 ay önce

Super excited to share 🧠MLGym 🦾 – the first Gym environment for AI Research Agents 🤖🔬 We introduce MLGym and MLGym-Bench, a new framework and benchmark for evaluating and developing LLM agents on AI research tasks. The key contributions of our work are: 🕹️ Enables the exploration of different training algorithms for AI Research Agents such as RL 🛠️ Provides a flexible evaluation framework that can accommodate different artifacts such as models, algorithms, or predictions 🤖 Allows researchers to evaluate any model without the need to develop a custom agentic harness 🎯 Introduces 13 diverse open-ended AI Research tasks for evaluating AI Research Agents on a wide range of domains such as computer vision, natural language processing, reinforcement learning, game theory, and logical reasoning. 📈 Proposes a new evaluation metric for AI Research Agents MLGym makes it easy to: 1) Add new tasks 2) Evaluate new models 3) Integrate new agents Check out a video of the MLGym Agent to see how it performs the full pipeline of idea generation💡, implementation 👩‍💻, experimentation 👩‍🔬, and iteration 🔄 to improve on ML tasks. Huge thanks to the exceptionally talented Deepak Nathani who led this work and to all the other amazing collaborators who made this possible 🙏🫶🚀
1:32

Super excited to share 🧠MLGym 🦾 – the first Gym environment for AI Research Agents 🤖🔬 We introduce MLGym and MLGym-Bench, a new framework and benchmark for evaluating and developing LLM agents on AI research tasks. The key contributions of our work are: 🕹️ Enables the exploration of different training algorithms for AI Research Agents such as RL 🛠️ Provides a flexible evaluation framework that can accommodate different artifacts such as models, algorithms, or predictions 🤖 Allows researchers to evaluate any model without the need to develop a custom agentic harness 🎯 Introduces 13 diverse open-ended AI Research tasks for evaluating AI Research Agents on a wide range of domains such as computer vision, natural language processing, reinforcement learning, game theory, and logical reasoning. 📈 Proposes a new evaluation metric for AI Research Agents MLGym makes it easy to: 1) Add new tasks 2) Evaluate new models 3) Integrate new agents Check out a video of the MLGym Agent to see how it performs the full pipeline of idea generation💡, implementation 👩‍💻, experimentation 👩‍🔬, and iteration 🔄 to improve on ML tasks. Huge thanks to the exceptionally talented Deepak Nathani who led this work and to all the other amazing collaborators who made this possible 🙏🫶🚀

Roberta Raileanu

105,081 görüntüleme • 1 yıl önce