正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Building AI agents? 🚧 Make sure they actually know where their answers come from. As Brana Rakic demonstrates, scalable AI requires verifiable knowledge, rule-based reasoning, and LLMs grounded in trusted memory. Key highlights: 03:25 - From human data to era of experience 07:42 - Agent architecture: memory + models... show more

OriginTrail

91,465 subscribers

17,750 次观看 • 6 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Traces, knowledge, and reasoning paths form a reliable source of truth for AI agents. 🤝 Charles Ivie, former Senior Graph Architect at Amazon Web Services, on why knowledge-backed traces are essential for trustworthy AI. 03:34 – Why data origin matters 07:17 – Interoperability and trusted knowledge 11:12 – Knowledge graphs as structured AI memory 16:09 – How combining graphs improves trust

Traces, knowledge, and reasoning paths form a reliable source of truth for AI agents. 🤝 Charles Ivie, former Senior Graph Architect at Amazon Web Services, on why knowledge-backed traces are essential for trustworthy AI. 03:34 – Why data origin matters 07:17 – Interoperability and trusted knowledge 11:12 – Knowledge graphs as structured AI memory 16:09 – How combining graphs improves trust

OriginTrail

12,528 次观看 • 7 个月前

Andrew Ng just released a free 1-hour course on building agentic knowledge graphs from scratch. How to turn raw data into structured memory for AI agents: 00:00 - Understand agentic knowledge graphs 03:07 - Build your first agentic graph 14:00 - Architect multi-agent systems 23:00 - Build graphs with Google ADK 1:06:03 - See why graphs are the future of agents Most people are still building agents with flat context. Andrew Ng is already teaching the next layer: Data → Relationships → Memory → Agents → Graphs Loop engineering is the old workflow. Graph engineering is the new one. This 1-hour course is worth more than most paid agent engineering courses. Bookmark and watch it before everyone catches up. Then read the full Graph Engineering roadmap below

Andrew Ng just released a free 1-hour course on building agentic knowledge graphs from scratch. How to turn raw data into structured memory for AI agents: 00:00 - Understand agentic knowledge graphs 03:07 - Build your first agentic graph 14:00 - Architect multi-agent systems 23:00 - Build graphs with Google ADK 1:06:03 - See why graphs are the future of agents Most people are still building agents with flat context. Andrew Ng is already teaching the next layer: Data → Relationships → Memory → Agents → Graphs Loop engineering is the old workflow. Graph engineering is the new one. This 1-hour course is worth more than most paid agent engineering courses. Bookmark and watch it before everyone catches up. Then read the full Graph Engineering roadmap below

Lunar

46,272 次观看 • 21 天前

BREAKING: AI has eaten the Internet. Data labeling is so over. & $30 trillion of human work is on the verge of automation. Inside The $2.2B AI Research Accelerator, Turing Founder & CEO, Jonathan Siddharth (), joins Sourcery to break down the severe power shift in AI training: from commodity data labeling → expert research Positioning Turing apart from AI data providers like Scale AI, Mercor, & Surge. (00:00) AI Ate The Internet (00:49) Training Superintelligence: the race to AGI (02:31) Viral tweet (03:24) What Turing actually does (04:43) The internet data is “used up” — where will new data come from? (05:34) Four pillars of superintelligence: multimodality, reasoning, tool use, coding (06:07) Automating $30T of global knowledge work (09:18) The $1B revenue opportunity (10:59) Why Turing is a research-first accelerator, not a data labeler (13:45) Jonathan’s Stanford AI Lab roots & founding DNA (17:57) How models are built: pre-training vs. post-training (20:14) RLHF, reinforcement learning, & “breaking the models” (25:19) GPT-5 and the myth of rapid takeoff (30:46) Safety debates and human-in-the-loop systems (34:53) Closing Enterprise Gap: finance, insurance, & pharma (39:23) Why proprietary enterprise data is the next moat in AI

BREAKING: AI has eaten the Internet. Data labeling is so over. & $30 trillion of human work is on the verge of automation. Inside The $2.2B AI Research Accelerator, Turing Founder & CEO, Jonathan Siddharth (), joins Sourcery to break down the severe power shift in AI training: from commodity data labeling → expert research Positioning Turing apart from AI data providers like Scale AI, Mercor, & Surge. (00:00) AI Ate The Internet (00:49) Training Superintelligence: the race to AGI (02:31) Viral tweet (03:24) What Turing actually does (04:43) The internet data is “used up” — where will new data come from? (05:34) Four pillars of superintelligence: multimodality, reasoning, tool use, coding (06:07) Automating $30T of global knowledge work (09:18) The $1B revenue opportunity (10:59) Why Turing is a research-first accelerator, not a data labeler (13:45) Jonathan’s Stanford AI Lab roots & founding DNA (17:57) How models are built: pre-training vs. post-training (20:14) RLHF, reinforcement learning, & “breaking the models” (25:19) GPT-5 and the myth of rapid takeoff (30:46) Safety debates and human-in-the-loop systems (34:53) Closing Enterprise Gap: finance, insurance, & pharma (39:23) Why proprietary enterprise data is the next moat in AI

Molly O’Shea

70,007 次观看 • 10 个月前

Eve Bodnia is the co-founder and CEO of Logical Intelligence, which is developing energy-based reasoning models (EBMs) as an alternative to large language models. She argues that LLMs, which operate by recognizing and recombining patterns within language space, are structurally incapable of genuine reasoning. In our conversation, we explore: • The $4 vs. $15,000 benchmark, and what it tells us about the cost of guessing vs. knowing • How Logical Intelligence showed spontaneous knowledge transfer at just 16M parameters • Why systems like chip design, surgical robotics, and power grids need more than probabilistic AI • How meeting Grigori Perelman as a teenager shaped Eve’s views on ego and ownership in science Thank you to the partners who make this possible - Granola: The app that might actually make you love meetings: - : Trusted identity verification for any use case: Timestamps (00:00) Introduction (03:03) Eve’s encounter with Grigori Perelman (09:02) The manifold hypothesis and language (22:58) Spirituality and creativity (27:00) Theory vs. experiment (42:08) Energy-based models explained (48:01) AGI defined (58:09) Early investors in Logical Intelligence (1:03:42) Final meditations

Eve Bodnia is the co-founder and CEO of Logical Intelligence, which is developing energy-based reasoning models (EBMs) as an alternative to large language models. She argues that LLMs, which operate by recognizing and recombining patterns within language space, are structurally incapable of genuine reasoning. In our conversation, we explore: • The $4 vs. $15,000 benchmark, and what it tells us about the cost of guessing vs. knowing • How Logical Intelligence showed spontaneous knowledge transfer at just 16M parameters • Why systems like chip design, surgical robotics, and power grids need more than probabilistic AI • How meeting Grigori Perelman as a teenager shaped Eve’s views on ego and ownership in science Thank you to the partners who make this possible - Granola: The app that might actually make you love meetings: - : Trusted identity verification for any use case: Timestamps (00:00) Introduction (03:03) Eve’s encounter with Grigori Perelman (09:02) The manifold hypothesis and language (22:58) Spirituality and creativity (27:00) Theory vs. experiment (42:08) Energy-based models explained (48:01) AGI defined (58:09) Early investors in Logical Intelligence (1:03:42) Final meditations

Mario Gabriele

20,207 次观看 • 6 个月前

Join our VP (Drastic) Research, Gemini co-Tech Lead Oriol Vinyals and our podcast host Hannah Fry as they discuss the evolution of our AI models, from AlphaGo to Gemini. They also cover agentic capabilities and why giving AI access to tools could lead to a new era of problem-solving. Listen now ↓ Timecodes: 00:00 Intro 02:30 Games and early AI agents 04:28 Weights 09:27 Architectures and a digital brain 10:24 Agentic behaviour 13:31 Digital body 14:09 Scaling 19:02 Data 20:59 Complex understanding and knowledge 25:14 Post training challenges 30:43 Reasoning 33:11 Planning 34:19 Systems 2 37:00 Memory 40:54 Gemini and agentic capabilities

Join our VP (Drastic) Research, Gemini co-Tech Lead Oriol Vinyals and our podcast host Hannah Fry as they discuss the evolution of our AI models, from AlphaGo to Gemini. They also cover agentic capabilities and why giving AI access to tools could lead to a new era of problem-solving. Listen now ↓ Timecodes: 00:00 Intro 02:30 Games and early AI agents 04:28 Weights 09:27 Architectures and a digital brain 10:24 Agentic behaviour 13:31 Digital body 14:09 Scaling 19:02 Data 20:59 Complex understanding and knowledge 25:14 Post training challenges 30:43 Reasoning 33:11 Planning 34:19 Systems 2 37:00 Memory 40:54 Gemini and agentic capabilities

Google DeepMind

57,351 次观看 • 1 年前

Epiplexity, Reasoning & The "Alien" Behavior of LLMs: my conversation with Pavel Izmailov, AI researcher at Anthropic and professor at New York University. 00:00 - Intro 00:53 - Alien survival instincts: is continual learning about to create a major alignment problem? Riffing on the post by 🍓🍓🍓 03:33 - Did AI learn deception from sci-fi literature? 05:55 - Defining Alignment, Superalignment & OpenAI teams 08:12 - Pavel’s journey: From Russian math to OpenAI Superalignment 10:46 - Culture check: OpenAI vs. Anthropic vs. Academia 11:54 - Why move to NYU? Academia and the need for exploratory research 13:09 - Does reasoning make AI alignment harder or easier? 14:22 - Sandbagging: When models pretend to be dumb 16:19 - Scalable Oversight: Using AI to supervise AI 18:04 - Weak-to-Strong Generalization 22:43 - Mechanistic Interpretability: Inside the black box 25:08 - The reasoning explosion 27:07 - Are Transformers enough or do we need a new paradigm? 28:29 - RL vs. Test-Time Compute: What’s actually driving progress? 30:10 - Long-horizon tasks: Agents running for hours 31:49 - Epiplexity: A new theory of data information content - Pavel's work with Marc Finzi, Zico Kolter, Andrew Gordon Wilson, Yiding Jiang and Shikai Qiu. 38:29 - 2026 Predictions: Multi-agent systems & reasoning limits 39:28 - AI & Scientific progress 41:42 - Advice for PhD students

Epiplexity, Reasoning & The "Alien" Behavior of LLMs: my conversation with Pavel Izmailov, AI researcher at Anthropic and professor at New York University. 00:00 - Intro 00:53 - Alien survival instincts: is continual learning about to create a major alignment problem? Riffing on the post by 🍓🍓🍓 03:33 - Did AI learn deception from sci-fi literature? 05:55 - Defining Alignment, Superalignment & OpenAI teams 08:12 - Pavel’s journey: From Russian math to OpenAI Superalignment 10:46 - Culture check: OpenAI vs. Anthropic vs. Academia 11:54 - Why move to NYU? Academia and the need for exploratory research 13:09 - Does reasoning make AI alignment harder or easier? 14:22 - Sandbagging: When models pretend to be dumb 16:19 - Scalable Oversight: Using AI to supervise AI 18:04 - Weak-to-Strong Generalization 22:43 - Mechanistic Interpretability: Inside the black box 25:08 - The reasoning explosion 27:07 - Are Transformers enough or do we need a new paradigm? 28:29 - RL vs. Test-Time Compute: What’s actually driving progress? 30:10 - Long-horizon tasks: Agents running for hours 31:49 - Epiplexity: A new theory of data information content - Pavel's work with Marc Finzi, Zico Kolter, Andrew Gordon Wilson, Yiding Jiang and Shikai Qiu. 38:29 - 2026 Predictions: Multi-agent systems & reasoning limits 39:28 - AI & Scientific progress 41:42 - Advice for PhD students

Matt Turck

23,020 次观看 • 7 个月前

"There may be some neuro-symbolic hybrid much better than we have right now that smoothly transitions between data in a corpus and abstract representations. The kinds of stuff you guys are doing are compatible with that." — Gary Marcus ⏱️10 highlights: 00:00 Intro: Gary Marcus & Brana Rakic at DKGCon 02:22 Why AI took a wrong turn 04:42 Deep learning vs. deep understanding 06:16 World models: a foundational idea 08:12 The building blocks of trustworthy AI 09:44 Neuro-symbolic AI & abstract relationships 13:04 Safety is an ecosystem - the airplane lesson 15:03 The real risk of AI agents today 18:36 Testing AI like we test new drugs 22:49 Where OpenAI is headed The signal is clear: the path forward runs through world models, abstraction, and an open, accountable ecosystem.

"There may be some neuro-symbolic hybrid much better than we have right now that smoothly transitions between data in a corpus and abstract representations. The kinds of stuff you guys are doing are compatible with that." — Gary Marcus ⏱️10 highlights: 00:00 Intro: Gary Marcus & Brana Rakic at DKGCon 02:22 Why AI took a wrong turn 04:42 Deep learning vs. deep understanding 06:16 World models: a foundational idea 08:12 The building blocks of trustworthy AI 09:44 Neuro-symbolic AI & abstract relationships 13:04 Safety is an ecosystem - the airplane lesson 15:03 The real risk of AI agents today 18:36 Testing AI like we test new drugs 22:49 Where OpenAI is headed The signal is clear: the path forward runs through world models, abstraction, and an open, accountable ecosystem.

OriginTrail

227,307 次观看 • 2 个月前

Amjad Masad and Marc Andreessen on AI agents, AGI, Creativity, and Reasoning Agents are getting better, fast. Replit Agent v1 could do only 2 minutes of coherent work. v2 could do 20 minutes. Today’s v3? 200 minutes. As agents get more and more reliable, we can make huge progress in coding without ever achieving “true” AGI. In this episode, Marc Andreessen and Erik Torenberg sit down with Replit ⠕ co-founder and CEO Amjad Masad to discuss the upward trajectory of agents, how RL unlocked reasoning for modern models, why verification loops changed everything, and whether LLMs are hitting diminishing returns. 00:00 Intro 03:00 The vision behind Replit 07:00 Building apps with AI agents 09:30 When the agent becomes the programmer 13:45 Reinforcement learning and problem solving 17:30 The verification loop and multi-agent systems 26:00 Why coding is advancing faster than other Fields 33:45 AGI debate 41:15 Functional AGI and automating labor 53:10 Creativity, reasoning, and finding truth in AI 57:30 The origins of Replit 01:03:00 Hacking his university and getting caught Amjad Masad Marc Andreessen 🇺🇸 Erik Torenberg

Amjad Masad and Marc Andreessen on AI agents, AGI, Creativity, and Reasoning Agents are getting better, fast. Replit Agent v1 could do only 2 minutes of coherent work. v2 could do 20 minutes. Today’s v3? 200 minutes. As agents get more and more reliable, we can make huge progress in coding without ever achieving “true” AGI. In this episode, Marc Andreessen and Erik Torenberg sit down with Replit ⠕ co-founder and CEO Amjad Masad to discuss the upward trajectory of agents, how RL unlocked reasoning for modern models, why verification loops changed everything, and whether LLMs are hitting diminishing returns. 00:00 Intro 03:00 The vision behind Replit 07:00 Building apps with AI agents 09:30 When the agent becomes the programmer 13:45 Reinforcement learning and problem solving 17:30 The verification loop and multi-agent systems 26:00 Why coding is advancing faster than other Fields 33:45 AGI debate 41:15 Functional AGI and automating labor 53:10 Creativity, reasoning, and finding truth in AI 57:30 The origins of Replit 01:03:00 Hacking his university and getting caught Amjad Masad Marc Andreessen 🇺🇸 Erik Torenberg

a16z

741,248 次观看 • 10 个月前

🚨NEW EPISODE: AI Is Changing How We Work with Crypto Data🚨 In today's episode, we're joined by Kofi to discuss how AI agents are fundamentally changing crypto data analysis, research, and engineering workflows. We discuss: - The evolution from manual coding to AI-assisted development - How MCPs unlock onchain data exploration - Using Herd MCP to analyze smart contracts - AI agents for protocol research and data engineering - Context windows, planning, and agent workflows - Cursor vs OpenCode vs Claude Code (Anthropic) - Managing multiple agents simultaneously - Model selection, costs, and productivity tradeoffs - Building internal AI knowledge bases - Agent orchestration and autonomous workflows - Training agents to replicate human expertise - The future of AI-powered crypto analytics - And much more—enjoy! — Timestamps: (00:00) Introduction (01:24) AI replaces frontends (03:24) Herd MCP demo (05:40) Exploring contracts with AI (08:06) Exploration, planning, execution (11:38) Investigating onchain activity (17:10) Managing agent workflows (20:20) Multi-agent productivity (23:01) Model selection tradeoffs (29:11) Trusting AI outputs (31:28) Missing links today (34:37) Agent orchestration future (38:02) Training agents from work (38:20) Outro

🚨NEW EPISODE: AI Is Changing How We Work with Crypto Data🚨 In today's episode, we're joined by Kofi to discuss how AI agents are fundamentally changing crypto data analysis, research, and engineering workflows. We discuss: - The evolution from manual coding to AI-assisted development - How MCPs unlock onchain data exploration - Using Herd MCP to analyze smart contracts - AI agents for protocol research and data engineering - Context windows, planning, and agent workflows - Cursor vs OpenCode vs Claude Code (Anthropic) - Managing multiple agents simultaneously - Model selection, costs, and productivity tradeoffs - Building internal AI knowledge bases - Agent orchestration and autonomous workflows - Training agents to replicate human expertise - The future of AI-powered crypto analytics - And much more—enjoy! — Timestamps: (00:00) Introduction (01:24) AI replaces frontends (03:24) Herd MCP demo (05:40) Exploring contracts with AI (08:06) Exploration, planning, execution (11:38) Investigating onchain activity (17:10) Managing agent workflows (20:20) Multi-agent productivity (23:01) Model selection tradeoffs (29:11) Trusting AI outputs (31:28) Missing links today (34:37) Agent orchestration future (38:02) Training agents from work (38:20) Outro

Indexed Podcast

10,562 次观看 • 2 个月前

RAG might already be becoming obsolete. A month ago, Andrej Karpathy dropped a simple GitHub gist called “LLM Wiki.” Now the comments section looks like the birth of an entirely new AI category. 5000+ stars later, developers are rapidly building: • persistent AI memory systems • self-maintaining knowledge bases • multi-agent research environments • contradiction detection engines • AI-native company operating systems • local-first memory architectures • graph-based reasoning layers • evolving second brains And the craziest part? Most of them were built in DAYS. Because the core idea is insanely powerful: Instead of AI repeatedly retrieving raw chunks like traditional RAG… …the model continuously maintains a living knowledge system. Not temporary context. Persistent synthesis. The shift sounds subtle until you realize what it changes: RAG: retrieve → answer → forget LLM Wiki: ingest → synthesize → evolve That one architectural difference is causing an explosion of experimentation right now. People are already building: • agent memory operating systems • AI-maintained engineering documentation • self-healing knowledge graphs • persistent research environments • conversational memory architectures • contradiction-aware wikis • context compression engines • machine-readable company systems The comments section alone feels like watching an ecosystem form in real time. One developer built deterministic contradiction detection using sheaf cohomology Another built “sleep consolidation” for AI memory systems inspired by human memory formation Another created persistent multi-agent vault conversations Another turned entire repositories into continuously maintained AI wikis Another built local-first memory systems with audit trails, provenance, graph exports, and MCP integration This is the important part: Karpathy didn’t launch a product. He introduced a pattern. And patterns are what create ecosystems. The same way: • transformers created modern AI • RAG created AI retrieval startups • agents created orchestration frameworks LLM Wikis may create persistent AI memory infrastructure. That’s why this moment feels different. For years, AI systems have been stateless. Now developers are trying to build systems that actually accumulate understanding over time. And once knowledge compounds instead of resetting… …the entire interface layer of AI changes. (Link in comments)

RAG might already be becoming obsolete. A month ago, Andrej Karpathy dropped a simple GitHub gist called “LLM Wiki.” Now the comments section looks like the birth of an entirely new AI category. 5000+ stars later, developers are rapidly building: • persistent AI memory systems • self-maintaining knowledge bases • multi-agent research environments • contradiction detection engines • AI-native company operating systems • local-first memory architectures • graph-based reasoning layers • evolving second brains And the craziest part? Most of them were built in DAYS. Because the core idea is insanely powerful: Instead of AI repeatedly retrieving raw chunks like traditional RAG… …the model continuously maintains a living knowledge system. Not temporary context. Persistent synthesis. The shift sounds subtle until you realize what it changes: RAG: retrieve → answer → forget LLM Wiki: ingest → synthesize → evolve That one architectural difference is causing an explosion of experimentation right now. People are already building: • agent memory operating systems • AI-maintained engineering documentation • self-healing knowledge graphs • persistent research environments • conversational memory architectures • contradiction-aware wikis • context compression engines • machine-readable company systems The comments section alone feels like watching an ecosystem form in real time. One developer built deterministic contradiction detection using sheaf cohomology Another built “sleep consolidation” for AI memory systems inspired by human memory formation Another created persistent multi-agent vault conversations Another turned entire repositories into continuously maintained AI wikis Another built local-first memory systems with audit trails, provenance, graph exports, and MCP integration This is the important part: Karpathy didn’t launch a product. He introduced a pattern. And patterns are what create ecosystems. The same way: • transformers created modern AI • RAG created AI retrieval startups • agents created orchestration frameworks LLM Wikis may create persistent AI memory infrastructure. That’s why this moment feels different. For years, AI systems have been stateless. Now developers are trying to build systems that actually accumulate understanding over time. And once knowledge compounds instead of resetting… …the entire interface layer of AI changes. (Link in comments)

Suryansh Tiwari

142,314 次观看 • 3 个月前

Can #AI not only support but actually drive the future of scientific discovery? We are excited to introduce SciAgents💡🔬, an agentic AI aimed towards scientific discovery through the integration of large-scale knowledge graphs, LLMs, and adversarial interactions between multiple experts. The model is capable of autonomously advancing scientific understanding by exploring novel domains, identifying complex patterns, and uncovering previously unseen connections in vast scientific data, while retrieving new data via literature search. Using graph reasoning, SciAgents identifies interdisciplinary relationships that might otherwise remain hidden, offering a step-by-step strategy for discovery & innovation. The video features an audiotrack generated using 🍓#o1 based on the original paper and design examples, providing an explanation of the work and its implications. Key elements include: 1⃣Ontological Knowledge Graphs: Structuring and connecting scientific concepts to highlight relationships across fields. 2⃣Multi-Agent Collaboration: AI agents autonomously generate and refine hypotheses, critique research, and evaluate emerging trends. 3⃣Graph-Based Reasoning: Identifying novel material designs, such as mycelium-based composites or silk-pigment blends, informed by both natural and artificial patterns. SciAgents can be used as an autonomous or collaborative tool to assist human researchers. The system offers a more powerful way to process vast data, providing innovative paths to explore nature-inspired designs or unexpected material properties. In the field of materials science, for instance, SciAgents has already demonstrated how principles from biology, music, and art can converge to create new biomimetic materials. Through isomorphic mapping, parallels have been drawn between Beethoven’s 9th Symphony and biological structures, pointing to a broader applicability of AI-driven insights across disciplines. This project allows us to enhance capabilities of researchers, allowing them to explore larger datasets and propose hypotheses grounded in a vast, interconnected web of knowledge. The agentic system was built using Auto Gen #AI #ScientificResearch #GraphReasoning #AI4Science #MaterialsScience #InterdisciplinaryResearch #SciAgents #OpenAI Chi Wang

Can #AI not only support but actually drive the future of scientific discovery? We are excited to introduce SciAgents💡🔬, an agentic AI aimed towards scientific discovery through the integration of large-scale knowledge graphs, LLMs, and adversarial interactions between multiple experts. The model is capable of autonomously advancing scientific understanding by exploring novel domains, identifying complex patterns, and uncovering previously unseen connections in vast scientific data, while retrieving new data via literature search. Using graph reasoning, SciAgents identifies interdisciplinary relationships that might otherwise remain hidden, offering a step-by-step strategy for discovery & innovation. The video features an audiotrack generated using 🍓#o1 based on the original paper and design examples, providing an explanation of the work and its implications. Key elements include: 1⃣Ontological Knowledge Graphs: Structuring and connecting scientific concepts to highlight relationships across fields. 2⃣Multi-Agent Collaboration: AI agents autonomously generate and refine hypotheses, critique research, and evaluate emerging trends. 3⃣Graph-Based Reasoning: Identifying novel material designs, such as mycelium-based composites or silk-pigment blends, informed by both natural and artificial patterns. SciAgents can be used as an autonomous or collaborative tool to assist human researchers. The system offers a more powerful way to process vast data, providing innovative paths to explore nature-inspired designs or unexpected material properties. In the field of materials science, for instance, SciAgents has already demonstrated how principles from biology, music, and art can converge to create new biomimetic materials. Through isomorphic mapping, parallels have been drawn between Beethoven’s 9th Symphony and biological structures, pointing to a broader applicability of AI-driven insights across disciplines. This project allows us to enhance capabilities of researchers, allowing them to explore larger datasets and propose hypotheses grounded in a vast, interconnected web of knowledge. The agentic system was built using Auto Gen #AI #ScientificResearch #GraphReasoning #AI4Science #MaterialsScience #InterdisciplinaryResearch #SciAgents #OpenAI Chi Wang

Markus J. Buehler

209,581 次观看 • 1 年前

AI has a trust problem. Verifiability is the solution. Our GM of AI Nima Vaziri sat down with a16z’s Ali Yahya and Dan Boneh of Stanford University to map the deepest fault lines in AI today. ☁️ Models we can’t trust ☁️ Current providers can censor, shut down, or shift rules overnight. Outsourced training hides backdoors. Even “open” weights don’t prove what’s actually running. Trust. Backdoors. Black boxes. The path forward is clear: 🔥 Verifiable evals 🔥 Verifiable inference 🔥 TEEs for hardware-backed integrity 🔥 Infra beyond single points of control 🔥 Blockchains as coordination layers for AI From “trust us” to “verify yourself.” That’s the shift. That’s the unlock. The frontier is here. The builders decide what comes next. Create and use AI that’s incentive aligned with you. Timestamps: 00:00:00 Introduction: AI & Crypto Intersection Overview 00:01:58 Four Major AI-Crypto Trends 00:02:44 AI Agents Need Financial Infrastructure 00:04:03 Proof of Humanity: Fighting AI-Generated Content 00:04:17 Decentralizing AI Infrastructure Networks 00:04:44 Synthetic Life: Autonomous AI Agents 00:06:20 Verifiable AI 00:10:16 Current Performance Numbers for AI Proofs 00:13:18 The Era of Experience in AI Learning 00:14:56 AI Agents Having Life of its Own 00:18:21 Algorithmic Fairness & Verifiable Models 00:23:18 Privacy in AI: Trusted Execution Environments 00:25:47 Economic Incentive for Open Weight Models 00:31:39 Attribution Problem: Who Gets Paid for AI Training? 00:35:52 Content Provenance & Authentication (C2PA) 00:48:03 AI Security: Finding Exploits & Vulnerabilities 00:54:53 Educational Applications: LLMs as Learning Partner 00:58:29 Reliance on LLMs and Cognitive Abilities 01:03:57 Content Providers’ Fear of LLM Training

AI has a trust problem. Verifiability is the solution. Our GM of AI Nima Vaziri sat down with a16z’s Ali Yahya and Dan Boneh of Stanford University to map the deepest fault lines in AI today. ☁️ Models we can’t trust ☁️ Current providers can censor, shut down, or shift rules overnight. Outsourced training hides backdoors. Even “open” weights don’t prove what’s actually running. Trust. Backdoors. Black boxes. The path forward is clear: 🔥 Verifiable evals 🔥 Verifiable inference 🔥 TEEs for hardware-backed integrity 🔥 Infra beyond single points of control 🔥 Blockchains as coordination layers for AI From “trust us” to “verify yourself.” That’s the shift. That’s the unlock. The frontier is here. The builders decide what comes next. Create and use AI that’s incentive aligned with you. Timestamps: 00:00:00 Introduction: AI & Crypto Intersection Overview 00:01:58 Four Major AI-Crypto Trends 00:02:44 AI Agents Need Financial Infrastructure 00:04:03 Proof of Humanity: Fighting AI-Generated Content 00:04:17 Decentralizing AI Infrastructure Networks 00:04:44 Synthetic Life: Autonomous AI Agents 00:06:20 Verifiable AI 00:10:16 Current Performance Numbers for AI Proofs 00:13:18 The Era of Experience in AI Learning 00:14:56 AI Agents Having Life of its Own 00:18:21 Algorithmic Fairness & Verifiable Models 00:23:18 Privacy in AI: Trusted Execution Environments 00:25:47 Economic Incentive for Open Weight Models 00:31:39 Attribution Problem: Who Gets Paid for AI Training? 00:35:52 Content Provenance & Authentication (C2PA) 00:48:03 AI Security: Finding Exploits & Vulnerabilities 00:54:53 Educational Applications: LLMs as Learning Partner 00:58:29 Reliance on LLMs and Cognitive Abilities 01:03:57 Content Providers’ Fear of LLM Training

EigenCloud

62,099 次观看 • 11 个月前

In this episode, Engram co-founder and CEO Dan Biderman joins allen to cook Mediterranean meatballs with yellow rice and talk about building AI that actually learns from you: why long context, RAG, and compaction eventually break down, how Engram compresses knowledge into cartridges and model weights, what continual learning could unlock for long-horizon agents, why token efficiency is inseparable from intelligence, how personal models could improve like Tamagotchis, and what it takes to build the research and infrastructure for millions of continuously updated AI memories. Timestamps: 0:00 Intro 0:26 Engram’s $98M Launch and Meatballs 1:45 From Naval Special Operations to AI Research 4:32 Israeli Military Culture and Founder Maturity 7:12 Why Engram Is Betting on Context and Continual Learning 9:14 Knowledge Cartridges, Compression, and Model Intuition 14:10 Trillion-Token Company Knowledge and Context Rot 18:05 Long-Context Limits, Compaction, and Neural Memory 22:20 Test-Time Training and “Destroying Prefill” 24:31 Harvey and Holistic Enterprise Queries Beyond RAG 27:02 Personal AI Models and Tamagotchi Weights 30:00 What Belongs in Weights vs. Text 32:25 Autonomous Memory and User-Specific Feedback Loops 34:20 Token Efficiency, Model Routing, and Harder Tasks 38:03 Engram’s Research Team and Product Culture 43:02 Hiring Researchers and Infrastructure Engineers 45:25 Doing More With Less 47:41 Where to Find Engram 48:19 Final Taste Test

In this episode, Engram co-founder and CEO Dan Biderman joins allen to cook Mediterranean meatballs with yellow rice and talk about building AI that actually learns from you: why long context, RAG, and compaction eventually break down, how Engram compresses knowledge into cartridges and model weights, what continual learning could unlock for long-horizon agents, why token efficiency is inseparable from intelligence, how personal models could improve like Tamagotchis, and what it takes to build the research and infrastructure for millions of continuously updated AI memories. Timestamps: 0:00 Intro 0:26 Engram’s $98M Launch and Meatballs 1:45 From Naval Special Operations to AI Research 4:32 Israeli Military Culture and Founder Maturity 7:12 Why Engram Is Betting on Context and Continual Learning 9:14 Knowledge Cartridges, Compression, and Model Intuition 14:10 Trillion-Token Company Knowledge and Context Rot 18:05 Long-Context Limits, Compaction, and Neural Memory 22:20 Test-Time Training and “Destroying Prefill” 24:31 Harvey and Holistic Enterprise Queries Beyond RAG 27:02 Personal AI Models and Tamagotchi Weights 30:00 What Belongs in Weights vs. Text 32:25 Autonomous Memory and User-Specific Feedback Loops 34:20 Token Efficiency, Model Routing, and Harder Tasks 38:03 Engram’s Research Team and Product Culture 43:02 Hiring Researchers and Infrastructure Engineers 45:25 Doing More With Less 47:41 Where to Find Engram 48:19 Final Taste Test

Latent.Space

34,076 次观看 • 1 个月前

Why AI Progress Suddenly Feels Real - my conversation with Yann Dubois, who co-leads the Post-Training Frontiers team at OpenAI 00:00 - Intro 01:30 - Why recent AI progress feels like a step function 04:13 - Model reliability & the emotional rollercoaster of shipping GPT-5.5 07:33 - How OpenAI structures vertical and horizontal teams 09:49 - Improving model efficiency and test-time compute 12:32 - Yann's journey from Switzerland to OpenAI 15:37 - Reasoning in 2026: Real-world utility vs verifiable rewards 18:34 - GPT-5.5 Thinking vs Pro: Scaling test-time compute 20:09 - How reasoning models become more efficient 23:23 - Pre-training scaling and overcoming the data wall 27:03 - Multimodal data, synthetic data, and embodied AI 31:05 - Demystifying mid-training and post-training 37:21 - Does RL create new capabilities in AI? 38:53 - The challenges and frontier of scaling RL 43:09 - Is building AI models a craft or a strict science 48:21 - How AI models generalize across different domains 54:18 - How reinforcement learning cures AI hallucinations 56:04 - Negative generalization and conflicting instructions 58:05 - Can RL scale to law, medicine, and the broader economy? 1:00:19 - The evaluation bottleneck and Model as a Judge 1:04:21 - Continuous AI progress & continual learning 1:08:49 - Will foundation models eat the agent harness 1:11:23 - Why startups should focus on the last mile of AI

Why AI Progress Suddenly Feels Real - my conversation with Yann Dubois, who co-leads the Post-Training Frontiers team at OpenAI 00:00 - Intro 01:30 - Why recent AI progress feels like a step function 04:13 - Model reliability & the emotional rollercoaster of shipping GPT-5.5 07:33 - How OpenAI structures vertical and horizontal teams 09:49 - Improving model efficiency and test-time compute 12:32 - Yann's journey from Switzerland to OpenAI 15:37 - Reasoning in 2026: Real-world utility vs verifiable rewards 18:34 - GPT-5.5 Thinking vs Pro: Scaling test-time compute 20:09 - How reasoning models become more efficient 23:23 - Pre-training scaling and overcoming the data wall 27:03 - Multimodal data, synthetic data, and embodied AI 31:05 - Demystifying mid-training and post-training 37:21 - Does RL create new capabilities in AI? 38:53 - The challenges and frontier of scaling RL 43:09 - Is building AI models a craft or a strict science 48:21 - How AI models generalize across different domains 54:18 - How reinforcement learning cures AI hallucinations 56:04 - Negative generalization and conflicting instructions 58:05 - Can RL scale to law, medicine, and the broader economy? 1:00:19 - The evaluation bottleneck and Model as a Judge 1:04:21 - Continuous AI progress & continual learning 1:08:49 - Will foundation models eat the agent harness 1:11:23 - Why startups should focus on the last mile of AI

Matt Turck

101,212 次观看 • 3 个月前

Today, we're joined by Aakanksha Chowdhery, member of technical staff at Reflection, to explore the fundamental shifts required to build true agentic AI. While the industry has largely focused on post-training techniques to improve reasoning, Aakanksha draws on her experience leading pre-training efforts for Google’s PaLM and early Gemini models to argue that pre-training itself must be rethought to move beyond static benchmarks. We explore the limitations of next-token prediction for multi-step workflows and examine how attention mechanisms, loss objectives, and training data must evolve to support long-form reasoning and planning. Aakanksha shares insights on the difference between context retrieval and actual reasoning, the importance of "trajectory" training data, and why scaling remains essential for discovering emergent agentic capabilities like error recovery and dynamic tool learning. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 02:26 - Reflection 04:54 - Limitations of post-training for building agents 07:31 - Rethinking pre-training in agents 10:51 - Scaling 11:27 - Evolving attention mechanisms for agentic capabilities 12:39 - Memory as a tool 14:13 - Loss objectives and training data 15:50 - Fine-tuning loss in agent performance 19:37 - Training data 21:29 - Augmenting dominant training data source 24:11 - Overcoming challenges in training on synthetic data 25:47 - Benchmarks 30:44 - Scaling laws in large models versus small models 33:20 - Long-form versus short-form reasoning 37:57 - Agent’s ability to recover from failure 40:15 - Hallucinations and failure recovery 43:53 - Tool use in agents 46:38 - Coding agents 48:37 - How researchers can contribute to agentic AI

Today, we're joined by Aakanksha Chowdhery, member of technical staff at Reflection, to explore the fundamental shifts required to build true agentic AI. While the industry has largely focused on post-training techniques to improve reasoning, Aakanksha draws on her experience leading pre-training efforts for Google’s PaLM and early Gemini models to argue that pre-training itself must be rethought to move beyond static benchmarks. We explore the limitations of next-token prediction for multi-step workflows and examine how attention mechanisms, loss objectives, and training data must evolve to support long-form reasoning and planning. Aakanksha shares insights on the difference between context retrieval and actual reasoning, the importance of "trajectory" training data, and why scaling remains essential for discovering emergent agentic capabilities like error recovery and dynamic tool learning. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 02:26 - Reflection 04:54 - Limitations of post-training for building agents 07:31 - Rethinking pre-training in agents 10:51 - Scaling 11:27 - Evolving attention mechanisms for agentic capabilities 12:39 - Memory as a tool 14:13 - Loss objectives and training data 15:50 - Fine-tuning loss in agent performance 19:37 - Training data 21:29 - Augmenting dominant training data source 24:11 - Overcoming challenges in training on synthetic data 25:47 - Benchmarks 30:44 - Scaling laws in large models versus small models 33:20 - Long-form versus short-form reasoning 37:57 - Agent’s ability to recover from failure 40:15 - Hallucinations and failure recovery 43:53 - Tool use in agents 46:38 - Coding agents 48:37 - How researchers can contribute to agentic AI

The TWIML AI Podcast

44,888 次观看 • 8 个月前

Thanksgiving-week treat: an epic conversation on Frontier AI with Lukasz Kaiser -co-author of “Attention Is All You Need” (Transformers) and leading research scientist at OpenAI working on GPT-5.1-era reasoning models. 00:00 – Cold open and intro 01:29 – “AI slowdown” vs a wild week of new frontier models 08:03 – Low-hanging fruit, infra, RL training and better data 11:39 – What is a reasoning model, in plain language 17:02 – Chain-of-thought and training the thinking process with RL 21:39 – Łukasz’s path: from logic and France to Google and Kurzweil 24:20 – Inside the Transformer story and what “attention” really means 28:42 – From Google Brain to OpenAI: culture, scale and GPUs 32:49 – What’s next for pre-training, GPUs and distillation 37:29 – Can we still understand these models? Circuits, sparsity and black boxes 39:42 – GPT-4 → GPT-5 → GPT-5.1: what actually changed 42:40 – Post-training, safety and teaching GPT-5.1 different tones 46:16 – How long should GPT-5.1 think? Reasoning tokens and jagged abilities 47:43 – The five-year-old’s dot puzzle that still breaks frontier models 52:22 – Generalization, child-like learning and whether reasoning is enough 53:48 – Beyond Transformers: ARC, LeCun’s ideas and multimodal bottlenecks 56:10 – GPT-5.1 Codex Max, long-running agents and compaction 1:00:06 – Will foundation models eat most apps? The translation analogy and trust 1:02:34 – What still needs to be solved, and where AI might go next

Thanksgiving-week treat: an epic conversation on Frontier AI with Lukasz Kaiser -co-author of “Attention Is All You Need” (Transformers) and leading research scientist at OpenAI working on GPT-5.1-era reasoning models. 00:00 – Cold open and intro 01:29 – “AI slowdown” vs a wild week of new frontier models 08:03 – Low-hanging fruit, infra, RL training and better data 11:39 – What is a reasoning model, in plain language 17:02 – Chain-of-thought and training the thinking process with RL 21:39 – Łukasz’s path: from logic and France to Google and Kurzweil 24:20 – Inside the Transformer story and what “attention” really means 28:42 – From Google Brain to OpenAI: culture, scale and GPUs 32:49 – What’s next for pre-training, GPUs and distillation 37:29 – Can we still understand these models? Circuits, sparsity and black boxes 39:42 – GPT-4 → GPT-5 → GPT-5.1: what actually changed 42:40 – Post-training, safety and teaching GPT-5.1 different tones 46:16 – How long should GPT-5.1 think? Reasoning tokens and jagged abilities 47:43 – The five-year-old’s dot puzzle that still breaks frontier models 52:22 – Generalization, child-like learning and whether reasoning is enough 53:48 – Beyond Transformers: ARC, LeCun’s ideas and multimodal bottlenecks 56:10 – GPT-5.1 Codex Max, long-running agents and compaction 1:00:06 – Will foundation models eat most apps? The translation analogy and trust 1:02:34 – What still needs to be solved, and where AI might go next

Matt Turck

168,007 次观看 • 9 个月前

LIVE NOW -- The Rise of AI Crypto Agents The collision between crypto and AI agents has officially begun. Joining us today is Matthew Stephensen, Research Partner Pantera Capital and author of “Crypto: Picks and Shovels for the AI Gold Rush”. We dive into the world of autonomous AI agents on blockchains, discuss the evolving role of agents, AI-driven market changes, and whether blockchain is the natural substrate for AI. Matt Stephenson sheds light on topics from agent liability and regulatory challenges to infrastructure value capture and the "picks and shovels" approach to investing in AI-driven crypto tech. Are AI agents on blockchains the obvious future? And how do scarcity and abundance interact in this new era? Join us as we tackle these questions and more, exploring what the future might hold at the intersection of AI, autonomy, and blockchain. ------------------------------------------------------------ Chapters: 0:00 Intro 5:34 Crypto x AI Narrative Shift 6:39 AI & Economic Agents Explained 11:50 $GOAT Memecoin Summary 23:15 Were AI Crypto Agents Obvious? 25:18 Luna AI Token & Terminal 29:41 Consequences? Is This Life? 33:27 Exciting Use Cases 40:27 Sam Altman Quote Importance 42:33 Wealth Generation Process & Blockspace 48:15 Programmable Money & Agent MEV 56:14 The #AI Agent & Memecoin Thesis 1:03:03 Government & Society Reaction Predictions 1:11:09 No Off Buttons?... 1:13:40 #DePin & AI 1:16:45 AI Agent Blockspace Demand 1:19:15 Closing & Disclaimers

LIVE NOW -- The Rise of AI Crypto Agents The collision between crypto and AI agents has officially begun. Joining us today is Matthew Stephensen, Research Partner Pantera Capital and author of “Crypto: Picks and Shovels for the AI Gold Rush”. We dive into the world of autonomous AI agents on blockchains, discuss the evolving role of agents, AI-driven market changes, and whether blockchain is the natural substrate for AI. Matt Stephenson sheds light on topics from agent liability and regulatory challenges to infrastructure value capture and the "picks and shovels" approach to investing in AI-driven crypto tech. Are AI agents on blockchains the obvious future? And how do scarcity and abundance interact in this new era? Join us as we tackle these questions and more, exploring what the future might hold at the intersection of AI, autonomy, and blockchain. ------------------------------------------------------------ Chapters: 0:00 Intro 5:34 Crypto x AI Narrative Shift 6:39 AI & Economic Agents Explained 11:50 $GOAT Memecoin Summary 23:15 Were AI Crypto Agents Obvious? 25:18 Luna AI Token & Terminal 29:41 Consequences? Is This Life? 33:27 Exciting Use Cases 40:27 Sam Altman Quote Importance 42:33 Wealth Generation Process & Blockspace 48:15 Programmable Money & Agent MEV 56:14 The #AI Agent & Memecoin Thesis 1:03:03 Government & Society Reaction Predictions 1:11:09 No Off Buttons?... 1:13:40 #DePin & AI 1:16:45 AI Agent Blockspace Demand 1:19:15 Closing & Disclaimers

Bankless

43,849 次观看 • 1 年前

Today, we're joined by Yejin Choi, professor and senior fellow at Stanford University University in the Computer Science Department and Stanford UniversityHAI. In this conversation, we explore Yejin’s recent work on making small language models reason more effectively. We discuss how high-quality, diverse data plays a central role in closing the intelligence gap between small and large models, and how combining synthetic data generation, imitation learning, and reinforcement learning can unlock stronger reasoning capabilities in smaller models. Yejin explains the risks of homogeneity in model outputs and mode collapse highlighted in her “Artificial Hivemind” paper, and its impacts on human creativity and knowledge. We also discuss her team's novel approaches, including reinforcement learning as a pre-training objective, where models are incentivized to “think” before predicting the next token, and "Prismatic Synthesis," a gradient-based method for generating diverse synthetic math data while filtering overrepresented examples. Additionally, we cover the societal implications of AI and the concept of pluralistic alignment—ensuring AI reflects the diverse norms and values of humanity. Finally, Yejin shares her mission to democratize AI beyond large organizations and offers her predictions for the coming year. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 04:44 - "Snowball effect" in AI investments 06:58 - Approaches to smaller models 08:58 - Importance of “better data” 14:07 - Imitation learning 18:24 - Artificial Hivemind paper 25:25 - AI risks 27:50 - Spectrum tuning 28:53 - Future of AI on humanity 33:08 - Reasoning in small models 34:58 - Prismatic Synthesis 48:20 - Reinforcement as a Pretraining Objective 55:04 - Pluralistic alignment 1:03:30 - Predictions

Today, we're joined by Yejin Choi, professor and senior fellow at Stanford University University in the Computer Science Department and Stanford UniversityHAI. In this conversation, we explore Yejin’s recent work on making small language models reason more effectively. We discuss how high-quality, diverse data plays a central role in closing the intelligence gap between small and large models, and how combining synthetic data generation, imitation learning, and reinforcement learning can unlock stronger reasoning capabilities in smaller models. Yejin explains the risks of homogeneity in model outputs and mode collapse highlighted in her “Artificial Hivemind” paper, and its impacts on human creativity and knowledge. We also discuss her team's novel approaches, including reinforcement learning as a pre-training objective, where models are incentivized to “think” before predicting the next token, and "Prismatic Synthesis," a gradient-based method for generating diverse synthetic math data while filtering overrepresented examples. Additionally, we cover the societal implications of AI and the concept of pluralistic alignment—ensuring AI reflects the diverse norms and values of humanity. Finally, Yejin shares her mission to democratize AI beyond large organizations and offers her predictions for the coming year. 🗒️ For the full list of resources for this episode, visit the show notes page: 📖 CHAPTERS =============================== 00:00 - Introduction 04:44 - "Snowball effect" in AI investments 06:58 - Approaches to smaller models 08:58 - Importance of “better data” 14:07 - Imitation learning 18:24 - Artificial Hivemind paper 25:25 - AI risks 27:50 - Spectrum tuning 28:53 - Future of AI on humanity 33:08 - Reasoning in small models 34:58 - Prismatic Synthesis 48:20 - Reinforcement as a Pretraining Objective 55:04 - Pluralistic alignment 1:03:30 - Predictions

The TWIML AI Podcast

12,141 次观看 • 6 个月前

Scale alone is not enough for AI data. Quality and complexity are equally critical. Excited to support all of these for LLM developers with Snorkel AI Data-as-a-Service, and to share our new leaderboard! — Our decade-plus of research and work in AI data has a simple point: scale alone is not enough. AI success is all about the quality, complexity, and distribution of data—in addition to volume. We’re excited to be powering leading LLM developers with Snorkel AI Expert Data-as-a-Service, our white glove service for custom, expert-level AI datasets—and to now preview some of what we’re building via our new Expert Data Leaderboard (🔗 in 🧵) + upcoming OSS dataset releases! Snorkel Expert Data-as-a-Service is built to meet the rapidly evolving data needs of the agentic AI world—where success is built on the quality, complexity, and distribution of datasets, in addition to size and scale. This kind of high-quality, frontier AI data can only come from a union of technology and human expertise. With Snorkel Expert Data-as-a-Service, we’re powering frontier LLM developers across agentic, expert knowledge, reasoning, coding, multi-modal, and other task types via the combination of these two key components: - (1) The Snorkel Expert Network: A global team of subject matter experts focused wholly on specialized knowledge–spanning thousands of topics in STEM/academic, vertical/professional, and consumer/lifestyle domains. - (2) Snorkel AI Data Development Platform: Our unique programmatic data curation and quality control platform, accelerating and improving expert authoring and review through principled techniques developed over the last decade of R&D. Now: we’re incredibly excited to showcase some of the power of Snorkel Expert Data-as-a-Service via the new Snorkel Leaderboard—putting frontier models to the test in complex, agentic, and reasoning settings inspired by real industry scenarios (not esoteric puzzles)! We’ll be releasing new leaderboards and accompanying expert-verified open source datasets (coming soon!) regularly. To start, we’re sharing three initial ones in preview: - SnorkelFinance: Q&A over financial documents requiring agentic tool-calling and reasoning - SnorkelUnderwrite: Agentic insurance tasks requiring industry-specific reasoning and tool use - SnorkelSequences: Mathematical tasks requiring compositional multi-step reasoning

Scale alone is not enough for AI data. Quality and complexity are equally critical. Excited to support all of these for LLM developers with Snorkel AI Data-as-a-Service, and to share our new leaderboard! — Our decade-plus of research and work in AI data has a simple point: scale alone is not enough. AI success is all about the quality, complexity, and distribution of data—in addition to volume. We’re excited to be powering leading LLM developers with Snorkel AI Expert Data-as-a-Service, our white glove service for custom, expert-level AI datasets—and to now preview some of what we’re building via our new Expert Data Leaderboard (🔗 in 🧵) + upcoming OSS dataset releases! Snorkel Expert Data-as-a-Service is built to meet the rapidly evolving data needs of the agentic AI world—where success is built on the quality, complexity, and distribution of datasets, in addition to size and scale. This kind of high-quality, frontier AI data can only come from a union of technology and human expertise. With Snorkel Expert Data-as-a-Service, we’re powering frontier LLM developers across agentic, expert knowledge, reasoning, coding, multi-modal, and other task types via the combination of these two key components: - (1) The Snorkel Expert Network: A global team of subject matter experts focused wholly on specialized knowledge–spanning thousands of topics in STEM/academic, vertical/professional, and consumer/lifestyle domains. - (2) Snorkel AI Data Development Platform: Our unique programmatic data curation and quality control platform, accelerating and improving expert authoring and review through principled techniques developed over the last decade of R&D. Now: we’re incredibly excited to showcase some of the power of Snorkel Expert Data-as-a-Service via the new Snorkel Leaderboard—putting frontier models to the test in complex, agentic, and reasoning settings inspired by real industry scenarios (not esoteric puzzles)! We’ll be releasing new leaderboards and accompanying expert-verified open source datasets (coming soon!) regularly. To start, we’re sharing three initial ones in preview: - SnorkelFinance: Q&A over financial documents requiring agentic tool-calling and reasoning - SnorkelUnderwrite: Agentic insurance tasks requiring industry-specific reasoning and tool use - SnorkelSequences: Mathematical tasks requiring compositional multi-step reasoning

Alex Ratner

495,851 次观看 • 1 年前