Sonya Huang 🐥
@sonyatweetybird • 30,640 subscribers
funding big computer @sequoia
Videos
David Silver is one of the all-time greats. He was the creator of AlphaGo, which changed the course of history by showing that neural nets could achieve superhuman performance for the first time. He also has a unique intuition and knack for forecasting when things will happen in AI. With computer Go, he predicted the Lee Sodol outcome 10 years before, right to the year. He got the year right for Starcraft and won a bet inside Deepmind. Same for AlphaProof. Same for the IMO. David's prediction for superintelligence: 3 years. !!! He has a strong sense that now is the time to build a superleaner, and that superlearners are now possible, thanks to the enormous progress in compute, simulators, autoresearch, and the sophistication of technology in the stack since the AlphaGo days. What is a “super learner”? A super learner discovers all knowledge from its own experience. Start from nothing (no internet pre-training), and go beyond human knowledge. Drop it into any stream of experience, simulated or physical, and the superlearner learns. He expects the progress will be rapid. When you get the recipe for a superlearner just right and remove humans from the development loop altogether, a superlearner can learn extremely quickly. Just look at AlphaGo. AlphaGo took two years to develop with humans in the loop. When David and his team at Google DeepMind got the formula for AlphaZero correctly, it surpassed the human-developed algorithms in just a few hours. Human data is a shortcut, but you have to let go of the human data to shoot beyond it. In January, David left GDM to found Ineffable Intelligence, a research-led lab with one mission: build a "super learner" that discovers all knowledge from its own experience, and make first contact with superintelligence. He joins us with co-founder Lasse Espeholt, who built IMPALA and SEED RL, the foundations of scaled-up RL, and now runs Ineffable's compute. A few things we cover in this conversation. — What a super learner is: depth (start from nothing, go beyond human knowledge) and breadth (drop it into any stream of experience, simulated or physical). The human brain is the only existence proof — Why they're giving up human data: AlphaGo took two years with humans in the loop. AlphaZero outperformed it in a few hours. "You have to let go of the human data to shoot past the competition" — Crucibles: simulated worlds with enough emergent complexity (physics engines, millions of interacting agents) for an agent to rediscover technology, science, maths and language on its own — Simple rewards, emergent complexity: evolution optimized fitness and got all of life. Don't breadcrumb the objective, give the agent something simple to optimize in a world with a lot to learn about — Go as the existence proof: one agent is the most boring game imaginable, two agents is "an infinite onion of layers of complexity" — Why human language is probably not the endpoint for reasoning, and how training on it bakes in a flat earth and the four humors — Can superintelligence be built in simulation? If the sim is Turing complete, computation, economics, language and maths are all expressible, and it happens 10-100x faster and safer — Alignment: language-based monitoring is reaching its limits as agents learn to say one thing and do another. Shadow actions, superintelligences monitoring superintelligences, and building a real science of how they interact peacefully — Accelerate in simulation, pace in the real world: Ineffable will gate real-world deployment on evidence that it goes well — Timing as the determinant: Silver called Computer Go to the year, then StarCraft, then the IMO. He thinks this is the moment — Predictions: True superintelligence within three years. Timestamps: 0:00 – Introduction 1:09 – What held true from Go to today, and what the LLM era changed 3:35 – Why leave DeepMind to start a new lab 5:58 – Why "Ineffable" (and the secret second reason) 7:03 – Lasse's path: scaling RL at DeepMind and Google Brain 9:31 – Defining a super learner and first contact 12:35 – Super learners vs. LLMs that make discoveries 13:59 – Day to day: the RL stack, crucibles and human-journey milestones 16:13 – Don't breadcrumb the objective: simple rewards, emergent complexity 21:16 – What a crucible looks like 24:14 – Go: one agent is boring, two is infinite 25:41 – Will agents rediscover language? 27:22 – Removing human priors: AlphaGo to AlphaZero 32:05 – Keeping human bias out of the crucibles 33:35 – Confidence, timing and super forecasting 36:24 – Is compute the driver? 38:13 – The ceiling on simulation and Rich Sutton's objection 43:44 – Alignment and the science of superintelligence 47:45 – Monitoring agents that don't think in English 51:01 – Pacing the frontier 52:54 – The compute setup: Vera Rubin on GCP 55:18 – Training, inference, simulation and RL scaling laws 57:40 – IMPALA and SEED RL 1:00:58 – 20 people and the compute-per-person ratio 1:04:49 – A research-led culture 1:05:47 – Predictions
Sonya Huang 🐥137,662 görüntüleme • 15 gün önce
Well.. Aaron Levie and I filmed this episode of Training Data a week or two ago, when the “current thing” was Doug Leone’s novacaine root canals instead of pacing the frontier… Simpler times! But Aaron’s advice on reinventing yourself and your company for AI is timeless. Aaron founded Box 20 years ago. It sits on hundreds of billions of enterprise files, and he's bet the company on agents that can read every one of them. He's also one of the most wired-in people in AI, on every cap table and, by his own admission, 95% Twitter-educated. He’s the rare CEO who can straddle both the internet AND has the ear of CIOs. His core argument: (1) the gap between what a model can do and what an enterprise workflow actually needs is vast, and closing it is a lot of software; (2) diffusion of AI outside of coding will take far longer than Silicon Valley thinks, and that slowness is exactly where the applied layer's value comes from. The conversation covers: — why application companies are the hottest neolabs, and why the LLM-wrapper thesis is finally working — the fox-guarding-the-henhouse problem with letting model providers route your tokens — work slop, and why we accept AI-written code but flinch at AI-written decks — how Box built its agentic harness and why it beats raw API access on accuracy and latency — the open-weights paradox: closed labs and open models both growing exponentially at once — what continual learning has to solve before it works for a lawyer with five matters and a Chinese wall — why 90% of enterprise tokens in five years will come from tasks no human kicked off — the mandate for founders right now: whoever gets it to the customer wins 0:00 – Introduction 1:55 – Are application companies the hottest neolabs? 6:56 – Will the labs move up the stack? 12:34 – Box and betting the company on AI 16:50 – Hero use cases: reading a million contracts and long-running agents 18:42 – Work slop: why AI code is embraced but AI content isn't 24:08 – Building Box's agentic harness and the evals that matter 27:23 – The state of the model race 29:25 – Open-weight model adoption in the enterprise 32:34 – Memory, continual learning, and what belongs in the weights 37:29 – Box Labs and systems of record in a world of agents 44:55 – Will chat be the dominant UI for enterprise AI? 48:00 – Why coding diffused fast and the rest of knowledge work hasn't 54:31 – Staying wired in, making a company AI-first, and what it takes to win
Sonya Huang 🐥392,772 görüntüleme • 1 ay önce
Biological intelligence to bootstrap robotic intelligence? If robotics is about to enter its golden age, Mecka is one of the companies feeding it, by sensorizing humans to train robots. The biggest challenge robotics faces is the data flywheel cold start problem. LLMs got a free cold start from the internet: trillions of tokens, already written. Robotics gets nothing. Someone has to go create the training data to jumpstart the system. Josh is the co-founder and CEO of Mecka, the data and deployment company for physical AI. Josh read every robotics paper he could find in late 2024, visited the labs, and made a bet: humans and humanoids look the same, so humans could act as the training fleet. Egocentric data, first-person video of people doing real work, could become vital fuel. Two years ago, the biggest egocentric dataset was Ego4D at 4,000 hours. The field is now in the millions of hours, thanks in part to Mecka. We’re probably still orders of magnitude of training data away from robotics nirvana. But every rung on the physical intelligence ladder unlocks real commercial tasks. And eventually, Josh imagines a world with an order of magnitude more robots than people, of a plurality of shapes and sizes and use cases, as the Hitchhiker’s Guide to the Galaxy foretold :) A few things we cover in this conversation. - Why robotics has no cold start: pixels, actions and logic, and why pre-training data is a real market in robotics in a way it never was for LLMs - What “teaching robots about carbon life” means: in sci-fi the final frontier is organic. The human brain runs on 20 watts and self-heals - The egocentric bet: teleop couldn’t scale, humans and humanoids share a form, so Waymo-fy the humans. The first pilot was aunties and uncles recording themselves cooking on a mobile app - Force data: video can’t tell a robot how hard to squeeze an egg. Wrist cameras are a hack. Mecka built the gloves instead - Inside the data factory: a consumer app that streams your tasks, a B2B engine recruiting across “the taxonomy of all physical human work,” 100-gigabit upload lines, hundreds of petabytes - Millions of hours vs. Tesla’s decade on two degrees of freedom, and why it’s a slow creep up, not a GPT-3 moment - The home has the most data and is the hardest place to deploy. Laundry folding and assembly-line pick-and-place get solved in the next year or two - Useful robots already exist: hotel delivery and cleaning bots in China and Southeast Asia, industrial cleaning in the US. Humanoids are the terminal state, not the first step - Deployment diffusion: a modern systems integrator whose installed robot does something next week it couldn’t do last week. If Mecka ever helps deploy a robot that mines an asteroid, they’ve done their job - The data pot of soup: a million hours of human data, tens of thousands of UMI, a few hours of in-domain teleop. Tactile and simulation haven’t entered the mix yet - Move 37 for robotics: AlphaGo went behavior cloning, then self-play, then magic. The catch is the rules of the game are the entire physical world, and we don’t have the simulator yet - Will the AGI labs steamroll robotics? “It takes a lot of courage to scale up data with imperfect information.” - The Kawasaki Corleo, the robot panther-dog-horse on Mecka’s conference room wall, and why the future of robotics looks like Hitchhiker’s Guide to the Galaxy Timestamps: 0:00 – Introduction 1:46 – What Mecka is: pixels, actions and logic 2:45 – Is robot data economically feasible without the internet? 4:15 – Teaching robots about carbon life 5:27 – Cloud kitchens, stablecoins and the path to robotics 7:03 – Entering robotics with a fresh lens 8:45 – What egocentric data is and why Mecka bet on it 10:09 – The first pilot: aunties and uncles with a mobile app 10:42 – Force data and tactile gloves 11:55 – Inside the operations of a data factory 14:41 – Heat-mapping the taxonomy of human work 15:42 – Quality gates, fraud and the McDonald’s POV videos 17:44 – Earning a margin as a data intermediary 19:33 – Millions of hours vs. Tesla’s decade 20:55 – Why it isn’t binary: unlocking commercial tasks along the way 22:02 – Home data is plentiful; home robots are the hardest 23:24 – Useful robots can be deployed today 24:35 – When robotics gets an FSD-style flywheel 26:42 – Deployment diffusion and the modern systems integrator 28:21 – Favorite vertical robot categories; mining an asteroid 30:08 – The hardware slate: Waymo-fying people 30:55 – EgoVerse 32:04 – The data pot of soup: the converged training mix 33:54 – Move 37 for robotics: AlphaGo and Federer 36:02 – World models and the training mix 36:58 – Will scaling the current mix get us to the promised land? 39:05 – Will the AGI labs steamroll robotics? 40:50 – Sci-fi roots and the Kawasaki Corleo 42:44 – How many robots in a decade?
Sonya Huang 🐥34,601 görüntüleme • 8 gün önce
Two of the people most responsible for scaling the transformer are now betting on a next act. Jerry Tworek ran the Reasoning 🍓 team at OpenAI. rohan anil was a pre-training lead on Gemini after years at Google Brain and Anthropic. They just started to find what comes next. Their core argument: (1) models are trained in the lab but deployed in the real world and can't keep learning once they leave; (2) AI research is done by humans today but models will be able to explore and uncover new advances more rapidly and systematically (controversial but timely w this week's petition). The conversation covers: — why Jerry expected AGI in 2025 and what changed his mind — the two kinds of learning from experience, and why RL only captures one — the computational depth problem baked into today's architectures — why the biggest labs can't afford to look for a transformer replacement — the kernel competition where humans + $100K of coding agents found a 60x speedup no frontier model comes close to — a definition of AGI you can actually test: a model that improves itself with no human in the loop 00:00 Introduction 01:46 Appreciating Transformers 02:44 Scaling Hits Limits 04:54 Why Architecture Matters 05:32 RL Reality Check 07:32 Test Time Learning 09:52 Economics Of Scaling 12:47 Why Start A Company 14:24 Rohan On Transformers 19:11 Computational Depth Problem 20:32 When Transformers Top Out 23:22 Beyond Reinforcement Learning 26:41 Optimization And Efficiency 34:24 Building An Automated Lab 39:45 Kernel Automation Roadmap
Sonya Huang 🐥236,449 görüntüleme • 3 ay önce
What happens when there are more agents than eyeballs browsing the internet? How will the economics of the internet be reinvented? Parag Agrawal thinks Shapley values may hold the answer. Parag built Twitter over a decade, eventually becoming CEO and selling the company to Elon. He's spent the last three years building Parallel Web Systems, a search engine built for agents instead of humans. His core argument: 1) human click data is a bug. Agents aren't just a new technology, they're a distinct customer – and the feedback loop that made Google great is the wrong signal for the thing actually doing the work; 2) the ad-funded web assumed scarce human attention. If agents show up instead of eyeballs, the business model underneath the internet has to be rebuilt, or good content stops being published. The conversation covers: — why he shipped a search agent before a search engine, and how that let him grow the index incrementally instead of buying a full web crawl up front — the billion-to-billion matching problem: pull the right 1,000 tokens out of a trillion web pages, and your agent uses under half the tokens — going from a 3-second compute budget to 200 milliseconds — why he doesn't think Parallel is a neo-lab: "our output is a complement to a model" — the Google Cloud deal — on GCP, your grounding options are now Google Search or Parallel Search — reinventing the economics of the internet, Shapley values as a payment rail for publishers, and why the company was originally incorporated as Shapley Inc — why routing 2-10% of inference spend to web data would dwarf every content business outside the walled gardens — the web going from pull to push: "call me if this happens" 00:00 Introduction 03:25 What Is Web Search 05:17 Why Start a New Index 07:52 Search Agents First 10:17 Not a Neolab 13:14 Agents vs Google Search 19:38 Inside the Search Stack 28:59 Search Multipliers With Agents 30:21 Meeting Prep Agent Workflows 31:46 Quality Cost Latency And Turbo 32:42 Are Agents Overtaking Humans 34:28 Ads Model Meets Agent Web 37:20 New Incentives For Content 40:48 Shapley Values Attribution 47:46 Parallel Web And Future Vision Hosted with my very unwilling co-host Andrew Reed and Sequoia Capital
Sonya Huang 🐥130,773 görüntüleme • 2 ay önce
Today we release my favorite episode of Training Data yet: the great Rich Sutton. Richard Sutton wrote the textbook, wrote The Bitter Lesson (and many other on-point essays like "Self-Verification, The Key to AI"), and trained a mafia of talented students who went on to change the AI landscape forever including David Silver, inventor of built AlphaGo. Khurram Javed was Rich's PhD student at Alberta and wrote The Big World Hypothesis. They just left academia to start Their core argument: (1) The Bitter Lesson: the world is massively more complex than any model of it, so anything trained on human-curated data has a ceiling (2) Continual Learning: intelligence is continual by definition, and today's models stop learning the moment they ship. The conversation covers: — what The Bitter Lesson actually says, and what people get wrong — why synthetic data is "just a big mistake," and the Big World Hypothesis behind it — how LLMs are both a positive and a negative example of his own essay — why no animal learns by supervised learning, and what squirrels can do that we can't — the cure for catastrophic forgetting: per-weight step sizes and continual backprop — why the biggest labs can't take a path where performance gets worse before it gets better — a trillion parameters on 20 watts, and the Moore's Law math that makes it plausible — why the endpoint isn't one mind but one design, running as many minds It was both a fun generative idea- and debate-filled conversation, and a surprisingly human one too. Rich, thank you for beating cancer and changing the trajectory of AI. 💙 00:00 Introduction 02:10 An AI winter, a cancer diagnosis, and the move to Alberta 07:07 Writing "The Bitter Lesson," and what people get wrong 09:53 Are LLMs a positive or a negative example of it? 11:03 Synthetic data is "just a big mistake," and the Big World Hypothesis 18:01 AlphaGo, human priors, and why prior knowledge and learning should be friends 22:37 "Their weights never change": do LLM assistants actually learn? 26:09 Babies, squirrels, and why no animal learns by supervised learning 32:02 Rockets, imagination, and where paradigm shifts come from 36:42 The Alberta Plan and its 12 steps 38:53 Catastrophic forgetting and the cure 43:43 Oak's biggest ambition: a self-maintaining mind 47:56 Why the big labs are stuck in a local minimum 49:13 If everything goes right: LLMs, many minds, and hiring The man who pioneered reinforcement learning thinks the rest of the field is weird, and lays it all out in today's episode. Together w/ Alfred Lin Sequoia Capital
Sonya Huang 🐥120,498 görüntüleme • 2 ay önce
OWN YOUR INTELLIGENCE Last year, building on open-weight models was primarily a cost rationalization exercise. Slightly worse performance for a much cheaper price. Now, it is increasingly an existential and strategic topic for our portfolio. Intelligence is the product. Companies want to shape it and own it and let it compound within their own walls. Not your weights, not your product. Now, with frontier open-weight models and fantastic tooling/infrastructure, owning your intelligence at the frontier is finally becoming possible. The result: every application company we work with is embarking on the journey of doing their own research on post-training, evals, harnesses, etc. The hottest neolabs may just be Harvey, Factory, RamPrasad "RamP!" Moudgalya, etc. The list goes on. We held a summit Sequoia Capital to convene our portfolio on this topic, together with Gabe Pereyra (Harvey) on building Harvey Labs, Lin Qiao (Fireworks) on post-training, Harrison Chase (LangChain) on harnesses + evals, Brendan (can/do) () on RL environments and synthetic data, Arjun Karanam (Trajectory) on online continual learning. Opening talk below; rest to come this week! 00:00 What is sovereign AI (and what it isn't) 01:24 Centralized vs. decentralized intelligence 02:54 Four reasons companies own their models: cost, speed, performance, destiny 04:22 "Not your weights, not your product" 05:32 The application companies are the newest neo labs 07:05 Step 1: Deciding what to own vs. rent 09:51 Step 2: Build the team (and don't shoehorn your platform team) 11:17 Step 3: Legibility – why your research has to be visible 12:33 Step 4: The technical roadmap 13:56 The stack: production vs. development 15:16 Opening Pandora's box – base models, harnesses, context
Sonya Huang 🐥130,017 görüntüleme • 2 ay önce
An agent is three things: a harness, a model, and context. If you're serious about owning your intelligence, you probably want to own all three. LangChain founder Harrison Chase joined us at our Sequoia Capital Own Your Intelligence to talk about the piece that often gets the least attention: the harness. He offers a clear heuristic for when to build your own. The more out of distribution you are from what the models were trained on, the more you'll want to customize. And good technical content on how to actually measure performance with evals and langsmith. 00:00 Introduction 00:58 The three parts of an agent: harness, model, context 02:12 What a harness actually does 03:25 Customizing the core loop with middleware 04:41 Sandboxes, file systems, sub-agents, summarization 05:47 Cognitive architectures — and when you still need them 07:03 Build your own harness or use off the shelf? 08:24 In-distribution vs. out-of-distribution: the file-editing example 09:39 Why evals define what "good" means in an organization 11:04 Harbor: what an eval task actually looks like 12:11 Comparing harnesses and models on accuracy, latency, and cost 13:20 Why observability is underrated — it's usually the context 14:34 The data flywheel: traces → curation → experiments 15:42 Getting feedback through UX design and online evaluators 16:51 Demo: LangSmith Engine 19:23 Q&A: Running Engine on Engine, and "codex-ification" 20:44 Q&A: Will harnesses converge or diverge?
Sonya Huang 🐥77,519 görüntüleme • 2 ay önce
"Member of the technical staff" is the hottest job title in SF right now. What's behind the name? OpenAI chose this title deliberately to blow up the previous industry dichotomy between researchers and engineers. The best researchers in AI right now aren't academics in a pure lab environment; they get their hands dirty technically writing code and digging into the data and implementations e.g. Alec Radford Bob McGrew, former Chief Research Officer at OpenAI and one of U.S. Army's newest recruits to Detachment 201, joined us on Training Data to share more about the secret sauce behind leading OpenAI's research org, the three legs of the stool to AGI, and why he thinks we're already there.
Sonya Huang 🐥358,649 görüntüleme • 1 yıl önce
AI is driving the biggest infrastructure build-out in history, with Google alone forecasting $200B of capex in 2026E. What are the real constraints on a system at this scale? Amin Vahdat is the chief in charge of Google's buildout. As SVP AI Infrastructure (AI^2), he role spans GoogleDeepMind, Google Cloud, and the TPU/accelerator hardware roadmap, planning chips 2-5 years out and overseeing a data center buildout of epic proportions. Takeaways: — Why "goodput" per watt is the north star metric and designing around failures: At the 100,000-accelerator scale, something fails multiple times an hour, capacity has to double every six months, and as much of that comes from software and model optimization as from silicon. Hardware is a multiplier that lifts everyone above it — Why Google split TPU into two chips (8I for inference, 8T for training), and the calculus for when a workload is big and durable enough to specialize for — The "bitter lesson of chips," and why the TPU architecture hasn't fundamentally changed since v1 — How DeepMind and the hardware team co-design: delaying a tape-out by two weeks for the right model optimization, and using Gemini to design chips for future Geminis — Long-horizon agents as a new workload shape: no human in the loop to rate-limit requests, and CPU, networking and storage demand going "through the roof" alongside accelerators — Optical circuit switching: mirrors redirecting light to swap a failed TPU rack in milliseconds, without touching a fibe — Why Google prefers grid-connected over behind-the-meter power — Why 7- and 8-year-old TPUs are still at 100% utilization — Open standards, and why IP won the internet as the narrow waist of the hourglass — Orbital data centers: 1.4x the solar power, near-100% sunlight in sun-synchronous orbit, free-space optics between satellites, and "no fundamental showstoppers" — The 2036 rack: multiple megawatts, wheeled in, plug in water, power and fiber Timestamps: 0:00 – Introduction 1:47 – What makes a data center an AI data center 5:30 – Goodput, not FLOPS: holding yourself accountable when something fails every hour 11:52 – Doubling token capacity every six months, and where the gains actually come from 15:32 – The TPU bet: from a contrarian call in 2013 to splitting 8i and 8t 23:30 – The case for and against co-design 26:11 – Shoulder to shoulder with DeepMind: intercepting chips mid-flight 34:16 – Long-horizon agents change the shape of the data center 37:50 – Optical circuit switching and the state of networking 42:35 – Power is the binding constraint: utilities, gigawatts, and sizing a data center 49:23 – Training vs. serving clusters, seven-year-old TPUs, and open standards 58:29 – Orbital data centers and the supercomputer of 2036
Sonya Huang 🐥21,284 görüntüleme • 22 gün önce
Today's Training Data episode takes us BTS on the infrastructure challenges required to do large RL runs at scale, featuring Federico Cassano (Composer Lead at Cursor) and Dmytro Dzhulgakov (Co-Founder at Fireworks). The Cursor team trained Composer 2 on Fireworks by starting with a strong base model (Kimi 2.5) and performing large-scale mid-training on code tokens and web data to learn common patterns and libraries, followed by a large-scale Reinforcement Learning run to learn how to navigate the Cursor harness, call tools, and write correct code. Today's episode dives into the systems and infrastructure challenges of making that large RL run happening, and there were many (!!), from numerical mismatch to global distribution to synchronizing rollouts across asynchronous pipelines to keeping track of expert activation across runs and more. Extremely nerdy in-the-weeds challenges that Federico and Dima were delighted to nerd out on together :) Beyond RL infra, we also discussed Online vs Simulated rollouts, self-summarization for long-horizon agents, environment design ("the most powerful RL environment is the product itself"), and other technical nuggets. PS: We filmed this episode before the SpaceX news, while the Cursor team was still compute-constrained. While Cursor now has *all* the flops, the takeaways and hurdles crossed ring true for any serious application-level company that is racing to post-train their own models. I believe that more serious application companies will go the way of Cursor and post-train their own models. 00:00 Introduction 00:53 Why Cursor Trained Composer 2 04:55 Specialization vs Bitter Lesson 06:16 Composer 2 Training Recipe 16:32 Scaling RL Infrastructure Globally 23:32 Floating Point Drift 25:11 MoE Sensitivity Explained 26:25 Router Replay Fix 27:19 Real Time RL Loop 31:49 Long Horizon Agents 34:29 Why RL Everywhere 37:34 LLM as Judge Rewards 39:14 RL in Hard Domains 40:13 Build Your Own Environments 44:34 Closing Thoughts
Sonya Huang 🐥81,490 görüntüleme • 5 ay önce
Very special Training Data drops today: Making Cities Awesome ☺️ We haven’t featured an application company on Training Data in a while. The diffusion of AI is the Most Important Thing, and the highest-stakes application category of all is the one sitting near the base of Maslow’s hierarchy: safety. Today I am excited to bring Nick Noone and Ben Rudolph of Peregrine onto the podcast. You may not have heard of Peregrine yet, but their technology is almost certainly keeping you and your loved ones safe, and they are rejecting the surveillance state while doing it. Nick and Ben talk about all the interesting ways that AI is being deployed in customer environments at Peregrine, which include some of the coolest use cases of long-horizon agents and vibe coding that I’ve seen: * a cold-case agent that reproduced an exoneration detectives had reached by hand * a Wisconsin county that placed a suspect using cell records buried in 300GB of evidence * a semantic search tool for identifying active threats to a synagogue * a vibe-coded hurricane simulator to help one Forward Deployed Engineer root-cause an inflection in weather-related incidents Nick formerly ran Palantir’s Special Operations Command business unit and deployed into high-stakes situations in the Middle East. Ben comes from almost the opposite background: building humanitarian technology for refugees and disease prevention in Africa and India. But the two of them converged on a similar thesis: that this technology could be used to make cities work better for the people who live in them. Today, Peregrine powers law enforcement, emergency medical services, fire and rescue, and other services in more than 400 communities globally. Public distrust in surveillance has reached a boiling point, for good reason. Other public safety technology companies grow by collecting more data. Peregrine inverted the model: no sensors, no new data, a business built on connecting the data and information cities already own, with permissions, policy and auditability from day one. Authorized users make sense of existing data when they have a legitimate reason to access it, and not otherwise. Data governance, access controls and audit logs are unglamorous work, but they are the safeguards that let a city protect safety and privacy at once. Nick and Ben’s deep integrity shines through in the episode. I am thankful for their stewardship of this critically important category. 00:00 Introduction 02:07 What Forward Deployed Engineering Means 03:58 What Silicon Valley Gets Wrong 05:23 Humanitarian Work, Refugee Work, And Downstream Data Problems 08:25 Why Cities, Why Safety 10:45 Two Dozen Nos And San Pablo PD 14:19 Building Through Defund The Police 18:16 The Inversion Of The Collection Model 21:20 Data Ownership And Governance 22:57 From Nice Search To Deep Analysis 29:59 Agents Writing The Integrations 31:45 The Cold Case Agent 35:02 The Anti-Network-Effect Proposition 38:40 Facial Recognition And Hard Decisions 40:48 Technology For The Underdogs 42:54 Trusting The Individual Contributor 48:50 Ten Thousand Cities
Sonya Huang 🐥34,092 görüntüleme • 1 ay önce
Don't sleep on Google DeepMind in AI... This week on Training Data, Google Labs VP Josh Woodward gave us the BTS on Google's imagination playground for AI, from Notebook to Mariner (computer use agent) to Veo (video models). Thanks Josh for the spicy convo and hot takes :)
Sonya Huang 🐥183,357 görüntüleme • 1 yıl önce
The advanced civilizations of sci-fi legend (Banks, Asimov, etc) have some form of simulation to guide society. Joon Sung Park is taking a crack at building that simulator with Simile. As Joon's cofounder Percy Liang puts it: great science starts with a great measurement. From Smallville in 2023 to today, Simile is trying to build the Hubble Telescope equivalent for simulating human behavior. 00:00 Introduction 01:49 Building Generative Agents 02:29 Valentines Day Emergence 03:33 From GPT 3 To Agents 05:03 Social Computing Problem 06:19 Social Simulacra Subreddits 07:57 Models Getting Good Enough 08:57 Humans Are Not Rational 10:04 Turning Research Into Simuli 11:55 Validation And Accuracy Proof 12:43 Customer Workflow CVS Example 16:11 Why Collect Real Data 17:51 Behavioral Signals And RCTs 21:52 Use Cases And Second Order Effects 26:31 Evaluating Convergence Divergence 31:58 Big Societal Simulations Ahead 36:08 Future Of Simulation
Sonya Huang 🐥47,168 görüntüleme • 4 ay önce
***Lights, inference, action…*** I’m so happy to share that Sequoia Capital has led the Seed in Preview. Developers are flying in magical AI-native editors. But creative tooling is still stuck in the pre-AI stone age. stefo is building the production platform for AI video. It is robust, it is full featured, it is everything a professional videomaker could ask for (as our star-studded alpha client list will attest), and most importantly it is built with care and the utmost attention to craftsmanship <3 Grateful to join many greats of the video and creative tools space on the cap table including @emery_wells of Frameio, Badrul Farooqi Kyle Parrish ex Figma, Burkay Gur batuhan the fal guy of fal, Soleio, and many other friends.
Sonya Huang 🐥29,755 görüntüleme • 2 ay önce
When should you start post-training your own models? Fireworks CEO Lin Qiao’s answer: after product-market fit. Not because it's hard... but because only after PMF is the data coming off your product surface worth training on. Lin joined us for our Sequoia Capital "Own Your Intelligence" event to host a workshop on all things post-training; what works, what breaks, and how not to let the model outsmart you. Must listen!! 00:00 Introduction 00:37 What Fireworks sees across thousands of AI applications 02:47 Off-the-shelf APIs and the problem of keeping your taste 03:58 What "owning your intelligence" actually means 05:43 The progression: prompting → RAG → SFT → preferences → RL 07:20 Why this mirrors how humans learn 09:03 Matching the technique to the problem you actually have 10:46 Where teams get stuck: data quality and vibe evals 12:28 Reward hacking: the model that wrote zero lines of code 13:59 Training-to-serving alignment (and why quality drops) 15:55 Post-training in healthcare and security 17:31 From coding to every co-work domain 19:35 Incumbents, cost burden, and not scaling into bankruptcy 21:26 How much control do you want? 23:24 Q&A: What makes a good reward signal 25:00 Q&A: When to start thinking about post-training
Sonya Huang 🐥28,212 görüntüleme • 2 ay önce
Baumol cost disease is real, AI is the solution Take law -- imagine a world where consumers have plentiful access to high-quality legal services Crosby is building an AI-native law firm towards that vision. @Ryanjdaniels John Sarihan share more on Training Data!
Sonya Huang 🐥69,577 görüntüleme • 1 yıl önce
Best technology M&A of all time has to be NVIDIA's $6.9 Billion acquisition of Mellanox in 2020. It was a special treat to interview Michael Kagan, CTO of NVIDIA and co-founder/CTO of Mellanox, for today's Training Data episode. Michael has been driving forward the Compute Frontier for more than 40 years now, first as Chief Architect at Intel in the 90s, then Co-Founder and CTO at Mellanox, and for the last 5 years CTO at NVIDIA. There's nobody better positioned than Michael to share the complete history of the compute frontier and what's ahead, from decades pushing forward Moore's law (squeezing more transistors on a chip) to the last decade of work scaling beyond single chip physics limitations (scaling out to 100K+ GPU clusters). Interconnect is the secret sauce enabling compute to scale beyond chip-level Moore's law. Connecting a fabric of 100K+ GPUs to function as a single unit of compute is the enabling technology for today's intelligence explosion. But other things break at the 100K+ GPU cluster scale: individual chips inevitably fail, power and networking become more complex, etc etc. Net effect of scale out: we've inflected the silicon frontier from Moore's Law (2x every 2 years) to Huang's law (~10x a year). Very excited about today's episode! Learned so much from Michael with Pat Grady
Sonya Huang 🐥56,175 görüntüleme • 1 yıl önce
Claude Code and Suno have more in common than you might think: "It's fun to build things, and it's fun to use what you build." AI lets people be creative in almost any domain, from coding to making music. Today on Training Data, Mikey shares his thesis for why generative AI is the newest form of active entertainment (the next 'gaming'), music as a cultural phenomenon vs creative expression platform, and more. My favorite part was Mikey's explanation of why Suno learns music theory implicitly vs explicitly: "In Western music, there are 12 tones. If you tell the model there are 12 tones, it will only ever produce those 12 tones. You will be forever limited. And if you tell the model there's 200 instruments, those are the only sounds that you'll ever be able to make." The more you constrain a model with what humans already know, the less capable it becomes. By treating everything as pure sound, Suno built what Mikey calls a totally generalized "music-making machine." Such is the power of neural nets.
Sonya Huang 🐥24,048 görüntüleme • 5 ay önce