Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

OWN YOUR INTELLIGENCE Last year, building on open-weight models was primarily a cost rationalization exercise. Slightly worse performance for a much cheaper price. Now, it is increasingly an existential and strategic topic for our portfolio. Intelligence is the product. Companies want to shape it and own it and let...

sonyatweetybird's profile picture

Sonya Huang 🐥

29,632 subscribers

128,779 görüntüleme • 1 ay önce •via X (Twitter)

Bilim & TeknolojiEğitim
LIVE

Anya Rossi• Live Now

Private livecam show

25 Yorum

Sonya Huang 🐥 profil fotoğrafı
Sonya Huang 🐥1 ay önce

YouTube Playlist here:

Matt Slotnick profil fotoğrafı
Matt Slotnick1 ay önce

the Sequoia Sovereignty Summit ™

Sonya Huang 🐥 profil fotoğrafı
Sonya Huang 🐥1 ay önce

a+

Philip Johnston profil fotoğrafı
Philip Johnston1 ay önce

👌🔥🤓

𝗦𝗔𝗚𝗢𝗥 𝗖𝗔𝗣𝗜𝗧𝗔𝗟 profil fotoğrafı
𝗦𝗔𝗚𝗢𝗥 𝗖𝗔𝗣𝗜𝗧𝗔𝗟1 ay önce

open-weight models just got a whole lot bigger

Sonya Huang 🐥 profil fotoğrafı
Sonya Huang 🐥1 ay önce

yes! 2.8 trillion parameters bigger to be precise :)

Steve Hou profil fotoğrafı
Steve Hou1 ay önce

👏

Nathan Kochera profil fotoğrafı
Nathan Kochera1 ay önce

I've always been bullish on the importance of open weight models. Most companies, especially those that have been around for a while, have so much proprietary data that can be used to fine-tune or train their own models. These custom models can make them extremely competitive in their respective industries. If AI continues on the pace it is at and get's to a point where it is outperforming human intelligence in enterprises, one could argue the most important task in enterprises will be continually training the AI, making sure it is running effectively, and ensuring you always have access to it. If you don't own your intelligent, the tap can always be turned off.

interstellarninja profil fotoğrafı
interstellarninja1 ay önce

we must own our learning loop

Inflectiv AI ⧉ profil fotoğrafı
Inflectiv AI ⧉1 ay önce

🔥🔥

Arjun Raj Jain profil fotoğrafı
Arjun Raj Jain1 ay önce

"Not your weights, not your product" cuts both ways: you also can't post-train on data the base model already memorized. We build coding RL envs from 1,000+ private production codebases that were never public. Claude opus 5 doesn't fully solve a single one at pass@1.

Angad Randhawa profil fotoğrafı
Angad Randhawa1 ay önce

great listen Sonya

Elizabeta Kuzevska profil fotoğrafı
Elizabeta Kuzevska1 ay önce

Owning your AI stack could become a major competitive advantage in the next few years

Michael Mayernick profil fotoğrafı
Michael Mayernick1 ay önce

Evals, RL environments, post-training targets all come from somewhere - usually undocumented judgment in a few people's heads. Writing ours down as versioned, checkable files, that "compiles" the whole company made clear what we want to own: the judgement layer. The models stay rentable and swappable (we've swapped twice; the company carried over) because identity is managed like source code. For Harvey-scale, owning the weights makes sense. For most companies, the sovereign layer is compilable judgment.

安叫兽|Bird🕊️ 🔶 BNB profil fotoğrafı
安叫兽|Bird🕊️ 🔶 BNB1 ay önce

从省成本到掌握主动权，这个转变挺明显了。

Pierangelo Raiola profil fotoğrafı
Pierangelo Raiola1 ay önce

And also authority of decisions. Intelligence is defined by actions, which depends on knowledge and authority. If you don’t map delegation of trustable actions within in an org you are still building voids. @sonyatweetybird - more here:

slei profil fotoğrafı
slei1 ay önce

Question, is ramp really needed ? Can’t banks just do this ? And with Harvey , ai can just replace human lawyers. Why just assist them ?

call me gb profil fotoğrafı
call me gb1 ay önce

cool talk! will check the playlist

Max Informatiker profil fotoğrafı
Max Informatiker1 ay önce

not your weights not your product 🔥

viet profil fotoğrafı
viet1 ay önce

any chance you can get these on spotify?

Harjiv Singh profil fotoğrafı
Harjiv Singh1 ay önce

Thanks for sharing. Great insights. @VishalSharai

mr ceo profil fotoğrafı
mr ceo1 ay önce

Can I work with you

Stefan profil fotoğrafı
Stefan1 ay önce

@sonyatweetybird are there any known hardware requirements when it comes to preparing companies that want to own their intelligence?

Sonya Huang 🐥 profil fotoğrafı
Sonya Huang 🐥1 ay önce

most are building on platforms like @FireworksAI_HQ which manage the hw for you; at scale you can also BYOC

Stefan profil fotoğrafı
Stefan1 ay önce

@FireworksAI_HQ Awesome! Do you see folks complain about cost of compute and lack of availability?

Benzer Videolar

On The Information's TITV talking about where open weights actually land inside a big company Nobody serious is picking one model. They'll ride the frontier of intelligence(rent) and most will train OSS models(own) on their own data for the work nobody else can do. For many critical end to end agentification the expertise is in your people and your systems, not on the internet.
1:31

On The Information's TITV talking about where open weights actually land inside a big company Nobody serious is picking one model. They'll ride the frontier of intelligence(rent) and most will train OSS models(own) on their own data for the work nobody else can do. For many critical end to end agentification the expertise is in your people and your systems, not on the internet.

Garrett Lord

90,679 görüntüleme • 16 gün önce

Today we're announcing Base Labs, a dedicated research organization focused on advancing open-source AI. We believe in a healthy, open frontier model ecosystem. To enable this, we are working on: - Blue-sky research on continual learning, the science of RL, and how models learn across their full lifecycle, with every experiment and recipe shared openly. - The BaseHub Data Foundry: the highest-quality open RL environments, training data, and real-world benchmarks, built for anyone to train and benchmark on. - Post-post training: taking open-source models and making them better, safer, and more aligned through continual post-training, built on our research, and deployed with our frontier safety stack so organizations can use open-source models with confidence. - Making models cheaper and more performant through our model performance research. This is a mission-driven research effort, not a commercial product. We believe the health of the open-source AI ecosystem matters and that the best way to advance it is to do science in the open. We’re hiring engineers, researchers, and research fellows to advance this mission.
1:05

Today we're announcing Base Labs, a dedicated research organization focused on advancing open-source AI. We believe in a healthy, open frontier model ecosystem. To enable this, we are working on: - Blue-sky research on continual learning, the science of RL, and how models learn across their full lifecycle, with every experiment and recipe shared openly. - The BaseHub Data Foundry: the highest-quality open RL environments, training data, and real-world benchmarks, built for anyone to train and benchmark on. - Post-post training: taking open-source models and making them better, safer, and more aligned through continual post-training, built on our research, and deployed with our frontier safety stack so organizations can use open-source models with confidence. - Making models cheaper and more performant through our model performance research. This is a mission-driven research effort, not a commercial product. We believe the health of the open-source AI ecosystem matters and that the best way to advance it is to do science in the open. We’re hiring engineers, researchers, and research fellows to advance this mission.

Base Labs

241,481 görüntüleme • 28 gün önce

Enterprise AI is in a wildly paradoxical state 🤔, and we’re reaching the inflection point that will resolve it. 💥 Enterprises want to differentiate with AI, yet rent the same intelligence as their competitors. Their workflows and expertise are highly specialized, yet they rely on generic models built to be good at everything. They worry about AI costs, yet pay premium prices for massive models where only a fraction (1%) of the intelligence is relevant to their task. 💸 And they demand control and sovereignty, yet rent the intelligence becoming core to their business. This is not a sustainable equilibrium. The next era of enterprise AI is specialized intelligence companies build, own, and compound. And we are at the inflection point of this transition. That’s the bet we made when we started Oumi two years ago. Today we’re closing the loop: Oumi can now not only automatically build your specialized AI models, but also deploy them into production, learn from their production experience, and continuously improve them. The intelligence that your business runs on, becomes your differentiator. Your compounding advantage. The winners of the next AI era will turn their own data, expertise, and experience into specialized intelligence that nobody else can rent. Don’t rent your AI. Build it. Own it. Compound it.
0:43

Enterprise AI is in a wildly paradoxical state 🤔, and we’re reaching the inflection point that will resolve it. 💥 Enterprises want to differentiate with AI, yet rent the same intelligence as their competitors. Their workflows and expertise are highly specialized, yet they rely on generic models built to be good at everything. They worry about AI costs, yet pay premium prices for massive models where only a fraction (1%) of the intelligence is relevant to their task. 💸 And they demand control and sovereignty, yet rent the intelligence becoming core to their business. This is not a sustainable equilibrium. The next era of enterprise AI is specialized intelligence companies build, own, and compound. And we are at the inflection point of this transition. That’s the bet we made when we started Oumi two years ago. Today we’re closing the loop: Oumi can now not only automatically build your specialized AI models, but also deploy them into production, learn from their production experience, and continuously improve them. The intelligence that your business runs on, becomes your differentiator. Your compounding advantage. The winners of the next AI era will turn their own data, expertise, and experience into specialized intelligence that nobody else can rent. Don’t rent your AI. Build it. Own it. Compound it.

Manos Koukoumidis

1,006,622 görüntüleme • 1 ay önce

Your data is your edge, but only if your AI is built on it. Rent a generic model and so can your competitor. The companies with an edge are deploying custom models that they own and improve over time. Our co-founder Rhythm Garg recently stopped by to share how companies are owning their intelligence with Applied Compute.
0:24

Your data is your edge, but only if your AI is built on it. Rent a generic model and so can your competitor. The companies with an edge are deploying custom models that they own and improve over time. Our co-founder Rhythm Garg recently stopped by to share how companies are owning their intelligence with Applied Compute.

Applied Compute

119,306 görüntüleme • 4 ay önce

An agent is three things: a harness, a model, and context. If you're serious about owning your intelligence, you probably want to own all three. LangChain founder Harrison Chase joined us at our Sequoia Capital Own Your Intelligence to talk about the piece that often gets the least attention: the harness. He offers a clear heuristic for when to build your own. The more out of distribution you are from what the models were trained on, the more you'll want to customize. And good technical content on how to actually measure performance with evals and langsmith. 00:00 Introduction 00:58 The three parts of an agent: harness, model, context 02:12 What a harness actually does 03:25 Customizing the core loop with middleware 04:41 Sandboxes, file systems, sub-agents, summarization 05:47 Cognitive architectures — and when you still need them 07:03 Build your own harness or use off the shelf? 08:24 In-distribution vs. out-of-distribution: the file-editing example 09:39 Why evals define what "good" means in an organization 11:04 Harbor: what an eval task actually looks like 12:11 Comparing harnesses and models on accuracy, latency, and cost 13:20 Why observability is underrated — it's usually the context 14:34 The data flywheel: traces → curation → experiments 15:42 Getting feedback through UX design and online evaluators 16:51 Demo: LangSmith Engine 19:23 Q&A: Running Engine on Engine, and "codex-ification" 20:44 Q&A: Will harnesses converge or diverge?
23:56

An agent is three things: a harness, a model, and context. If you're serious about owning your intelligence, you probably want to own all three. LangChain founder Harrison Chase joined us at our Sequoia Capital Own Your Intelligence to talk about the piece that often gets the least attention: the harness. He offers a clear heuristic for when to build your own. The more out of distribution you are from what the models were trained on, the more you'll want to customize. And good technical content on how to actually measure performance with evals and langsmith. 00:00 Introduction 00:58 The three parts of an agent: harness, model, context 02:12 What a harness actually does 03:25 Customizing the core loop with middleware 04:41 Sandboxes, file systems, sub-agents, summarization 05:47 Cognitive architectures — and when you still need them 07:03 Build your own harness or use off the shelf? 08:24 In-distribution vs. out-of-distribution: the file-editing example 09:39 Why evals define what "good" means in an organization 11:04 Harbor: what an eval task actually looks like 12:11 Comparing harnesses and models on accuracy, latency, and cost 13:20 Why observability is underrated — it's usually the context 14:34 The data flywheel: traces → curation → experiments 15:42 Getting feedback through UX design and online evaluators 16:51 Demo: LangSmith Engine 19:23 Q&A: Running Engine on Engine, and "codex-ification" 20:44 Q&A: Will harnesses converge or diverge?

Sonya Huang 🐥

77,519 görüntüleme • 1 ay önce

When should you start post-training your own models? Fireworks CEO Lin Qiao’s answer: after product-market fit. Not because it's hard... but because only after PMF is the data coming off your product surface worth training on. Lin joined us for our Sequoia Capital "Own Your Intelligence" event to host a workshop on all things post-training; what works, what breaks, and how not to let the model outsmart you. Must listen!! 00:00 Introduction 00:37 What Fireworks sees across thousands of AI applications 02:47 Off-the-shelf APIs and the problem of keeping your taste 03:58 What "owning your intelligence" actually means 05:43 The progression: prompting → RAG → SFT → preferences → RL 07:20 Why this mirrors how humans learn 09:03 Matching the technique to the problem you actually have 10:46 Where teams get stuck: data quality and vibe evals 12:28 Reward hacking: the model that wrote zero lines of code 13:59 Training-to-serving alignment (and why quality drops) 15:55 Post-training in healthcare and security 17:31 From coding to every co-work domain 19:35 Incumbents, cost burden, and not scaling into bankruptcy 21:26 How much control do you want? 23:24 Q&A: What makes a good reward signal 25:00 Q&A: When to start thinking about post-training
28:28

When should you start post-training your own models? Fireworks CEO Lin Qiao’s answer: after product-market fit. Not because it's hard... but because only after PMF is the data coming off your product surface worth training on. Lin joined us for our Sequoia Capital "Own Your Intelligence" event to host a workshop on all things post-training; what works, what breaks, and how not to let the model outsmart you. Must listen!! 00:00 Introduction 00:37 What Fireworks sees across thousands of AI applications 02:47 Off-the-shelf APIs and the problem of keeping your taste 03:58 What "owning your intelligence" actually means 05:43 The progression: prompting → RAG → SFT → preferences → RL 07:20 Why this mirrors how humans learn 09:03 Matching the technique to the problem you actually have 10:46 Where teams get stuck: data quality and vibe evals 12:28 Reward hacking: the model that wrote zero lines of code 13:59 Training-to-serving alignment (and why quality drops) 15:55 Post-training in healthcare and security 17:31 From coding to every co-work domain 19:35 Incumbents, cost burden, and not scaling into bankruptcy 21:26 How much control do you want? 23:24 Q&A: What makes a good reward signal 25:00 Q&A: When to start thinking about post-training

Sonya Huang 🐥

28,212 görüntüleme • 1 ay önce

Intelligence and Experience are orthogonal vectors Terence Tao is perhaps the world’s smartest person, but drop him into an accounting firm or onto a construction site and on day one he’s not going to be very productive Trajectory calls this The Experience Gap, and they have a way to close it Arjun Karanam explained how at our Sovereign AI event: 00:00 Introduction 00:12 Building the platform for continual learning 01:33 The experience gap: models have IQ but no tenure 02:52 Traceability → model spec → better models and harnesses 05:27 Four wishes for the agent ecosystem 06:34 Wish 1: Trace the whole tree — and capture the corrections 08:03 Wish 2: Evals from real traffic, graded in the real harness 09:26 Wish 3: Let the agents cook, and make tool responses informative 10:34 Wish 4: Get comfortable on open weights, experiment with routers 11:51 Why owning your intelligence shouldn't be consulted away 13:15 Demo: import a benchmark, train a model, deploy it 14:28 Q&A: What's the trainable object — weights, harness, or context? 16:08 Q&A: Continual learning without training on customer data 17:13 Q&A: Episodic memory and the hierarchy of feedback 19:37 Q&A: Where continual learning matters most
21:55

Intelligence and Experience are orthogonal vectors Terence Tao is perhaps the world’s smartest person, but drop him into an accounting firm or onto a construction site and on day one he’s not going to be very productive Trajectory calls this The Experience Gap, and they have a way to close it Arjun Karanam explained how at our Sovereign AI event: 00:00 Introduction 00:12 Building the platform for continual learning 01:33 The experience gap: models have IQ but no tenure 02:52 Traceability → model spec → better models and harnesses 05:27 Four wishes for the agent ecosystem 06:34 Wish 1: Trace the whole tree — and capture the corrections 08:03 Wish 2: Evals from real traffic, graded in the real harness 09:26 Wish 3: Let the agents cook, and make tool responses informative 10:34 Wish 4: Get comfortable on open weights, experiment with routers 11:51 Why owning your intelligence shouldn't be consulted away 13:15 Demo: import a benchmark, train a model, deploy it 14:28 Q&A: What's the trainable object — weights, harness, or context? 16:08 Q&A: Continual learning without training on customer data 17:13 Q&A: Episodic memory and the hierarchy of feedback 19:37 Q&A: Where continual learning matters most

Pat Grady

77,295 görüntüleme • 1 ay önce

.Chamath Palihapitiya on building a moat in 2026: If you are a reasonable company, why are you not finding an independent way to access intelligence in a way that doesn't leak your edge away? To [not] do so at this point now is kind of becoming derelict and irresponsible… With post-training and telemetry collected from usage, you can take GLM, control it entirely, soup to nuts, on your own hardware, inside the United States, and have it be much, much cheaper. Start building your own intelligence today.
1:05

.Chamath Palihapitiya on building a moat in 2026: If you are a reasonable company, why are you not finding an independent way to access intelligence in a way that doesn't leak your edge away? To [not] do so at this point now is kind of becoming derelict and irresponsible… With post-training and telemetry collected from usage, you can take GLM, control it entirely, soup to nuts, on your own hardware, inside the United States, and have it be much, much cheaper. Start building your own intelligence today.

Alex Ker 🔭

108,498 görüntüleme • 2 ay önce

.L3Harris says Palantir helped them beat frontier AI models in less than 2 days, at 95% lower cost: "When we fine-tuned open source models trained on our own data, we were able to outperform the frontier models in less than 48 hours." "The cost of our fine-tuned open source model was 95% lower than the frontier models we were using." "AI is a commodity. It's all about the data. We view our data as a corporate asset. It's our unique hard-earned knowledge." "We believe American defense companies should not be a vassal for frontier AI labs, handing over our data and institutional knowledge, hoping to rent back the intelligence it creates." " We own the model, we own the compute, we own the advantage."
1:19

.L3Harris says Palantir helped them beat frontier AI models in less than 2 days, at 95% lower cost: "When we fine-tuned open source models trained on our own data, we were able to outperform the frontier models in less than 48 hours." "The cost of our fine-tuned open source model was 95% lower than the frontier models we were using." "AI is a commodity. It's all about the data. We view our data as a corporate asset. It's our unique hard-earned knowledge." "We believe American defense companies should not be a vassal for frontier AI labs, handing over our data and institutional knowledge, hoping to rent back the intelligence it creates." " We own the model, we own the compute, we own the advantage."

Jawwwn

1,105,056 görüntüleme • 21 gün önce

The open-source & open-weight frontier is 7 months behind the closed-model frontier. Let’s talk about it. Check out last week’s episode for the reasons why you might want to consider open-source & open-weight models. Welcome to the fourth episode of the Open Model Series with merve, Hugging Face AI/ML engineer & open-sourceress! We have been discussing open-source & open-weight AI: what it is, how it works, and how you can run them on your own compute. Please leave all your questions about open-source & open-weight AI in the comments! This is a super important topic that is novel to most people, and it can be challenging to grasp - so rest assured your questions are shared with many others!
1:14

The open-source & open-weight frontier is 7 months behind the closed-model frontier. Let’s talk about it. Check out last week’s episode for the reasons why you might want to consider open-source & open-weight models. Welcome to the fourth episode of the Open Model Series with merve, Hugging Face AI/ML engineer & open-sourceress! We have been discussing open-source & open-weight AI: what it is, how it works, and how you can run them on your own compute. Please leave all your questions about open-source & open-weight AI in the comments! This is a super important topic that is novel to most people, and it can be challenging to grasp - so rest assured your questions are shared with many others!

Harper Carroll

17,279 görüntüleme • 1 ay önce

Sam Altman, CEO of OpenAI: "GPT 5.6 is 54% more efficient on agentic coding, and it's still the best on the market for half the cost." AI spend has never mattered as much as it does today. As a result the models keep getting better and cheaper at the same time. This is going to widen the gap between the people using AI agents and everyone else, because now it's not just powerful, it's cheap. That's exactly why i wrote a full step by step guide on agents, what they are and how to build your own from scratch. Read it below.
2:15

Sam Altman, CEO of OpenAI: "GPT 5.6 is 54% more efficient on agentic coding, and it's still the best on the market for half the cost." AI spend has never mattered as much as it does today. As a result the models keep getting better and cheaper at the same time. This is going to widen the gap between the people using AI agents and everyone else, because now it's not just powerful, it's cheap. That's exactly why i wrote a full step by step guide on agents, what they are and how to build your own from scratch. Read it below.

Anatoli Kopadze

91,858 görüntüleme • 2 ay önce

.River AI has a new vision for personal AI. We co-led River’s $1.1B funding round because we believe in Igor Babuschkin's ambition to build open-weight models that individuals can train and improve continuously. Watch Hemant Taneja in conversation with Igor. Chapters 02:22 — Co-Founding xAI 04:36 — An AI Experience You Own 05:59 — Betting Early on Open Weights 07:47 — How Do You Make Money on Free Models? 09:25 — Why the US Needs Its Own Open Models 11:27 — Enterprises Want to Control Their AI 13:36 — What Is Continual Learning? 16:56 — An API That Updates the Weights 19:17 — A Personal AI for Everyone 20:46 — The 20-Minute Training Run
22:16

.River AI has a new vision for personal AI. We co-led River’s $1.1B funding round because we believe in Igor Babuschkin's ambition to build open-weight models that individuals can train and improve continuously. Watch Hemant Taneja in conversation with Igor. Chapters 02:22 — Co-Founding xAI 04:36 — An AI Experience You Own 05:59 — Betting Early on Open Weights 07:47 — How Do You Make Money on Free Models? 09:25 — Why the US Needs Its Own Open Models 11:27 — Enterprises Want to Control Their AI 13:36 — What Is Continual Learning? 16:56 — An API That Updates the Weights 19:17 — A Personal AI for Everyone 20:46 — The 20-Minute Training Run

General Catalyst

112,510 görüntüleme • 1 ay önce

When Mudith Jayasekara and I met Gabe Pereyra, we were expecting just another vanilla intro call and instead had the best yarn about research, the state of LLMs, and where intelligence is actually heading. It's rare to meet a founder this deep in the weeds who's also building for one of the most important verticals in this new age of intelligence So it was awesome to sit down with Gabe for an extended discussion on what it take to build agents that can reliably complete work over hours, days, or even longer? We talked about why agents today struggle with search and long context windows and how techniques like KV-cache compaction, synthetic data, and continual learning could help. 0:00 Introduction 0:36 Getting legal agents to review the whole data room 2:08 Data rooms larger than any context window 5:28 How far open-source models can go 7:58 Where specialist models fit in legal AI 10:59 Training legal models when client data is off-limits 13:06 Teaching a model how a law firm works 13:59 What belongs in context vs. model weights 15:36 From firm-wide AI to a model for every lawyer 18:37 What training adds beyond retrieving the right cases 20:26 Why context windows have plateaued 24:01 How models could learn continuously on the job 26:12 Can AI recursively improve AI research? 27:07 Research agents can run experiments but not choose them 30:00 Why open-ended research is hard to train 33:47 Why deployment, not intelligence, is the bottleneck 35:08 The cost of frontier intelligence 36:59 Different neolabs, different paths to intelligence 39:26 Using open datasets to compare research methods 41:13 Conclusion
41:50

When Mudith Jayasekara and I met Gabe Pereyra, we were expecting just another vanilla intro call and instead had the best yarn about research, the state of LLMs, and where intelligence is actually heading. It's rare to meet a founder this deep in the weeds who's also building for one of the most important verticals in this new age of intelligence So it was awesome to sit down with Gabe for an extended discussion on what it take to build agents that can reliably complete work over hours, days, or even longer? We talked about why agents today struggle with search and long context windows and how techniques like KV-cache compaction, synthetic data, and continual learning could help. 0:00 Introduction 0:36 Getting legal agents to review the whole data room 2:08 Data rooms larger than any context window 5:28 How far open-source models can go 7:58 Where specialist models fit in legal AI 10:59 Training legal models when client data is off-limits 13:06 Teaching a model how a law firm works 13:59 What belongs in context vs. model weights 15:36 From firm-wide AI to a model for every lawyer 18:37 What training adds beyond retrieving the right cases 20:26 Why context windows have plateaued 24:01 How models could learn continuously on the job 26:12 Can AI recursively improve AI research? 27:07 Research agents can run experiments but not choose them 30:00 Why open-ended research is hard to train 33:47 Why deployment, not intelligence, is the bottleneck 35:08 The cost of frontier intelligence 36:59 Different neolabs, different paths to intelligence 39:26 Using open datasets to compare research methods 41:13 Conclusion

Charlie O'Neill

93,422 görüntüleme • 2 ay önce

A model is only as good as its data, and we’ve long since exhausted the internet. From here on out, model progress is gated by data production. ’s Brendan (can/do) joined us at our Sovereign AI event to talk about how RL environments get built, and why your data might be your real moat: 00:00 Introduction 00:47 A short history of the data market: crowdsourcing to agentic data 02:29 What an RL environment is: worlds, apps, tasks 03:57 Why only humans can measure the frontier 05:35 Building verifiers is the hard part 06:44 Walkthrough: a real legal RL environment 08:18 Leaderboards — and what open weights change 09:45 Post-training results on Apex Agents 11:17 Three ways companies buy data 12:49 Q&A: How do you price data? 14:17 Q&A: What "data quality" actually means 16:42 Q&A: The misunderstanding about synthetic data 18:17 Q&A: Why RL environments now — and what comes after 21:20 Q&A: Can you scale rubric generation with models? 23:00 Q&A: RL environments for cyber defense 25:33 Q&A: Build data in-house or partner?
26:21

A model is only as good as its data, and we’ve long since exhausted the internet. From here on out, model progress is gated by data production. ’s Brendan (can/do) joined us at our Sovereign AI event to talk about how RL environments get built, and why your data might be your real moat: 00:00 Introduction 00:47 A short history of the data market: crowdsourcing to agentic data 02:29 What an RL environment is: worlds, apps, tasks 03:57 Why only humans can measure the frontier 05:35 Building verifiers is the hard part 06:44 Walkthrough: a real legal RL environment 08:18 Leaderboards — and what open weights change 09:45 Post-training results on Apex Agents 11:17 Three ways companies buy data 12:49 Q&A: How do you price data? 14:17 Q&A: What "data quality" actually means 16:42 Q&A: The misunderstanding about synthetic data 18:17 Q&A: Why RL environments now — and what comes after 21:20 Q&A: Can you scale rubric generation with models? 23:00 Q&A: RL environments for cyber defense 25:33 Q&A: Build data in-house or partner?

Pat Grady

66,691 görüntüleme • 1 ay önce

Alex Karp went on TV and said his enterprise customers are done letting AI companies quietly steal the alpha out of their business, and the CEO of Together AI explained on CNBC exactly how that theft works. Karp said his customers are livid. They feel they pay for tokens that create nothing while handing over the secret sauce of their own company. Then Vipul Ved Prakash laid out the mechanism. Every time you send your data to a company with very smart models, you hand them the recipe to rebuild what you do. Your data is the thing that makes you money. And you are pushing it straight into a competitor's system. The smarter the models get, the more they learn from what you feed them. This is why companies are moving to open models, and it was never really about price. You can download an open model, run it inside your own walls, and never let your data leave the building. It scores 81 against the top closed model's 85, and runs up to sixty times cheaper. Half the Fortune 500 is already running open models from Hugging Face. The story was that the labs win because they own the best models. The companies paying them just realized they owned the best data the whole time.
0:45

Alex Karp went on TV and said his enterprise customers are done letting AI companies quietly steal the alpha out of their business, and the CEO of Together AI explained on CNBC exactly how that theft works. Karp said his customers are livid. They feel they pay for tokens that create nothing while handing over the secret sauce of their own company. Then Vipul Ved Prakash laid out the mechanism. Every time you send your data to a company with very smart models, you hand them the recipe to rebuild what you do. Your data is the thing that makes you money. And you are pushing it straight into a competitor's system. The smarter the models get, the more they learn from what you feed them. This is why companies are moving to open models, and it was never really about price. You can download an open model, run it inside your own walls, and never let your data leave the building. It scores 81 against the top closed model's 85, and runs up to sixty times cheaper. Half the Fortune 500 is already running open models from Hugging Face. The story was that the labs win because they own the best models. The companies paying them just realized they owned the best data the whole time.

Ihtesham Ali

17,433 görüntüleme • 3 ay önce

For the first time, your AI can be an extension of you — not a service you use. newOS is a new operating system for the mind. It gives your intelligence a home — a place to create a personal AI modeled on your own way of thinking, with its own memory, identity, and wallet powered by the Ethereum Virtual Machine (EVM). Now going live on Base, every AI in newOS receives a trust score and cryptographically verified interactions, so your intelligence, ideas, and data remain fully yours. It’s the foundation for a new internet — where insight flows directly between sovereign minds, not through corporate servers. The Garden is open. 1️⃣ Create your AI in minutes 2️⃣ Feed it your expertise and taste 3️⃣ Grow your trust score on the leaderboard 🌱 Comment your impressions and questions on this tweet to jump the waitlist.
8:00

For the first time, your AI can be an extension of you — not a service you use. newOS is a new operating system for the mind. It gives your intelligence a home — a place to create a personal AI modeled on your own way of thinking, with its own memory, identity, and wallet powered by the Ethereum Virtual Machine (EVM). Now going live on Base, every AI in newOS receives a trust score and cryptographically verified interactions, so your intelligence, ideas, and data remain fully yours. It’s the foundation for a new internet — where insight flows directly between sovereign minds, not through corporate servers. The Garden is open. 1️⃣ Create your AI in minutes 2️⃣ Feed it your expertise and taste 3️⃣ Grow your trust score on the leaderboard 🌱 Comment your impressions and questions on this tweet to jump the waitlist.

Newfoundation

142,898 görüntüleme • 1 yıl önce

“don’t train your own model” is common ai advice. it's wrong. your token bill's the proof. today, we’re excited to launch castform into open preview. castform is the easiest way for you to train your own model, on your own data. open-weights models are performant and much cheaper. when trained on your task & proprietary data, they beat closed models. the thing standing between you and that was weeks of plumbing & years of ml expertise. with castform, model training is as simple as prompt engineering. castform bring your agent traces or raw corpora. castform turns it into training data, picks the right algorithmic recipes, manages gpus, and gives you an ide to watch and chat with your model as it learns. see what you can build with castform👇
2:23

“don’t train your own model” is common ai advice. it's wrong. your token bill's the proof. today, we’re excited to launch castform into open preview. castform is the easiest way for you to train your own model, on your own data. open-weights models are performant and much cheaper. when trained on your task & proprietary data, they beat closed models. the thing standing between you and that was weeks of plumbing & years of ml expertise. with castform, model training is as simple as prompt engineering. castform bring your agent traces or raw corpora. castform turns it into training data, picks the right algorithmic recipes, manages gpus, and gives you an ide to watch and chat with your model as it learns. see what you can build with castform👇

girish

462,836 görüntüleme • 3 ay önce

Ben Goertzel told me two years. Emad Mostaque puts a sharper number on it: 800 days. Emad built Stable Diffusion: he put AI image generation in the hands of millions. Now he's warning about what he helped start: "In crypto it's not your keys, not your crypto. And with AI, it's not your models, not your mind." His argument goes further than jobs. Within a couple of years, he says, the value of human cognitive labor goes to zero. And while that happens, governments move in with licenses, KYC and surveillance to control who gets access to the most powerful models. The people who own their own AI stay sovereign. Everyone else rents their mind from a platform. We cover: - The 800-day timeline, and why most people aren't ready - Why you'll soon need a license just to use frontier AI - Why an open-source model you run yourself is the only real form of sovereignty - Digital feudalism: what happens if five companies own all the intelligence - Why owning your models could become as important as owning your Bitcoin keys Thanks for OKX for being our sponsor of this episode. Timestamps: 00:00 - The 800-Day Countdown 03:16 - What AI Breaks First 06:01 - Not Your Models, Not Your Mind 16:53 - The License You'll Need To Use AI 24:05 - The Ethics Nobody Agrees On 27:30 - The Jobs That Don't Survive 32:33 - When Cognitive Labor Goes To Zero 39:47 - Investing In A World That Thinks 51:44 - Escaping Digital Feudalism 55:41 - What To Do Differently Tomorrow Stability AI Intelligent Internet
54:01

Ben Goertzel told me two years. Emad Mostaque puts a sharper number on it: 800 days. Emad built Stable Diffusion: he put AI image generation in the hands of millions. Now he's warning about what he helped start: "In crypto it's not your keys, not your crypto. And with AI, it's not your models, not your mind." His argument goes further than jobs. Within a couple of years, he says, the value of human cognitive labor goes to zero. And while that happens, governments move in with licenses, KYC and surveillance to control who gets access to the most powerful models. The people who own their own AI stay sovereign. Everyone else rents their mind from a platform. We cover: - The 800-day timeline, and why most people aren't ready - Why you'll soon need a license just to use frontier AI - Why an open-source model you run yourself is the only real form of sovereignty - Digital feudalism: what happens if five companies own all the intelligence - Why owning your models could become as important as owning your Bitcoin keys Thanks for OKX for being our sponsor of this episode. Timestamps: 00:00 - The 800-Day Countdown 03:16 - What AI Breaks First 06:01 - Not Your Models, Not Your Mind 16:53 - The License You'll Need To Use AI 24:05 - The Ethics Nobody Agrees On 27:30 - The Jobs That Don't Survive 32:33 - When Cognitive Labor Goes To Zero 39:47 - Investing In A World That Thinks 51:44 - Escaping Digital Feudalism 55:41 - What To Do Differently Tomorrow Stability AI Intelligent Internet

Michaël van de Poppe

158,833 görüntüleme • 1 ay önce

Gavin Baker says the future for the world's biggest companies is open models and private context: "I think the future is an ensemble of models. There's a Pareto curve. No one model is going to be the best at everything." "For the global 1,000 biggest companies, you're going to take whatever the best open-source model is. I think probably in the very near future, that's going to be an Nvidia model." "Everybody says 'Well, in a world where open-source wins, who funds the training?' Chip companies can fund the training." "It's trivial to do a $50 to $100 billion training run for Jensen, but I do think you're going to see American open-source led by Nvidia get really close to the frontier." "Sharing your own enterprise context, that's truly your IP, that's truly the value of your company, the context embedded in all of your data, sharing that with a frontier lab may be hazardous for your financial health." "I think what you'll see these companies do is they'll have their own model on their data, and it will work with one or two other frontier models, checking each other... I think that feels like a very likely future to me." Gavin Baker David George
1:37

Gavin Baker says the future for the world's biggest companies is open models and private context: "I think the future is an ensemble of models. There's a Pareto curve. No one model is going to be the best at everything." "For the global 1,000 biggest companies, you're going to take whatever the best open-source model is. I think probably in the very near future, that's going to be an Nvidia model." "Everybody says 'Well, in a world where open-source wins, who funds the training?' Chip companies can fund the training." "It's trivial to do a $50 to $100 billion training run for Jensen, but I do think you're going to see American open-source led by Nvidia get really close to the frontier." "Sharing your own enterprise context, that's truly your IP, that's truly the value of your company, the context embedded in all of your data, sharing that with a frontier lab may be hazardous for your financial health." "I think what you'll see these companies do is they'll have their own model on their data, and it will work with one or two other frontier models, checking each other... I think that feels like a very likely future to me." Gavin Baker David George

a16z

39,947 görüntüleme • 1 ay önce

Matt Bornstein says open source is how AI companies stop being wrappers: "A year ago, a bunch of smaller companies or new application companies were trying to figure out, 'How do I really build an AI without just being a wrapper on top of OpenAI?' The answer to that question turned out to be open source." "This is what Cursor did. This is what Decagon and Harvey are in the process of doing now. A bunch of really strong application-level startups made the determination: we can't build just on closed source." "We need to do our own mid-training, our own post-training, our own inference and deployment tricks. All of that means it must be built on top of open source. The closed-source vendors won't give you the access to do this." "Open source became really central in a way that's not always visible because it's deeply embedded in some of these products. Some of the most innovative products and applications now really depend on this very deeply." Matt Bornstein
1:15

Matt Bornstein says open source is how AI companies stop being wrappers: "A year ago, a bunch of smaller companies or new application companies were trying to figure out, 'How do I really build an AI without just being a wrapper on top of OpenAI?' The answer to that question turned out to be open source." "This is what Cursor did. This is what Decagon and Harvey are in the process of doing now. A bunch of really strong application-level startups made the determination: we can't build just on closed source." "We need to do our own mid-training, our own post-training, our own inference and deployment tricks. All of that means it must be built on top of open source. The closed-source vendors won't give you the access to do this." "Open source became really central in a way that's not always visible because it's deeply embedded in some of these products. Some of the most innovative products and applications now really depend on this very deeply." Matt Bornstein

a16z

40,604 görüntüleme • 1 ay önce