Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

José explains why open-source AI could favor inference providers. “It’s definitely bad for OpenAI and Anthropic, but it’s really good for the neoclouds and inference providers... More people get access to cheap intelligence, more stuff gets done.”

Delphi Digital

1,567,382 subscribers

22,167 views • 2 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

7 Comments

Delphi Digital2 months ago

Watch the full episode here.

Maria García2 months ago

It seems like Delphi Digital is discussing Anthropic's recent issues and how they might impact the growth of AI-based projects!.

The AI Therapist2 months ago

Openai's margin was "we're the only ones with it." open-source erases that instantly. what's left to sell: inference speed. providers who own silicon just won the game

Qmatrix2 months ago

open-source models still need specialist labeled data for scientific domains like molecular simulation. We route those tasks through domain experts for the quality attestation that inference providers rely on.

João Capital2 months ago

a abertura de modelos como llama reduz o custo de inferencia em ate 80% e acelera a adoção por neoclouds como coreweave.

Crypto Hôm Nay2 months ago

Mở nguồn AI tốt cho nhà cung cấp inference.

RaoulDuke2 months ago

yeah this fits with more devs using decentralized inference options these days

Related Videos

New Delphi Podcast with TravisGood, co-founder of ambient.xyz Travis believes open source AI will win and that OpenAI and Anthropic are making a major strategic mistake by betting against it We discuss – Why closed AI providers can’t be trusted as infrastructure – China’s open source advantage – What happens if OpenAI reaches AGI – Prompt injection and AI’s unsolved safety problem – The AI CapEx bubble and a possible AI winter – How Ambient is building Uber for inference - 00:00 Intro - 03:20 What Ambient Is and How It Works - 18:40 Verified AI Inference - 40:20 China and the Open-Source AI Race - 49:00 Why Closed AI Is Making a Mistake - 1:03:00 What Happens If OpenAI Reaches AGI? - 1:17:10 The AI Bubble and a Possible AI Winter

New Delphi Podcast with TravisGood, co-founder of ambient.xyz Travis believes open source AI will win and that OpenAI and Anthropic are making a major strategic mistake by betting against it We discuss – Why closed AI providers can’t be trusted as infrastructure – China’s open source advantage – What happens if OpenAI reaches AGI – Prompt injection and AI’s unsolved safety problem – The AI CapEx bubble and a possible AI winter – How Ambient is building Uber for inference - 00:00 Intro - 03:20 What Ambient Is and How It Works - 18:40 Verified AI Inference - 40:20 China and the Open-Source AI Race - 49:00 Why Closed AI Is Making a Mistake - 1:03:00 What Happens If OpenAI Reaches AGI? - 1:17:10 The AI Bubble and a Possible AI Winter

Tommy

24,582 views • 1 month ago

The bull case for AI isn't zero-sum. It might literally be that everyone wins. "Anthropic wins, OpenAI wins, SpaceX wins, Meta wins... open source wins, NeoClouds win, inference clouds win." And $NVDA sits at the center of all of it. FT Gavin Baker David George a16z.

The bull case for AI isn't zero-sum. It might literally be that everyone wins. "Anthropic wins, OpenAI wins, SpaceX wins, Meta wins... open source wins, NeoClouds win, inference clouds win." And $NVDA sits at the center of all of it. FT Gavin Baker David George a16z.

Milk Road Stocks

12,466 views • 18 days ago

⚡️Today marks a big milestone for Nebius. We’re launching Nebius Token Factory, the evolution of Nebius AI Studio, built to make open-source AI production-grade. Token Factory transforms raw open models into governed, scalable systems with dedicated inference, sub-second latency, 99.9% uptime and zero-retention compliance. It’s where inference, post-training and governance converge, turning raw compute into reliable intelligence. Run AI inference at scale:

⚡️Today marks a big milestone for Nebius. We’re launching Nebius Token Factory, the evolution of Nebius AI Studio, built to make open-source AI production-grade. Token Factory transforms raw open models into governed, scalable systems with dedicated inference, sub-second latency, 99.9% uptime and zero-retention compliance. It’s where inference, post-training and governance converge, turning raw compute into reliable intelligence. Run AI inference at scale:

Nebius Token Factory

260,532 views • 10 months ago

Open source powers every layer of the AI software stack—from agents and models to inference, training and cloud infrastructure. At #OSSummit Korea, Linux Foundation CEO Jim Zemlin explains how open collaboration is making AI faster, more affordable and more accessible. Watch:

Open source powers every layer of the AI software stack—from agents and models to inference, training and cloud infrastructure. At #OSSummit Korea, Linux Foundation CEO Jim Zemlin explains how open collaboration is making AI faster, more affordable and more accessible. Watch:

The Linux Foundation

13,685 views • 22 days ago

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 views • 6 months ago

Open source/weight models are often used in regulated industries like Health Care or Financial Services, where they handle personally identifiable data, and can't send it to proprietary LLM providers. We recently chatted to Vaibhav (VB) Srivastav about the partnership VS Visual Studio Code and Hugging Face inference providers have to let you use open weight models directly in your IDE! Something that surprised me was just how fast inference providers like Cerebras make it to generate code! In this episode we made a journaling CLI tool using Qwen! I personally love open source and hope more of these models will become small enough to run locally!

Open source/weight models are often used in regulated industries like Health Care or Financial Services, where they handle personally identifiable data, and can't send it to proprietary LLM providers. We recently chatted to Vaibhav (VB) Srivastav about the partnership VS Visual Studio Code and Hugging Face inference providers have to let you use open weight models directly in your IDE! Something that surprised me was just how fast inference providers like Cerebras make it to generate code! In this episode we made a journaling CLI tool using Qwen! I personally love open source and hope more of these models will become small enough to run locally!

Marlene Mhangami

18,215 views • 10 months ago

This is HUGE, Hugging Face just shipped Inference Providers on the Hub Partnering with Together AI, @FAL, Replicate and SambaNova! Starting today you can access thousands of Models like DeepSeek R1, Llama, Flux, Whisper, and more Directly from Hugging Face!

This is HUGE, Hugging Face just shipped Inference Providers on the Hub Partnering with Together AI, @FAL, Replicate and SambaNova! Starting today you can access thousands of Models like DeepSeek R1, Llama, Flux, Whisper, and more Directly from Hugging Face!

AK

177,217 views • 1 year ago

Kyutai Speech-To-Text is now open-source! It’s streaming, supports batched inference, and runs blazingly fast: perfect for interactive applications. Check out the details here:

Kyutai Speech-To-Text is now open-source! It’s streaming, supports batched inference, and runs blazingly fast: perfect for interactive applications. Check out the details here:

kyutai

66,841 views • 1 year ago

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

NVIDIA

82,086 views • 5 months ago

General AI value is flowing into Onchain AI China Open-Weight Labs → Inference providers → Intelligent Routers Venice is eating more token share, DIEM secondary markets are getting established, and decentralized consumer inference are forming their structural moats Diving into the latest dynamic of General AI Onchain AI + where the value will be going next in today's After Hour Link below ↓

General AI value is flowing into Onchain AI China Open-Weight Labs → Inference providers → Intelligent Routers Venice is eating more token share, DIEM secondary markets are getting established, and decentralized consumer inference are forming their structural moats Diving into the latest dynamic of General AI Onchain AI + where the value will be going next in today's After Hour Link below ↓

0xJeff

16,686 views • 2 months ago

AI inference is already live on UOMI Router. Access frontier open-source models through a decentralized inference network with: • Low-cost inference • OpenAI-compatible APIs • Verifiable compute • On-chain settlement Start building: And if you have idle GPUs, there's now a second way to participate. The UOMI Provider whitelist is officially open. Instead of letting your hardware sit unused, you can contribute GPU power to the UOMI Inference Network and earn from real AI demand. Join the Provider whitelist:

AI inference is already live on UOMI Router. Access frontier open-source models through a decentralized inference network with: • Low-cost inference • OpenAI-compatible APIs • Verifiable compute • On-chain settlement Start building: And if you have idle GPUs, there's now a second way to participate. The UOMI Provider whitelist is officially open. Instead of letting your hardware sit unused, you can contribute GPU power to the UOMI Inference Network and earn from real AI demand. Join the Provider whitelist:

Uomi

18,982 views • 3 months ago

More and more people agree - it’s time for change. Let’s get it done. #skpoli

More and more people agree - it’s time for change. Let’s get it done. #skpoli

Carla Beck

15,562 views • 1 year ago

Jesse Pollak on the ecosystem forming around tokenized inference "There's this really cool tokenized inference market that Venice has innovated, where they've taken inference and turned it into a token called DIEM where you can buy it and you get $1 of inference per day" "That innovation of tokenizing inference has unlocked a ton of innovation around it, where people are using that tokenized inference to do things" "There's other projects that let people sell their tokenized inference at a discount so other people can get cheaper inference and the whole system works more efficiently" "I feel like that's the first time we're really seeing the intersection of AI plus markets plus crypto and it's thanks to Venice and it's happening on Base"

Jesse Pollak on the ecosystem forming around tokenized inference "There's this really cool tokenized inference market that Venice has innovated, where they've taken inference and turned it into a token called DIEM where you can buy it and you get $1 of inference per day" "That innovation of tokenizing inference has unlocked a ton of innovation around it, where people are using that tokenized inference to do things" "There's other projects that let people sell their tokenized inference at a discount so other people can get cheaper inference and the whole system works more efficiently" "I feel like that's the first time we're really seeing the intersection of AI plus markets plus crypto and it's thanks to Venice and it's happening on Base"

Market Bubble

26,240 views • 2 months ago

Lightchain AI – Decentralized Inference Demo 🍂🥧 + Blockchain Rewards In this video, we showcase how Lightchain AI’s decentralized inference engine (AIVM + PoI + Federated Learning) runs a real-world prompt “What is the best way to make pumpkin pie for thanksgiving dinner?” 💰 Blockchain Rewards in Action This demo doesn’t just show inference — it shows how inference providers are rewarded for their work. The provider that processed this prompt was automatically rewarded on the Lightchain testnet. 🍁 Why It Matters Unlike centralized AI, Lightchain AI distributes inference across a global network of participants. Nodes earn blockchain rewards for providing compute, ensuring a trustless, transparent, and economically sustainable ecosystem. With pay-to-prompt mechanics and DAO governance, Lightchain AI creates a fair AI economy for all. 🌐 Learn more at-

Lightchain AI – Decentralized Inference Demo 🍂🥧 + Blockchain Rewards In this video, we showcase how Lightchain AI’s decentralized inference engine (AIVM + PoI + Federated Learning) runs a real-world prompt “What is the best way to make pumpkin pie for thanksgiving dinner?” 💰 Blockchain Rewards in Action This demo doesn’t just show inference — it shows how inference providers are rewarded for their work. The provider that processed this prompt was automatically rewarded on the Lightchain testnet. 🍁 Why It Matters Unlike centralized AI, Lightchain AI distributes inference across a global network of participants. Nodes earn blockchain rewards for providing compute, ensuring a trustless, transparent, and economically sustainable ecosystem. With pay-to-prompt mechanics and DAO governance, Lightchain AI creates a fair AI economy for all. 🌐 Learn more at-

Lightchain AI

18,730 views • 1 year ago

Baseten’s CEO on why every company will want to own its AI / Tuhin Srivastava on the rise of AI agents, the demand for inference, and building a new kind of hyperscaler. Lately, I’ve been spending a lot of time thinking about the AI inference market and how big it could get. Agents like Muse, Instinct, Town, and Grok Bot aggressively use browsers, run their own computers, and burn through far more tokens than a traditional chatbot. As more people put them to work (Muse is number two in the App Store), the demand for inference, or the computing needed to run these models, should grow enormously. Tuhin and I discuss the rise of agents using browsers and virtual machines to get things done, and Baseten's recent acquisition to help power that shift. We also talk about the data center backlash, why companies are embracing Chinese open models, his plans for Baseten’s new research lab, and why he thinks inference becomes the only market left after AGI. Timestamps: 00:00 What Is AI Inference? 06:05 Competing With the Cloud Giants 09:24 Why Companies Want to Own Their AI 15:30 Building Baseten Before the AI Boom 23:45 DeepSeek and the Race for Open AI Models 29:32 Baseten’s Growth and Expansion 33:05 AI Agents and the Blaxel Acquisition 38:32 Data Centers and the AI Backlash 43:25 What Happens to Inference After AGI? 45:12 When AI Agents Become Customers Thanks to the show's premier sponsors: Atlassian, Granola, and Mercury.

Baseten’s CEO on why every company will want to own its AI / Tuhin Srivastava on the rise of AI agents, the demand for inference, and building a new kind of hyperscaler. Lately, I’ve been spending a lot of time thinking about the AI inference market and how big it could get. Agents like Muse, Instinct, Town, and Grok Bot aggressively use browsers, run their own computers, and burn through far more tokens than a traditional chatbot. As more people put them to work (Muse is number two in the App Store), the demand for inference, or the computing needed to run these models, should grow enormously. Tuhin and I discuss the rise of agents using browsers and virtual machines to get things done, and Baseten's recent acquisition to help power that shift. We also talk about the data center backlash, why companies are embracing Chinese open models, his plans for Baseten’s new research lab, and why he thinks inference becomes the only market left after AGI. Timestamps: 00:00 What Is AI Inference? 06:05 Competing With the Cloud Giants 09:24 Why Companies Want to Own Their AI 15:30 Building Baseten Before the AI Boom 23:45 DeepSeek and the Race for Open AI Models 29:32 Baseten’s Growth and Expansion 33:05 AI Agents and the Blaxel Acquisition 38:32 Data Centers and the AI Backlash 43:25 What Happens to Inference After AGI? 45:12 When AI Agents Become Customers Thanks to the show's premier sponsors: Atlassian, Granola, and Mercury.

Alex Heath

25,513 views • 8 days ago