Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

José explains why open-source AI could favor inference providers. “It’s definitely bad for OpenAI and Anthropic, but it’s really good for the neoclouds and inference providers... More people get access to cheap intelligence, more stuff gets done.”

Delphi Digital

1,567,382 subscribers

22,167 views • 3 months ago •via X (Twitter)

Science & Technology Finance

Anya Rossi• Live Now

Private livecam show

7 Comments

Delphi Digital3 months ago

Watch the full episode here.

Maria García3 months ago

It seems like Delphi Digital is discussing Anthropic's recent issues and how they might impact the growth of AI-based projects!.

The AI Therapist3 months ago

Openai's margin was "we're the only ones with it." open-source erases that instantly. what's left to sell: inference speed. providers who own silicon just won the game

Qmatrix3 months ago

open-source models still need specialist labeled data for scientific domains like molecular simulation. We route those tasks through domain experts for the quality attestation that inference providers rely on.

João Capital3 months ago

a abertura de modelos como llama reduz o custo de inferencia em ate 80% e acelera a adoção por neoclouds como coreweave.

Crypto Hôm Nay3 months ago

Mở nguồn AI tốt cho nhà cung cấp inference.

RaoulDuke3 months ago

yeah this fits with more devs using decentralized inference options these days

Related Videos

AI teams overpay for inference twice: once for models bigger than they need, and again for idle capacity they don’t use. RouterPlus (YC F26) is the extended inference team for fast-growing AI companies. We test models and providers on your traffic and get providers to compete for your work. Make your inference better. Go to

AI teams overpay for inference twice: once for models bigger than they need, and again for idle capacity they don’t use. RouterPlus (YC F26) is the extended inference team for fast-growing AI companies. We test models and providers on your traffic and get providers to compete for your work. Make your inference better. Go to

Alok Bishoyi

1,066,433 views • 10 days ago

Introducing Liquid Inference by Architect, a new LLM model router where inference providers compete dynamically to offer lowest-cost tokens. Providers onboard in minutes, not weeks. Buyers have full price visibility and receive 20% of referred fees in free inference. More info: Liquid Inference can be used in place of any OpenAI or Anthropic API-compatible backend. Behind it, our team has leveraged our experience trading and building financial exchanges to create real-time two-sided price discovery for inference. Benefits for buyers and providers: INFERENCE BUYERS • Fully compatible with agentic coding tools: Claude Code, Codex, OpenCode, Cursor, Pi, Cline, and many more. Full multi-modal support. • Hundreds of open- and closed-weight models. Create routing rule presets or use our Auto routing algorithms. • Providers compete dynamically on price for every prompt, offering the lowest marginal cost. • Sign up for free with email, first 500 users get $20 of free inference. • Receive 20% of referred fees as free inference, 10% for second-level referrals. INFERENCE PROVIDERS • Onboard through the Liquid Inference app. We verify new providers in minutes, not weeks. • All prompts are OpenAI API standard. Simple REST/Websocket API to register models and quotes. • Update quotes dynamically based on your own costs. Monetize GPU capacity only when you want. • Standardize payouts via Stripe, full itemized records of all jobs performed.

Introducing Liquid Inference by Architect, a new LLM model router where inference providers compete dynamically to offer lowest-cost tokens. Providers onboard in minutes, not weeks. Buyers have full price visibility and receive 20% of referred fees in free inference. More info: Liquid Inference can be used in place of any OpenAI or Anthropic API-compatible backend. Behind it, our team has leveraged our experience trading and building financial exchanges to create real-time two-sided price discovery for inference. Benefits for buyers and providers: INFERENCE BUYERS • Fully compatible with agentic coding tools: Claude Code, Codex, OpenCode, Cursor, Pi, Cline, and many more. Full multi-modal support. • Hundreds of open- and closed-weight models. Create routing rule presets or use our Auto routing algorithms. • Providers compete dynamically on price for every prompt, offering the lowest marginal cost. • Sign up for free with email, first 500 users get $20 of free inference. • Receive 20% of referred fees as free inference, 10% for second-level referrals. INFERENCE PROVIDERS • Onboard through the Liquid Inference app. We verify new providers in minutes, not weeks. • All prompts are OpenAI API standard. Simple REST/Websocket API to register models and quotes. • Update quotes dynamically based on your own costs. Monetize GPU capacity only when you want. • Standardize payouts via Stripe, full itemized records of all jobs performed.

Brett Harrison

39,450 views • 1 month ago

Warp supports GLM 5.2! Hosted on Fireworks and super token efficient for the intelligence. We also support BYO inference to connect through other providers

Warp supports GLM 5.2! Hosted on Fireworks and super token efficient for the intelligence. We also support BYO inference to connect through other providers

Warp

16,993 views • 4 months ago

New Delphi Podcast with TravisGood, co-founder of ambient.xyz Travis believes open source AI will win and that OpenAI and Anthropic are making a major strategic mistake by betting against it We discuss – Why closed AI providers can’t be trusted as infrastructure – China’s open source advantage – What happens if OpenAI reaches AGI – Prompt injection and AI’s unsolved safety problem – The AI CapEx bubble and a possible AI winter – How Ambient is building Uber for inference - 00:00 Intro - 03:20 What Ambient Is and How It Works - 18:40 Verified AI Inference - 40:20 China and the Open-Source AI Race - 49:00 Why Closed AI Is Making a Mistake - 1:03:00 What Happens If OpenAI Reaches AGI? - 1:17:10 The AI Bubble and a Possible AI Winter

New Delphi Podcast with TravisGood, co-founder of ambient.xyz Travis believes open source AI will win and that OpenAI and Anthropic are making a major strategic mistake by betting against it We discuss – Why closed AI providers can’t be trusted as infrastructure – China’s open source advantage – What happens if OpenAI reaches AGI – Prompt injection and AI’s unsolved safety problem – The AI CapEx bubble and a possible AI winter – How Ambient is building Uber for inference - 00:00 Intro - 03:20 What Ambient Is and How It Works - 18:40 Verified AI Inference - 40:20 China and the Open-Source AI Race - 49:00 Why Closed AI Is Making a Mistake - 1:03:00 What Happens If OpenAI Reaches AGI? - 1:17:10 The AI Bubble and a Possible AI Winter

Tommy

24,634 views • 3 months ago

The SemiAnalysis team on why Anthropic's S-1 is good news for neoclouds: "Anthropic has shown today AI inference is a really great business. Even running the training is extremely profitable." "Compute margins are excellent." "Neoclouds are still very good businesses."

The SemiAnalysis team on why Anthropic's S-1 is good news for neoclouds: "Anthropic has shown today AI inference is a really great business. Even running the training is extremely profitable." "Compute margins are excellent." "Neoclouds are still very good businesses."

TBPN

33,717 views • 12 days ago

BlackRock calls AI an underappreciated source of demand for digital assets. An agent on Incentiv could buy inference, query paid data and pay providers to complete one task. Each payment funds the next step. More useful work per human instruction as the agentic economy should.

BlackRock calls AI an underappreciated source of demand for digital assets. An agent on Incentiv could buy inference, query paid data and pay providers to complete one task. Each payment funds the next step. More useful work per human instruction as the agentic economy should.

Incentiv

11,402 views • 1 month ago

A question from the $VVV telegram: What role does NEAR Protocol play in Venice's product? NEAR AI is one of Venice's providers for "nuclear-level privacy" for AI inference Jon Venice: "this is a smaller part of Venice overall inference, but it's really important and critical to our offering"

A question from the $VVV telegram: What role does NEAR Protocol play in Venice's product? NEAR AI is one of Venice's providers for "nuclear-level privacy" for AI inference Jon Venice: "this is a smaller part of Venice overall inference, but it's really important and critical to our offering"

David Hoffman

35,675 views • 24 days ago

The bull case for AI isn't zero-sum. It might literally be that everyone wins. "Anthropic wins, OpenAI wins, SpaceX wins, Meta wins... open source wins, NeoClouds win, inference clouds win." And $NVDA sits at the center of all of it. FT Gavin Baker David George a16z.

The bull case for AI isn't zero-sum. It might literally be that everyone wins. "Anthropic wins, OpenAI wins, SpaceX wins, Meta wins... open source wins, NeoClouds win, inference clouds win." And $NVDA sits at the center of all of it. FT Gavin Baker David George a16z.

Milk Road Stocks

12,466 views • 2 months ago

⚡️Today marks a big milestone for Nebius. We’re launching Nebius Token Factory, the evolution of Nebius AI Studio, built to make open-source AI production-grade. Token Factory transforms raw open models into governed, scalable systems with dedicated inference, sub-second latency, 99.9% uptime and zero-retention compliance. It’s where inference, post-training and governance converge, turning raw compute into reliable intelligence. Run AI inference at scale:

⚡️Today marks a big milestone for Nebius. We’re launching Nebius Token Factory, the evolution of Nebius AI Studio, built to make open-source AI production-grade. Token Factory transforms raw open models into governed, scalable systems with dedicated inference, sub-second latency, 99.9% uptime and zero-retention compliance. It’s where inference, post-training and governance converge, turning raw compute into reliable intelligence. Run AI inference at scale:

Nebius Token Factory

260,737 views • 1 year ago

Open source powers every layer of the AI software stack—from agents and models to inference, training and cloud infrastructure. At #OSSummit Korea, Linux Foundation CEO Jim Zemlin explains how open collaboration is making AI faster, more affordable and more accessible. Watch:

Open source powers every layer of the AI software stack—from agents and models to inference, training and cloud infrastructure. At #OSSummit Korea, Linux Foundation CEO Jim Zemlin explains how open collaboration is making AI faster, more affordable and more accessible. Watch:

The Linux Foundation

13,685 views • 2 months ago

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 views • 7 months ago

Open source/weight models are often used in regulated industries like Health Care or Financial Services, where they handle personally identifiable data, and can't send it to proprietary LLM providers. We recently chatted to Vaibhav (VB) Srivastav about the partnership VS Visual Studio Code and Hugging Face inference providers have to let you use open weight models directly in your IDE! Something that surprised me was just how fast inference providers like Cerebras make it to generate code! In this episode we made a journaling CLI tool using Qwen! I personally love open source and hope more of these models will become small enough to run locally!

Open source/weight models are often used in regulated industries like Health Care or Financial Services, where they handle personally identifiable data, and can't send it to proprietary LLM providers. We recently chatted to Vaibhav (VB) Srivastav about the partnership VS Visual Studio Code and Hugging Face inference providers have to let you use open weight models directly in your IDE! Something that surprised me was just how fast inference providers like Cerebras make it to generate code! In this episode we made a journaling CLI tool using Qwen! I personally love open source and hope more of these models will become small enough to run locally!

Marlene Mhangami

18,215 views • 11 months ago

BOOM! Starting today you can use open source frontier LLMs in Visual Studio Code with HF Inference Providers! 🔥 Use your inference credits on SoTA llms like GLM 4.5, Qwen3 Coder, DeepSeek 3.1 and more All of it packaged in one simple extension - try it out today 🤗

BOOM! Starting today you can use open source frontier LLMs in Visual Studio Code with HF Inference Providers! 🔥 Use your inference credits on SoTA llms like GLM 4.5, Qwen3 Coder, DeepSeek 3.1 and more All of it packaged in one simple extension - try it out today 🤗

Vaibhav (VB) Srivastav

41,201 views • 1 year ago

This is HUGE, Hugging Face just shipped Inference Providers on the Hub Partnering with Together AI, @FAL, Replicate and SambaNova! Starting today you can access thousands of Models like DeepSeek R1, Llama, Flux, Whisper, and more Directly from Hugging Face!

This is HUGE, Hugging Face just shipped Inference Providers on the Hub Partnering with Together AI, @FAL, Replicate and SambaNova! Starting today you can access thousands of Models like DeepSeek R1, Llama, Flux, Whisper, and more Directly from Hugging Face!

AK

177,217 views • 1 year ago

Ad | Lately I've been testing several OpenAI-compatible inference providers. One that stood out: Jalapeno Cloud. One API for DeepSeek, GLM, Kimi, MiniMax and more. It's not a pure reseller either: they run their own GPU clusters in Japan and Singapore.

Ad | Lately I've been testing several OpenAI-compatible inference providers. One that stood out: Jalapeno Cloud. One API for DeepSeek, GLM, Kimi, MiniMax and more. It's not a pure reseller either: they run their own GPU clusters in Japan and Singapore.

Rakib Hossen

14,392 views • 9 days ago

Kyutai Speech-To-Text is now open-source! It’s streaming, supports batched inference, and runs blazingly fast: perfect for interactive applications. Check out the details here:

Kyutai Speech-To-Text is now open-source! It’s streaming, supports batched inference, and runs blazingly fast: perfect for interactive applications. Check out the details here:

kyutai

67,041 views • 1 year ago

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

NVIDIA

82,086 views • 7 months ago