Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Stop overpaying for every LLM call. 💸 The DigitalOcean Inference Router resolves intent in ~200ms and beats GPT-5.1 and Claude Sonnet 4.5 on routing accuracy. Powered by Rust, WASM, and purpose-built SLMs, it adds milliseconds, not seconds, to every request. 🌊

DigitalOcean

221,342 subscribers

19,853 views • 1 month ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

DigitalOcean

591,533 views • 1 month ago

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.

DigitalOcean

20,992 views • 1 month ago

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊

DigitalOcean

10,297 views • 5 months ago

Today we're releasing Not Diamond… The world’s most powerful AI model router. Not Diamond maximizes LLM output quality by automatically recommending the best LLM on every request at lower cost and latency. And it takes <5m to set up. Watch this to see how to start using it:

Today we're releasing Not Diamond… The world’s most powerful AI model router. Not Diamond maximizes LLM output quality by automatically recommending the best LLM on every request at lower cost and latency. And it takes <5m to set up. Watch this to see how to start using it:

Tomas Hernando Kofman

75,821 views • 1 year ago

Among the fastest DeepSeek V3.2, MiniMax-M2.5, and Qwen 3.5 397B inference in the market, per Artificial Analysis benchmarks (April 2026). ⚡️🤖 Sub-1-second TTFT. 230 tokens per second. Co-designed every layer of the stack with Inferact, performance optimized vLLM, all on NVIDIA HGX B300. Live on DigitalOcean Serverless Inference now. Full breakdown in the comments. ⬇️

Among the fastest DeepSeek V3.2, MiniMax-M2.5, and Qwen 3.5 397B inference in the market, per Artificial Analysis benchmarks (April 2026). ⚡️🤖 Sub-1-second TTFT. 230 tokens per second. Co-designed every layer of the stack with Inferact, performance optimized vLLM, all on NVIDIA HGX B300. Live on DigitalOcean Serverless Inference now. Full breakdown in the comments. ⬇️

DigitalOcean

39,063 views • 2 months ago

Anthropic engineer: "Most people will use Sonnet 5 and Fable 5 wrong. You can set them up right in one afternoon and stop overpaying every single day." In 31 minutes he shows how to test every model against your real use case and stop overpaying for nothing. Watch the session, then read the guide below on the Claude features 99% of users never find.

Anthropic engineer: "Most people will use Sonnet 5 and Fable 5 wrong. You can set them up right in one afternoon and stop overpaying every single day." In 31 minutes he shows how to test every model against your real use case and stop overpaying for nothing. Watch the session, then read the guide below on the Claude features 99% of users never find.

Anatoli Kopadze

153,160 views • 14 days ago

Claude Sonnet 4.5 is now the default model for Augment Code. We’re rolling it out to all customers over the next 24 hours, where it will be available alongside Sonnet 4 (for a limited time) and GPT-5 in the model picker. Here’s how Sonnet 4.5 compares to Sonnet 4:

Claude Sonnet 4.5 is now the default model for Augment Code. We’re rolling it out to all customers over the next 24 hours, where it will be available alongside Sonnet 4 (for a limited time) and GPT-5 in the model picker. Here’s how Sonnet 4.5 compares to Sonnet 4:

Augment Code

29,182 views • 9 months ago

🚨 Announcing Smart Model Router - Create Your Own Custom Router To Route To Your Favorite LLM - Route to GPT Sol, Muse Spark, Grok 4.5 and Fable - Optimize for cost or performance - Use Fable only for hard coding Once you create a router, you can use it on our Chat, Agent or in an API! Coming on Monday - Support for all CLI clients including Code, Claude Code and others

🚨 Announcing Smart Model Router - Create Your Own Custom Router To Route To Your Favorite LLM - Route to GPT Sol, Muse Spark, Grok 4.5 and Fable - Optimize for cost or performance - Use Fable only for hard coding Once you create a router, you can use it on our Chat, Agent or in an API! Coming on Monday - Support for all CLI clients including Code, Claude Code and others

Bindu Reddy

2,571,023 views • 8 days ago

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.

DigitalOcean

805,831 views • 1 month ago

Comparisons of Sonnet 4.5 vs GPT-5 Pro. I appreciate the comparison is not exactly fair, but I've had GPT-5 Pro videos ready to go, so forgive me. Saying that it does give a good benchmark, I don't think there was a single instance of Sonnet 4.5 being better, and I was testing it in Claude Code, so it should have had an advantage of not being stuck in the web client. It doesn't mean to say that Claude 4.5 would be worse on all dimensions, these are 1-shot single file HTML files, so not going to test the full agentic suite of capabilities. Song via Suno v5 Lyrics by Sonnet 4.5

Comparisons of Sonnet 4.5 vs GPT-5 Pro. I appreciate the comparison is not exactly fair, but I've had GPT-5 Pro videos ready to go, so forgive me. Saying that it does give a good benchmark, I don't think there was a single instance of Sonnet 4.5 being better, and I was testing it in Claude Code, so it should have had an advantage of not being stuck in the web client. It doesn't mean to say that Claude 4.5 would be worse on all dimensions, these are 1-shot single file HTML files, so not going to test the full agentic suite of capabilities. Song via Suno v5 Lyrics by Sonnet 4.5

Peter Gostev

255,936 views • 9 months ago

Stop prototyping, start deploying. ☁️🤖 Join us at #DOdeploy SF to master production #AI inference. Grounded in real-world costs & reliability, we'll show you how to scale with DigitalOcean. 🌁

Stop prototyping, start deploying. ☁️🤖 Join us at #DOdeploy SF to master production #AI inference. Grounded in real-world costs & reliability, we'll show you how to scale with DigitalOcean. 🌁

DigitalOcean

10,326 views • 5 months ago

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).

DigitalOcean

27,714 views • 6 months ago

This is the last chatbot you’ll ever need. Yesterday, Mckay Wrigley built an oss Not Diamond-powered chat app. We loved it. So today we’re releasing a hosted version. Get the best LLM on every message and hyper-personalize routing to your preferences with feedback. Watch how:

This is the last chatbot you’ll ever need. Yesterday, Mckay Wrigley built an oss Not Diamond-powered chat app. We loved it. So today we’re releasing a hosted version. Get the best LLM on every message and hyper-personalize routing to your preferences with feedback. Watch how:

Tomas Hernando Kofman

19,668 views • 1 year ago

.RadixArk brought DeepSeek V4 to production with DigitalOcean and AMD. AMD Instinct™ MI350X GPU Droplets, plus joint engineering that drove a ~10x throughput gain. When the team that builds the inference engine picks your stack, that's the signal.

.RadixArk brought DeepSeek V4 to production with DigitalOcean and AMD. AMD Instinct™ MI350X GPU Droplets, plus joint engineering that drove a ~10x throughput gain. When the team that builds the inference engine picks your stack, that's the signal.

DigitalOcean

12,385 views • 4 days ago

Open-sourcing the first unified LLM routing library 🔥 Meet LLMRouter 16+ routers in ONE framework. Stop reimplementing routing papers from scratch, simply run pip install llmrouter-lib And instantly deploy SOTA LLM routing tailored to your exact needs! 🔗 Get Started with LLMRouter 🚀 Code: 🌐 Project Page: 💸 Why LLMRouter? Why pay GPT-5 prices for "What's the weather?" Smart routing = Significant Savings Simple query → Cheap model Complex query → Powerful model Save 30–50% on inference costs without sacrificing quality 🧭 The 16+ Router Arsenal Switch between state-of-the-art methods with a single flag change. We cover every paradigm: ✅ Single-Round: From classic ML (KNN, SVM) to neural approaches (Graph, Contrastive). ✅ Multi-Round: RL-powered reasoning that "thinks" before routing. ✅ Agentic: Breaks down complex tasks and routes step-by-step. ✅ Personalized: Learns from user history to fit unique needs. 🛠️ Complete "Out-of-the-Box" Toolchain We didn't just ship the code; we shipped the pipeline. ✅ Unified CLI: Train, infer, and chat with any router. ✅ Interactive UI: Full Gradio interface included. ✅ Benchmarks: 11 datasets ready to use + full data generation pipeline. From LLM routing research to production in minutes. 🚀

Open-sourcing the first unified LLM routing library 🔥 Meet LLMRouter 16+ routers in ONE framework. Stop reimplementing routing papers from scratch, simply run pip install llmrouter-lib And instantly deploy SOTA LLM routing tailored to your exact needs! 🔗 Get Started with LLMRouter 🚀 Code: 🌐 Project Page: 💸 Why LLMRouter? Why pay GPT-5 prices for "What's the weather?" Smart routing = Significant Savings Simple query → Cheap model Complex query → Powerful model Save 30–50% on inference costs without sacrificing quality 🧭 The 16+ Router Arsenal Switch between state-of-the-art methods with a single flag change. We cover every paradigm: ✅ Single-Round: From classic ML (KNN, SVM) to neural approaches (Graph, Contrastive). ✅ Multi-Round: RL-powered reasoning that "thinks" before routing. ✅ Agentic: Breaks down complex tasks and routes step-by-step. ✅ Personalized: Learns from user history to fit unique needs. 🛠️ Complete "Out-of-the-Box" Toolchain We didn't just ship the code; we shipped the pipeline. ✅ Unified CLI: Train, infer, and chat with any router. ✅ Interactive UI: Full Gradio interface included. ✅ Benchmarks: 11 datasets ready to use + full data generation pipeline. From LLM routing research to production in minutes. 🚀

Jiaxuan You

75,244 views • 6 months ago

Claude Sonnet 4.8 is imminent. Most likely dropping today. Sonnet 4.6 is starting to look outdated. Look at the Flappy Bird test on BridgeBench. GPT 5.5 and Claude Opus 4.7 have moved past it. The model that used to be the default for most vibe coders is falling behind. Anthropic needs Sonnet 4.8 to close the gap. The second it drops, we're running it through every BridgeBench test and posting the results live. New Sonnet day. Let's see what Anthropic has.

Claude Sonnet 4.8 is imminent. Most likely dropping today. Sonnet 4.6 is starting to look outdated. Look at the Flappy Bird test on BridgeBench. GPT 5.5 and Claude Opus 4.7 have moved past it. The model that used to be the default for most vibe coders is falling behind. Anthropic needs Sonnet 4.8 to close the gap. The second it drops, we're running it through every BridgeBench test and posting the results live. New Sonnet day. Let's see what Anthropic has.

Bridgebench

16,715 views • 1 month ago

Someone built a free and better alternative to Claude that runs 100% locally. → works with any LLM (Claude, GPT, Gemini, vLLM) → beats it on deep research → has Cowork-like capabilities → 50+ connectors out of the box → deploy in literally one command 100% open source. MIT license. 28k stars.

Someone built a free and better alternative to Claude that runs 100% locally. → works with any LLM (Claude, GPT, Gemini, vLLM) → beats it on deep research → has Cowork-like capabilities → 50+ connectors out of the box → deploy in literally one command 100% open source. MIT license. 28k stars.

How To Prompt

39,202 views • 2 months ago

We just built the #1 tool every AI team wants. Introducing Merge Gateway: LLM routing, fallback, cost guardrails, and security, all in one place. Everyone gets $10 free LLM usage on us to try it out. RT+ comment “Gateway” → we’ll double your credits.

We just built the #1 tool every AI team wants. Introducing Merge Gateway: LLM routing, fallback, cost guardrails, and security, all in one place. Everyone gets $10 free LLM usage on us to try it out. RT+ comment “Gateway” → we’ll double your credits.

Shensi Ding

93,844 views • 3 months ago

Jensen Huang congratulates OpenAI on Stargate Norway. It will run on GB300 Superchips, scaling to hundreds of thousands of GPUs - purpose-built for training, reasoning, and real-time inference. “Just as electricity and the internet became foundational to modern life, AI will become essential infrastructure. Every country will build it. Every industry will depend on it.”

Jensen Huang congratulates OpenAI on Stargate Norway. It will run on GB300 Superchips, scaling to hundreds of thousands of GPUs - purpose-built for training, reasoning, and real-time inference. “Just as electricity and the internet became foundational to modern life, AI will become essential infrastructure. Every country will build it. Every industry will depend on it.”

vitrupo

73,644 views • 11 months ago

From POC to production inference. 🤖🌁 Join us at #DOdeploy in San Francisco where we'll discuss inference-first architectures, predictable inference economics, operational simplicity at scale, & more.

From POC to production inference. 🤖🌁 Join us at #DOdeploy in San Francisco where we'll discuss inference-first architectures, predictable inference economics, operational simplicity at scale, & more.

DigitalOcean

12,195 views • 4 months ago