Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Stop overpaying for every LLM call. 💸 The DigitalOcean Inference Router resolves intent in ~200ms and beats GPT-5.1 and Claude Sonnet 4.5 on routing accuracy. Powered by Rust, WASM, and purpose-built SLMs, it adds milliseconds, not seconds, to every request. 🌊

digitalocean's profile picture

DigitalOcean

221,342 subscribers

19,853 Aufrufe • vor 1 Monat •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨
0:28

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

DigitalOcean

590,330 Aufrufe • vor 1 Monat

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.
0:33

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.

DigitalOcean

20,992 Aufrufe • vor 1 Monat

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊
0:23

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊

DigitalOcean

10,297 Aufrufe • vor 4 Monaten

Today we're releasing Not Diamond… The world’s most powerful AI model router. Not Diamond maximizes LLM output quality by automatically recommending the best LLM on every request at lower cost and latency. And it takes <5m to set up. Watch this to see how to start using it:
1:10

Today we're releasing Not Diamond… The world’s most powerful AI model router. Not Diamond maximizes LLM output quality by automatically recommending the best LLM on every request at lower cost and latency. And it takes <5m to set up. Watch this to see how to start using it:

Tomas Hernando Kofman

75,821 Aufrufe • vor 1 Jahr

Among the fastest DeepSeek V3.2, MiniMax-M2.5, and Qwen 3.5 397B inference in the market, per Artificial Analysis benchmarks (April 2026). ⚡️🤖 Sub-1-second TTFT. 230 tokens per second. Co-designed every layer of the stack with Inferact, performance optimized vLLM, all on NVIDIA HGX B300. Live on DigitalOcean Serverless Inference now. Full breakdown in the comments. ⬇️
0:25

Among the fastest DeepSeek V3.2, MiniMax-M2.5, and Qwen 3.5 397B inference in the market, per Artificial Analysis benchmarks (April 2026). ⚡️🤖 Sub-1-second TTFT. 230 tokens per second. Co-designed every layer of the stack with Inferact, performance optimized vLLM, all on NVIDIA HGX B300. Live on DigitalOcean Serverless Inference now. Full breakdown in the comments. ⬇️

DigitalOcean

39,063 Aufrufe • vor 2 Monaten

Anthropic engineer: "Most people will use Sonnet 5 and Fable 5 wrong. You can set them up right in one afternoon and stop overpaying every single day." In 31 minutes he shows how to test every model against your real use case and stop overpaying for nothing. Watch the session, then read the guide below on the Claude features 99% of users never find.
31:12

Anthropic engineer: "Most people will use Sonnet 5 and Fable 5 wrong. You can set them up right in one afternoon and stop overpaying every single day." In 31 minutes he shows how to test every model against your real use case and stop overpaying for nothing. Watch the session, then read the guide below on the Claude features 99% of users never find.

Anatoli Kopadze

149,477 Aufrufe • vor 3 Tagen

Claude Sonnet 4.5 is now the default model for Augment Code. We’re rolling it out to all customers over the next 24 hours, where it will be available alongside Sonnet 4 (for a limited time) and GPT-5 in the model picker. Here’s how Sonnet 4.5 compares to Sonnet 4:
1:23

Claude Sonnet 4.5 is now the default model for Augment Code. We’re rolling it out to all customers over the next 24 hours, where it will be available alongside Sonnet 4 (for a limited time) and GPT-5 in the model picker. Here’s how Sonnet 4.5 compares to Sonnet 4:

Augment Code

29,182 Aufrufe • vor 9 Monaten

Every 5 minutes, Sakana Fugu's conductor splits trades between GPT-5.5, Claude Fable 5 and Gemini 3.5, and it beats every model it directs.
0:42

Every 5 minutes, Sakana Fugu's conductor splits trades between GPT-5.5, Claude Fable 5 and Gemini 3.5, and it beats every model it directs.

0xMarioNawfal

57,502 Aufrufe • vor 13 Tagen

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.
0:38

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.

DigitalOcean

799,912 Aufrufe • vor 20 Tagen

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).
0:23

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).

DigitalOcean

27,714 Aufrufe • vor 5 Monaten

Comparisons of Sonnet 4.5 vs GPT-5 Pro. I appreciate the comparison is not exactly fair, but I've had GPT-5 Pro videos ready to go, so forgive me. Saying that it does give a good benchmark, I don't think there was a single instance of Sonnet 4.5 being better, and I was testing it in Claude Code, so it should have had an advantage of not being stuck in the web client. It doesn't mean to say that Claude 4.5 would be worse on all dimensions, these are 1-shot single file HTML files, so not going to test the full agentic suite of capabilities. Song via Suno v5 Lyrics by Sonnet 4.5
0:49

Comparisons of Sonnet 4.5 vs GPT-5 Pro. I appreciate the comparison is not exactly fair, but I've had GPT-5 Pro videos ready to go, so forgive me. Saying that it does give a good benchmark, I don't think there was a single instance of Sonnet 4.5 being better, and I was testing it in Claude Code, so it should have had an advantage of not being stuck in the web client. It doesn't mean to say that Claude 4.5 would be worse on all dimensions, these are 1-shot single file HTML files, so not going to test the full agentic suite of capabilities. Song via Suno v5 Lyrics by Sonnet 4.5

Peter Gostev

255,936 Aufrufe • vor 9 Monaten

Stop prototyping, start deploying. ☁️🤖 Join us at #DOdeploy SF to master production #AI inference. Grounded in real-world costs &amp; reliability, we'll show you how to scale with DigitalOcean. 🌁
0:25

Stop prototyping, start deploying. ☁️🤖 Join us at #DOdeploy SF to master production #AI inference. Grounded in real-world costs &amp; reliability, we'll show you how to scale with DigitalOcean. 🌁

DigitalOcean

10,326 Aufrufe • vor 5 Monaten

This is the last chatbot you’ll ever need. Yesterday, Mckay Wrigley built an oss Not Diamond-powered chat app. We loved it. So today we’re releasing a hosted version. Get the best LLM on every message and hyper-personalize routing to your preferences with feedback. Watch how:
2:12

This is the last chatbot you’ll ever need. Yesterday, Mckay Wrigley built an oss Not Diamond-powered chat app. We loved it. So today we’re releasing a hosted version. Get the best LLM on every message and hyper-personalize routing to your preferences with feedback. Watch how:

Tomas Hernando Kofman

19,668 Aufrufe • vor 1 Jahr

Anthropic engineer: "Most people will use Sonnet 5 and Fable 5 wrong. You can set them up right in one afternoon and stop overpaying every single day." In 29 minutes, he breaks down every Claude model, and why running them all the same way is a mistake. Watch the session, then save the config below 👇
29:30

Anthropic engineer: "Most people will use Sonnet 5 and Fable 5 wrong. You can set them up right in one afternoon and stop overpaying every single day." In 29 minutes, he breaks down every Claude model, and why running them all the same way is a mistake. Watch the session, then save the config below 👇

darkzodchi

555,282 Aufrufe • vor 6 Tagen

Deterministic inference: getting the exact same output every time you run an LLM with identical inputs. Try it yourself: Powered by EigenAI
0:31

Deterministic inference: getting the exact same output every time you run an LLM with identical inputs. Try it yourself: Powered by EigenAI

nader dabit

29,335 Aufrufe • vor 8 Monaten

my new favorite coding workflow: gpt-4.5 for brainstorming and planning claude 3.7 sonnet for building windsurf for all the agentic stuff watch the video for a quick example
12:15

my new favorite coding workflow: gpt-4.5 for brainstorming and planning claude 3.7 sonnet for building windsurf for all the agentic stuff watch the video for a quick example

elvis

111,789 Aufrufe • vor 1 Jahr

Open-sourcing the first unified LLM routing library 🔥 Meet LLMRouter 16+ routers in ONE framework. Stop reimplementing routing papers from scratch, simply run pip install llmrouter-lib And instantly deploy SOTA LLM routing tailored to your exact needs! 🔗 Get Started with LLMRouter 🚀 Code: 🌐 Project Page: 💸 Why LLMRouter? Why pay GPT-5 prices for "What's the weather?" Smart routing = Significant Savings Simple query → Cheap model Complex query → Powerful model Save 30–50% on inference costs without sacrificing quality 🧭 The 16+ Router Arsenal Switch between state-of-the-art methods with a single flag change. We cover every paradigm: ✅ Single-Round: From classic ML (KNN, SVM) to neural approaches (Graph, Contrastive). ✅ Multi-Round: RL-powered reasoning that "thinks" before routing. ✅ Agentic: Breaks down complex tasks and routes step-by-step. ✅ Personalized: Learns from user history to fit unique needs. 🛠️ Complete "Out-of-the-Box" Toolchain We didn't just ship the code; we shipped the pipeline. ✅ Unified CLI: Train, infer, and chat with any router. ✅ Interactive UI: Full Gradio interface included. ✅ Benchmarks: 11 datasets ready to use + full data generation pipeline. From LLM routing research to production in minutes. 🚀
1:08

Open-sourcing the first unified LLM routing library 🔥 Meet LLMRouter 16+ routers in ONE framework. Stop reimplementing routing papers from scratch, simply run pip install llmrouter-lib And instantly deploy SOTA LLM routing tailored to your exact needs! 🔗 Get Started with LLMRouter 🚀 Code: 🌐 Project Page: 💸 Why LLMRouter? Why pay GPT-5 prices for "What's the weather?" Smart routing = Significant Savings Simple query → Cheap model Complex query → Powerful model Save 30–50% on inference costs without sacrificing quality 🧭 The 16+ Router Arsenal Switch between state-of-the-art methods with a single flag change. We cover every paradigm: ✅ Single-Round: From classic ML (KNN, SVM) to neural approaches (Graph, Contrastive). ✅ Multi-Round: RL-powered reasoning that "thinks" before routing. ✅ Agentic: Breaks down complex tasks and routes step-by-step. ✅ Personalized: Learns from user history to fit unique needs. 🛠️ Complete "Out-of-the-Box" Toolchain We didn't just ship the code; we shipped the pipeline. ✅ Unified CLI: Train, infer, and chat with any router. ✅ Interactive UI: Full Gradio interface included. ✅ Benchmarks: 11 datasets ready to use + full data generation pipeline. From LLM routing research to production in minutes. 🚀

Jiaxuan You

75,176 Aufrufe • vor 6 Monaten

Claude Sonnet 4.8 is imminent. Most likely dropping today. Sonnet 4.6 is starting to look outdated. Look at the Flappy Bird test on BridgeBench. GPT 5.5 and Claude Opus 4.7 have moved past it. The model that used to be the default for most vibe coders is falling behind. Anthropic needs Sonnet 4.8 to close the gap. The second it drops, we're running it through every BridgeBench test and posting the results live. New Sonnet day. Let's see what Anthropic has.
0:28

Claude Sonnet 4.8 is imminent. Most likely dropping today. Sonnet 4.6 is starting to look outdated. Look at the Flappy Bird test on BridgeBench. GPT 5.5 and Claude Opus 4.7 have moved past it. The model that used to be the default for most vibe coders is falling behind. Anthropic needs Sonnet 4.8 to close the gap. The second it drops, we're running it through every BridgeBench test and posting the results live. New Sonnet day. Let's see what Anthropic has.

Bridgebench

16,715 Aufrufe • vor 1 Monat

Someone built a free and better alternative to Claude that runs 100% locally. → works with any LLM (Claude, GPT, Gemini, vLLM) → beats it on deep research → has Cowork-like capabilities → 50+ connectors out of the box → deploy in literally one command 100% open source. MIT license. 28k stars.
1:00

Someone built a free and better alternative to Claude that runs 100% locally. → works with any LLM (Claude, GPT, Gemini, vLLM) → beats it on deep research → has Cowork-like capabilities → 50+ connectors out of the box → deploy in literally one command 100% open source. MIT license. 28k stars.

How To Prompt

39,043 Aufrufe • vor 2 Monaten