正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Stop overpaying for every LLM call. 💸 The DigitalOcean Inference Router resolves intent in ~200ms and beats GPT-5.1 and Claude Sonnet 4.5 on routing accuracy. Powered by Rust, WASM, and purpose-built SLMs, it adds milliseconds, not seconds, to every request. 🌊

DigitalOcean

221,342 subscribers

19,853 次观看 • 2 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

DigitalOcean

593,533 次观看 • 1 个月前

.Kimi.ai K3 from Moonshot AI is now live on DigitalOcean Inference Engine. 1M-token context, native vision, built to run agentic tasks for hours. Supported on Inference Router and model synthesis to maximize intelligence per dollar. No setup, no model ops.

.Kimi.ai K3 from Moonshot AI is now live on DigitalOcean Inference Engine. 1M-token context, native vision, built to run agentic tasks for hours. Supported on Inference Router and model synthesis to maximize intelligence per dollar. No setup, no model ops.

DigitalOcean

205,907 次观看 • 3 天前

DigitalOcean’s model synthesis tool is now available in public preview. 🆕 A new server-side tool: run multiple models on one inference request and get a single synthesized response, no custom orchestration. Just add it to your existing inference request.

DigitalOcean’s model synthesis tool is now available in public preview. 🆕 A new server-side tool: run multiple models on one inference request and get a single synthesized response, no custom orchestration. Just add it to your existing inference request.

DigitalOcean

2,030,708 次观看 • 7 天前

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.

DigitalOcean

20,992 次观看 • 2 个月前

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊

DigitalOcean

10,297 次观看 • 5 个月前

Today we're releasing Not Diamond… The world’s most powerful AI model router. Not Diamond maximizes LLM output quality by automatically recommending the best LLM on every request at lower cost and latency. And it takes <5m to set up. Watch this to see how to start using it:

Today we're releasing Not Diamond… The world’s most powerful AI model router. Not Diamond maximizes LLM output quality by automatically recommending the best LLM on every request at lower cost and latency. And it takes <5m to set up. Watch this to see how to start using it:

Tomas Hernando Kofman

75,821 次观看 • 2 年前

Anthropic engineer: "Most people will use Sonnet 5 and Fable 5 wrong. You can set them up right in one afternoon and stop overpaying every single day." In 31 minutes he shows how to test every model against your real use case and stop overpaying for nothing. Watch the session, then read the guide below on the Claude features 99% of users never find.

Anthropic engineer: "Most people will use Sonnet 5 and Fable 5 wrong. You can set them up right in one afternoon and stop overpaying every single day." In 31 minutes he shows how to test every model against your real use case and stop overpaying for nothing. Watch the session, then read the guide below on the Claude features 99% of users never find.

Anatoli Kopadze

153,825 次观看 • 26 天前

Among the fastest DeepSeek V3.2, MiniMax-M2.5, and Qwen 3.5 397B inference in the market, per Artificial Analysis benchmarks (April 2026). ⚡️🤖 Sub-1-second TTFT. 230 tokens per second. Co-designed every layer of the stack with Inferact, performance optimized vLLM, all on NVIDIA HGX B300. Live on DigitalOcean Serverless Inference now. Full breakdown in the comments. ⬇️

Among the fastest DeepSeek V3.2, MiniMax-M2.5, and Qwen 3.5 397B inference in the market, per Artificial Analysis benchmarks (April 2026). ⚡️🤖 Sub-1-second TTFT. 230 tokens per second. Co-designed every layer of the stack with Inferact, performance optimized vLLM, all on NVIDIA HGX B300. Live on DigitalOcean Serverless Inference now. Full breakdown in the comments. ⬇️

DigitalOcean

39,063 次观看 • 3 个月前

Claude Sonnet 4.5 is now the default model for Augment Code. We’re rolling it out to all customers over the next 24 hours, where it will be available alongside Sonnet 4 (for a limited time) and GPT-5 in the model picker. Here’s how Sonnet 4.5 compares to Sonnet 4:

Claude Sonnet 4.5 is now the default model for Augment Code. We’re rolling it out to all customers over the next 24 hours, where it will be available alongside Sonnet 4 (for a limited time) and GPT-5 in the model picker. Here’s how Sonnet 4.5 compares to Sonnet 4:

Augment Code

29,376 次观看 • 10 个月前

🚨 Announcing Smart Model Router - Create Your Own Custom Router To Route To Your Favorite LLM - Route to GPT Sol, Muse Spark, Grok 4.5 and Fable - Optimize for cost or performance - Use Fable only for hard coding Once you create a router, you can use it on our Chat, Agent or in an API! Coming on Monday - Support for all CLI clients including Code, Claude Code and others

🚨 Announcing Smart Model Router - Create Your Own Custom Router To Route To Your Favorite LLM - Route to GPT Sol, Muse Spark, Grok 4.5 and Fable - Optimize for cost or performance - Use Fable only for hard coding Once you create a router, you can use it on our Chat, Agent or in an API! Coming on Monday - Support for all CLI clients including Code, Claude Code and others

Bindu Reddy

2,571,559 次观看 • 20 天前

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.

DigitalOcean

807,645 次观看 • 1 个月前

Stop prototyping, start deploying. ☁️🤖 Join us at #DOdeploy SF to master production #AI inference. Grounded in real-world costs & reliability, we'll show you how to scale with DigitalOcean. 🌁

Stop prototyping, start deploying. ☁️🤖 Join us at #DOdeploy SF to master production #AI inference. Grounded in real-world costs & reliability, we'll show you how to scale with DigitalOcean. 🌁

DigitalOcean

10,326 次观看 • 5 个月前

Comparisons of Sonnet 4.5 vs GPT-5 Pro. I appreciate the comparison is not exactly fair, but I've had GPT-5 Pro videos ready to go, so forgive me. Saying that it does give a good benchmark, I don't think there was a single instance of Sonnet 4.5 being better, and I was testing it in Claude Code, so it should have had an advantage of not being stuck in the web client. It doesn't mean to say that Claude 4.5 would be worse on all dimensions, these are 1-shot single file HTML files, so not going to test the full agentic suite of capabilities. Song via Suno v5 Lyrics by Sonnet 4.5

Comparisons of Sonnet 4.5 vs GPT-5 Pro. I appreciate the comparison is not exactly fair, but I've had GPT-5 Pro videos ready to go, so forgive me. Saying that it does give a good benchmark, I don't think there was a single instance of Sonnet 4.5 being better, and I was testing it in Claude Code, so it should have had an advantage of not being stuck in the web client. It doesn't mean to say that Claude 4.5 would be worse on all dimensions, these are 1-shot single file HTML files, so not going to test the full agentic suite of capabilities. Song via Suno v5 Lyrics by Sonnet 4.5

Peter Gostev

255,936 次观看 • 10 个月前

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).

DigitalOcean

27,726 次观看 • 6 个月前

This is the last chatbot you’ll ever need. Yesterday, Mckay Wrigley built an oss Not Diamond-powered chat app. We loved it. So today we’re releasing a hosted version. Get the best LLM on every message and hyper-personalize routing to your preferences with feedback. Watch how:

This is the last chatbot you’ll ever need. Yesterday, Mckay Wrigley built an oss Not Diamond-powered chat app. We loved it. So today we’re releasing a hosted version. Get the best LLM on every message and hyper-personalize routing to your preferences with feedback. Watch how:

Tomas Hernando Kofman

19,668 次观看 • 2 年前

.RadixArk brought DeepSeek V4 to production with DigitalOcean and AMD. AMD Instinct™ MI350X GPU Droplets, plus joint engineering that drove a ~10x throughput gain. When the team that builds the inference engine picks your stack, that's the signal.

.RadixArk brought DeepSeek V4 to production with DigitalOcean and AMD. AMD Instinct™ MI350X GPU Droplets, plus joint engineering that drove a ~10x throughput gain. When the team that builds the inference engine picks your stack, that's the signal.

DigitalOcean

13,381 次观看 • 16 天前

Claude Sonnet 4.8 is imminent. Most likely dropping today. Sonnet 4.6 is starting to look outdated. Look at the Flappy Bird test on BridgeBench. GPT 5.5 and Claude Opus 4.7 have moved past it. The model that used to be the default for most vibe coders is falling behind. Anthropic needs Sonnet 4.8 to close the gap. The second it drops, we're running it through every BridgeBench test and posting the results live. New Sonnet day. Let's see what Anthropic has.

Claude Sonnet 4.8 is imminent. Most likely dropping today. Sonnet 4.6 is starting to look outdated. Look at the Flappy Bird test on BridgeBench. GPT 5.5 and Claude Opus 4.7 have moved past it. The model that used to be the default for most vibe coders is falling behind. Anthropic needs Sonnet 4.8 to close the gap. The second it drops, we're running it through every BridgeBench test and posting the results live. New Sonnet day. Let's see what Anthropic has.

Bridgebench

16,715 次观看 • 2 个月前

Open-sourcing the first unified LLM routing library 🔥 Meet LLMRouter 16+ routers in ONE framework. Stop reimplementing routing papers from scratch, simply run pip install llmrouter-lib And instantly deploy SOTA LLM routing tailored to your exact needs! 🔗 Get Started with LLMRouter 🚀 Code: 🌐 Project Page: 💸 Why LLMRouter? Why pay GPT-5 prices for "What's the weather?" Smart routing = Significant Savings Simple query → Cheap model Complex query → Powerful model Save 30–50% on inference costs without sacrificing quality 🧭 The 16+ Router Arsenal Switch between state-of-the-art methods with a single flag change. We cover every paradigm: ✅ Single-Round: From classic ML (KNN, SVM) to neural approaches (Graph, Contrastive). ✅ Multi-Round: RL-powered reasoning that "thinks" before routing. ✅ Agentic: Breaks down complex tasks and routes step-by-step. ✅ Personalized: Learns from user history to fit unique needs. 🛠️ Complete "Out-of-the-Box" Toolchain We didn't just ship the code; we shipped the pipeline. ✅ Unified CLI: Train, infer, and chat with any router. ✅ Interactive UI: Full Gradio interface included. ✅ Benchmarks: 11 datasets ready to use + full data generation pipeline. From LLM routing research to production in minutes. 🚀

Open-sourcing the first unified LLM routing library 🔥 Meet LLMRouter 16+ routers in ONE framework. Stop reimplementing routing papers from scratch, simply run pip install llmrouter-lib And instantly deploy SOTA LLM routing tailored to your exact needs! 🔗 Get Started with LLMRouter 🚀 Code: 🌐 Project Page: 💸 Why LLMRouter? Why pay GPT-5 prices for "What's the weather?" Smart routing = Significant Savings Simple query → Cheap model Complex query → Powerful model Save 30–50% on inference costs without sacrificing quality 🧭 The 16+ Router Arsenal Switch between state-of-the-art methods with a single flag change. We cover every paradigm: ✅ Single-Round: From classic ML (KNN, SVM) to neural approaches (Graph, Contrastive). ✅ Multi-Round: RL-powered reasoning that "thinks" before routing. ✅ Agentic: Breaks down complex tasks and routes step-by-step. ✅ Personalized: Learns from user history to fit unique needs. 🛠️ Complete "Out-of-the-Box" Toolchain We didn't just ship the code; we shipped the pipeline. ✅ Unified CLI: Train, infer, and chat with any router. ✅ Interactive UI: Full Gradio interface included. ✅ Benchmarks: 11 datasets ready to use + full data generation pipeline. From LLM routing research to production in minutes. 🚀

Jiaxuan You

75,244 次观看 • 7 个月前

Someone built a free and better alternative to Claude that runs 100% locally. → works with any LLM (Claude, GPT, Gemini, vLLM) → beats it on deep research → has Cowork-like capabilities → 50+ connectors out of the box → deploy in literally one command 100% open source. MIT license. 28k stars.

Someone built a free and better alternative to Claude that runs 100% locally. → works with any LLM (Claude, GPT, Gemini, vLLM) → beats it on deep research → has Cowork-like capabilities → 50+ connectors out of the box → deploy in literally one command 100% open source. MIT license. 28k stars.

How To Prompt

39,303 次观看 • 2 个月前

We just built the #1 tool every AI team wants. Introducing Merge Gateway: LLM routing, fallback, cost guardrails, and security, all in one place. Everyone gets $10 free LLM usage on us to try it out. RT+ comment “Gateway” → we’ll double your credits.

We just built the #1 tool every AI team wants. Introducing Merge Gateway: LLM routing, fallback, cost guardrails, and security, all in one place. Everyone gets $10 free LLM usage on us to try it out. RT+ comment “Gateway” → we’ll double your credits.

Shensi Ding

93,900 次观看 • 4 个月前