正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

DigitalOcean

221,802 subscribers

589,389 次观看 • 23 天前 •via X (Twitter)

科学技术财经

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.

DigitalOcean

20,992 次观看 • 1 个月前

Stop overpaying for every LLM call. 💸 The DigitalOcean Inference Router resolves intent in ~200ms and beats GPT-5.1 and Claude Sonnet 4.5 on routing accuracy. Powered by Rust, WASM, and purpose-built SLMs, it adds milliseconds, not seconds, to every request. 🌊

Stop overpaying for every LLM call. 💸 The DigitalOcean Inference Router resolves intent in ~200ms and beats GPT-5.1 and Claude Sonnet 4.5 on routing accuracy. Powered by Rust, WASM, and purpose-built SLMs, it adds milliseconds, not seconds, to every request. 🌊

DigitalOcean

19,853 次观看 • 1 个月前

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).

DigitalOcean

27,714 次观看 • 5 个月前

Among the fastest DeepSeek V3.2, MiniMax-M2.5, and Qwen 3.5 397B inference in the market, per Artificial Analysis benchmarks (April 2026). ⚡️🤖 Sub-1-second TTFT. 230 tokens per second. Co-designed every layer of the stack with Inferact, performance optimized vLLM, all on NVIDIA HGX B300. Live on DigitalOcean Serverless Inference now. Full breakdown in the comments. ⬇️

Among the fastest DeepSeek V3.2, MiniMax-M2.5, and Qwen 3.5 397B inference in the market, per Artificial Analysis benchmarks (April 2026). ⚡️🤖 Sub-1-second TTFT. 230 tokens per second. Co-designed every layer of the stack with Inferact, performance optimized vLLM, all on NVIDIA HGX B300. Live on DigitalOcean Serverless Inference now. Full breakdown in the comments. ⬇️

DigitalOcean

39,063 次观看 • 1 个月前

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.

DigitalOcean

544,020 次观看 • 11 天前

.AMD Instinct™ MI350X GPU Droplets are live on DigitalOcean's Agentic Inference Cloud. 🆕 Lower latency. Higher throughput. ✅ Transparent pricing and production-ready scale. ✅ AI without the infrastructure headache. 💯

.AMD Instinct™ MI350X GPU Droplets are live on DigitalOcean's Agentic Inference Cloud. 🆕 Lower latency. Higher throughput. ✅ Transparent pricing and production-ready scale. ✅ AI without the infrastructure headache. 💯

DigitalOcean

25,539 次观看 • 4 个月前

Today we're releasing Not Diamond… The world’s most powerful AI model router. Not Diamond maximizes LLM output quality by automatically recommending the best LLM on every request at lower cost and latency. And it takes <5m to set up. Watch this to see how to start using it:

Today we're releasing Not Diamond… The world’s most powerful AI model router. Not Diamond maximizes LLM output quality by automatically recommending the best LLM on every request at lower cost and latency. And it takes <5m to set up. Watch this to see how to start using it:

Tomas Hernando Kofman

75,806 次观看 • 1 年前

From POC to production inference. 🤖🌁 Join us at #DOdeploy in San Francisco where we'll discuss inference-first architectures, predictable inference economics, operational simplicity at scale, & more.

From POC to production inference. 🤖🌁 Join us at #DOdeploy in San Francisco where we'll discuss inference-first architectures, predictable inference economics, operational simplicity at scale, & more.

DigitalOcean

12,195 次观看 • 4 个月前

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊

DigitalOcean

10,297 次观看 • 4 个月前

Stop prototyping, start deploying. ☁️🤖 Join us at #DOdeploy SF to master production #AI inference. Grounded in real-world costs & reliability, we'll show you how to scale with DigitalOcean. 🌁

Stop prototyping, start deploying. ☁️🤖 Join us at #DOdeploy SF to master production #AI inference. Grounded in real-world costs & reliability, we'll show you how to scale with DigitalOcean. 🌁

DigitalOcean

10,326 次观看 • 4 个月前

Crusoe Managed Inference is now available. Run model inference faster, easier, and more cost-effectively. Large-context AI solutions demand fast outputs, massive throughput, and resilient scaling. Crusoe Managed Inference delivers breakthrough speed & reduced input-token spend.

Crusoe Managed Inference is now available. Run model inference faster, easier, and more cost-effectively. Large-context AI solutions demand fast outputs, massive throughput, and resilient scaling. Crusoe Managed Inference delivers breakthrough speed & reduced input-token spend.

Crusoe

12,096,815 次观看 • 7 个月前

Releasing moondream-zig! It is a fast, implementation of moondream2 inference on the CPU written from-scratch in Zig :) moondream-zig provides 1.5-2x faster inference compared to huggingface on the same device. moondream vik

Releasing moondream-zig! It is a fast, implementation of moondream2 inference on the CPU written from-scratch in Zig :) moondream-zig provides 1.5-2x faster inference compared to huggingface on the same device. moondream vik

snow

29,245 次观看 • 1 年前

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 次观看 • 3 个月前

Multi-LoRA is in private preview on Cerebras Inference. Deploy one base model alongside a library of LoRA adapters. Switch between them per request, with no reloading, no separate deployments, and no latency cost. Available now for dedicated endpoint users. Reach out to your account rep to get access.

Multi-LoRA is in private preview on Cerebras Inference. Deploy one base model alongside a library of LoRA adapters. Switch between them per request, with no reloading, no separate deployments, and no latency cost. Available now for dedicated endpoint users. Reach out to your account rep to get access.

Cerebras

21,168 次观看 • 1 个月前

Free, instant access to 1M inference tok/day is now waitlist-free! Building the new onboarding flow and removing our waitlist were so fun to ship & all API signups automatically get > Free 1,000,000 toks/day > SOTA models on the world's fastest inference provider

Free, instant access to 1M inference tok/day is now waitlist-free! Building the new onboarding flow and removing our waitlist were so fun to ship & all API signups automatically get > Free 1,000,000 toks/day > SOTA models on the world's fastest inference provider

Sarah Chieng

120,480 次观看 • 1 年前

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

NVIDIA

81,795 次观看 • 2 个月前

Introducing the Morph Model Router. It chooses the best model for each task in under 50ms. Keep frontier performance while lowering latency and cost. Available today in our API

Introducing the Morph Model Router. It chooses the best model for each task in under 50ms. Keep frontier performance while lowering latency and cost. Available today in our API

Morph

19,160 次观看 • 25 天前

Stop hardcoding one model name in your code. Now you can give each request a policy: a small rule for what the call needs It picks the right model for the job, on your own keys This is unhardcoded, our new open source routing for AI models, live today

Stop hardcoding one model name in your code. Now you can give each request a policy: a small rule for what the call needs It picks the right model for the job, on your own keys This is unhardcoded, our new open source routing for AI models, live today

GenLayer

36,056 次观看 • 6 天前

Our first open-source release. YOLO26-MLX, native YOLO26 on Apple Silicon. No PyTorch. No external GPU. Up to 2.6x faster inference. Up to 1.7x faster training. Accuracy within 0.2% of official results. It won't be the last.

Our first open-source release. YOLO26-MLX, native YOLO26 on Apple Silicon. No PyTorch. No external GPU. Up to 2.6x faster inference. Up to 1.7x faster training. Accuracy within 0.2% of official results. It won't be the last.

webAI

96,990 次观看 • 2 个月前

OpenAI's Noam Brown says that while AI model performance scales roughly equivalently with more training or inference compute, the cost of inference is on the order of 100 billion times cheaper

OpenAI's Noam Brown says that while AI model performance scales roughly equivalently with more training or inference compute, the cost of inference is on the order of 100 billion times cheaper

Tsarathustra

250,828 次观看 • 1 年前