Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

DigitalOcean’s model synthesis tool is now available in public preview. 🆕 A new server-side tool: run multiple models on one inference request and get a single synthesized response, no custom orchestration. Just add it to your existing inference request.

DigitalOcean

222,219 subscribers

2,192,210 views • 1 month ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

DigitalOcean

594,950 views • 3 months ago

.Kimi.ai K3 from Moonshot AI is now live on DigitalOcean Inference Engine. 1M-token context, native vision, built to run agentic tasks for hours. Supported on Inference Router and model synthesis to maximize intelligence per dollar. No setup, no model ops.

.Kimi.ai K3 from Moonshot AI is now live on DigitalOcean Inference Engine. 1M-token context, native vision, built to run agentic tasks for hours. Supported on Inference Router and model synthesis to maximize intelligence per dollar. No setup, no model ops.

DigitalOcean

665,105 views • 1 month ago

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.

DigitalOcean

20,992 views • 3 months ago

Multi-LoRA is in private preview on Cerebras Inference. Deploy one base model alongside a library of LoRA adapters. Switch between them per request, with no reloading, no separate deployments, and no latency cost. Available now for dedicated endpoint users. Reach out to your account rep to get access.

Multi-LoRA is in private preview on Cerebras Inference. Deploy one base model alongside a library of LoRA adapters. Switch between them per request, with no reloading, no separate deployments, and no latency cost. Available now for dedicated endpoint users. Reach out to your account rep to get access.

Cerebras

21,168 views • 3 months ago

DigitalOcean Inference Router is now cache-aware. 🔀 Before, switching models mid-conversation meant losing your cache, and the savings and consistency it bought you. Now, Inference Router weighs that cost before switching. Set a model affinity header or routing budget for full control.

DigitalOcean Inference Router is now cache-aware. 🔀 Before, switching models mid-conversation meant losing your cache, and the savings and consistency it bought you. Now, Inference Router weighs that cost before switching. Set a model affinity header or routing budget for full control.

DigitalOcean

318,366 views • 24 days ago

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.

DigitalOcean

807,645 views • 2 months ago

New stateful server tool: Shell! Any model on OpenRouter can now run commands in a hosted Linux container and use the new Files API to move files in and out. Available today in beta: `openrouter:shell`

New stateful server tool: Shell! Any model on OpenRouter can now run commands in a hosted Linux container and use the new Files API to move files in and out. Available today in beta: `openrouter:shell`

OpenRouter

21,279 views • 3 days ago

. M2 uses "interleaved thinking" - instead of one thinking block at the start, you get multiple thinking blocks throughout a single request. The model re-evaluates its approach as it goes, adapting based on tool outputs and new information. You'll see these thinking blocks appear in the UI showing its reasoning process in real-time. Available free in Cline until November 7!

. M2 uses "interleaved thinking" - instead of one thinking block at the start, you get multiple thinking blocks throughout a single request. The model re-evaluates its approach as it goes, adapting based on tool outputs and new information. You'll see these thinking blocks appear in the UI showing its reasoning process in real-time. Available free in Cline until November 7!

Cline

53,426 views • 10 months ago

Your Mac is about to run inference like a datacenter. Coming soon to MLX-Swift: Continuous batching: the fastest way to handle multiple inference streams locally. It starts with regular inference and seamlessly upgrades to batched mode when new requests arrive. The best of both worlds. Based on the work of and Awni Hannun

Your Mac is about to run inference like a datacenter. Coming soon to MLX-Swift: Continuous batching: the fastest way to handle multiple inference streams locally. It starts with regular inference and seamlessly upgrades to batched mode when new requests arrive. The best of both worlds. Based on the work of and Awni Hannun

Ronald Mannak

60,570 views • 10 months ago

A glimpse into one of our core features 👀 Chat, Search, Compare, & Run #Inference for all AI models on ONE Platform: No more complicated setups, just seamless #AI magic. 💫 Be the first to experience - join waitlist now: #Inferium #AI #Inference

A glimpse into one of our core features 👀 Chat, Search, Compare, & Run #Inference for all AI models on ONE Platform: No more complicated setups, just seamless #AI magic. 💫 Be the first to experience - join waitlist now: #Inferium #AI #Inference

Inferium

1,079,402 views • 2 years ago

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).

DigitalOcean

27,726 views • 8 months ago

Model Council is now available inside Computer. Run independent analysis across multiple frontier models, choose your analysis depth, and get a single cited report on where models agree, where they disagree, and what each found that others missed.

Model Council is now available inside Computer. Run independent analysis across multiple frontier models, choose your analysis depth, and get a single cited report on where models agree, where they disagree, and what each found that others missed.

Perplexity

86,840 views • 1 month ago

today we're releasing a new small model (0.5B) for detecting problems with tool usage in agents, trained on 50M tokens from publicly available MCP server tools it's great at picking up on tool accuracy issues and outperforms larger models

today we're releasing a new small model (0.5B) for detecting problems with tool usage in agents, trained on 50M tokens from publicly available MCP server tools it's great at picking up on tool accuracy issues and outperforms larger models

Freddie Vargus

96,781 views • 1 year ago

Stop overpaying for every LLM call. 💸 The DigitalOcean Inference Router resolves intent in ~200ms and beats GPT-5.1 and Claude Sonnet 4.5 on routing accuracy. Powered by Rust, WASM, and purpose-built SLMs, it adds milliseconds, not seconds, to every request. 🌊

Stop overpaying for every LLM call. 💸 The DigitalOcean Inference Router resolves intent in ~200ms and beats GPT-5.1 and Claude Sonnet 4.5 on routing accuracy. Powered by Rust, WASM, and purpose-built SLMs, it adds milliseconds, not seconds, to every request. 🌊

DigitalOcean

19,853 views • 3 months ago

Tired of guessing which AI model is best? 🤔 We've got you covered! 👀 Here's a sneak peek of our new model comparison feature in action! Run the same prompt across multiple models and see which one works best for YOU. Which models are you excited to test? #Inferium #AI #Inference #Compare

Tired of guessing which AI model is best? 🤔 We've got you covered! 👀 Here's a sneak peek of our new model comparison feature in action! Run the same prompt across multiple models and see which one works best for YOU. Which models are you excited to test? #Inferium #AI #Inference #Compare

Inferium

12,352 views • 1 year ago

New on DigitalOcean's Inference Engine: GLM-5.3-Flash from Z.ai. Agentic coding that rivals top-tier models, now natively multimodal for browser and computer use. 1M token context, MoE architecture, one endpoint swap to try it. Senior Developer Advocate Ryan O'Connor breaks it down, and Z.ai for Startups is there to help AI startups build faster with GLM models. 👇

New on DigitalOcean's Inference Engine: GLM-5.3-Flash from Z.ai. Agentic coding that rivals top-tier models, now natively multimodal for browser and computer use. 1M token context, MoE architecture, one endpoint swap to try it. Senior Developer Advocate Ryan O'Connor breaks it down, and Z.ai for Startups is there to help AI startups build faster with GLM models. 👇

DigitalOcean

140,583 views • 13 days ago

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊

DigitalOcean

10,297 views • 7 months ago

Nous Research just dropped MOA (Mixture of Agents) presets inside Hermes Agent. I made a quick video showing how to set it up and create your own MOA. The idea: mix multiple models to get capabilities beyond any single model you can use right now. How it works: Normally Hermes sends your conversation + tools to one model. With MOA you get several reference models plus one aggregator. The references read the conversation and offer thoughts and suggestions, but they get no tool access and never reply to you directly. The aggregator is the one that actually acts. It sees the normal conversation plus the private advice from the references, then makes the tool calls and writes the final response. From Hermes's side, the aggregator's output IS the model's response, so you can use /goal or anything else like that. Cool idea, curious to see how it really performs!

Nous Research just dropped MOA (Mixture of Agents) presets inside Hermes Agent. I made a quick video showing how to set it up and create your own MOA. The idea: mix multiple models to get capabilities beyond any single model you can use right now. How it works: Normally Hermes sends your conversation + tools to one model. With MOA you get several reference models plus one aggregator. The references read the conversation and offer thoughts and suggestions, but they get no tool access and never reply to you directly. The aggregator is the one that actually acts. It sees the normal conversation plus the private advice from the references, then makes the tool calls and writes the final response. From Hermes's side, the aggregator's output IS the model's response, so you can use /goal or anything else like that. Cool idea, curious to see how it really performs!

tonbi

148,312 views • 2 months ago

Codex Monitor now fully supports the Codex collab feature; it can spawn any number of new agents at your request. Here is a demo! Orchestration is just a prompt and a bit of UI now!

Codex Monitor now fully supports the Codex collab feature; it can spawn any number of new agents at your request. Here is a demo! Orchestration is just a prompt and a bit of UI now!

Thomas Ricouard

26,788 views • 7 months ago