Загрузка видео...

Не удалось загрузить видео

На главную

DigitalOcean’s model synthesis tool is now available in public preview. 🆕 A new server-side tool: run multiple models on one inference request and get a single synthesized response, no custom orchestration. Just add it to your existing inference request.

digitalocean's profile picture

DigitalOcean

222,046 subscribers

2,030,708 просмотров • 7 дней назад •via X (Twitter)

Наука и технологииОбразование
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨
0:28

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

DigitalOcean

593,533 просмотров • 1 месяц назад

.Kimi.ai K3 from Moonshot AI is now live on DigitalOcean Inference Engine. 1M-token context, native vision, built to run agentic tasks for hours. Supported on Inference Router and model synthesis to maximize intelligence per dollar. No setup, no model ops.
0:36

.Kimi.ai K3 from Moonshot AI is now live on DigitalOcean Inference Engine. 1M-token context, native vision, built to run agentic tasks for hours. Supported on Inference Router and model synthesis to maximize intelligence per dollar. No setup, no model ops.

DigitalOcean

205,907 просмотров • 3 дней назад

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.
0:33

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.

DigitalOcean

20,992 просмотров • 2 месяцев назад

Multi-LoRA is in private preview on Cerebras Inference. Deploy one base model alongside a library of LoRA adapters. Switch between them per request, with no reloading, no separate deployments, and no latency cost. Available now for dedicated endpoint users. Reach out to your account rep to get access.
1:15

Multi-LoRA is in private preview on Cerebras Inference. Deploy one base model alongside a library of LoRA adapters. Switch between them per request, with no reloading, no separate deployments, and no latency cost. Available now for dedicated endpoint users. Reach out to your account rep to get access.

Cerebras

21,168 просмотров • 2 месяцев назад

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.
0:38

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.

DigitalOcean

807,645 просмотров • 1 месяц назад

Your Mac is about to run inference like a datacenter. Coming soon to MLX-Swift: Continuous batching: the fastest way to handle multiple inference streams locally. It starts with regular inference and seamlessly upgrades to batched mode when new requests arrive. The best of both worlds. Based on the work of and Awni Hannun
0:25

Your Mac is about to run inference like a datacenter. Coming soon to MLX-Swift: Continuous batching: the fastest way to handle multiple inference streams locally. It starts with regular inference and seamlessly upgrades to batched mode when new requests arrive. The best of both worlds. Based on the work of and Awni Hannun

Ronald Mannak

60,570 просмотров • 8 месяцев назад

A glimpse into one of our core features 👀 Chat, Search, Compare, & Run #Inference for all AI models on ONE Platform: No more complicated setups, just seamless #AI magic. 💫 Be the first to experience - join waitlist now: #Inferium #AI #Inference
0:43

A glimpse into one of our core features 👀 Chat, Search, Compare, & Run #Inference for all AI models on ONE Platform: No more complicated setups, just seamless #AI magic. 💫 Be the first to experience - join waitlist now: #Inferium #AI #Inference

Inferium

1,079,229 просмотров • 2 лет назад

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).
0:23

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).

DigitalOcean

27,726 просмотров • 6 месяцев назад

IN NEWS: Baseten raises a $150M series D round. Tuhin Srivastava (Founder & CEO, Baseten) on the future of inference: “I think the token price goes down and inference should get cheaper over time. And that really just means there is going to be more inference.” “Every time we lower prices or optimize models to make it cheaper, four months later customers are spending more anyway.” “Inference prices will go down, but if the world is run by AI in 10 years, there is going to be a lot of inference. It better be cheap.”
0:52

IN NEWS: Baseten raises a $150M series D round. Tuhin Srivastava (Founder & CEO, Baseten) on the future of inference: “I think the token price goes down and inference should get cheaper over time. And that really just means there is going to be more inference.” “Every time we lower prices or optimize models to make it cheaper, four months later customers are spending more anyway.” “Inference prices will go down, but if the world is run by AI in 10 years, there is going to be a lot of inference. It better be cheap.”

TBPN

17,057 просмотров • 10 месяцев назад

today we're releasing a new small model (0.5B) for detecting problems with tool usage in agents, trained on 50M tokens from publicly available MCP server tools it's great at picking up on tool accuracy issues and outperforms larger models
0:46

today we're releasing a new small model (0.5B) for detecting problems with tool usage in agents, trained on 50M tokens from publicly available MCP server tools it's great at picking up on tool accuracy issues and outperforms larger models

Freddie Vargus

96,781 просмотров • 1 год назад

Stop overpaying for every LLM call. 💸 The DigitalOcean Inference Router resolves intent in ~200ms and beats GPT-5.1 and Claude Sonnet 4.5 on routing accuracy. Powered by Rust, WASM, and purpose-built SLMs, it adds milliseconds, not seconds, to every request. 🌊
0:40

Stop overpaying for every LLM call. 💸 The DigitalOcean Inference Router resolves intent in ~200ms and beats GPT-5.1 and Claude Sonnet 4.5 on routing accuracy. Powered by Rust, WASM, and purpose-built SLMs, it adds milliseconds, not seconds, to every request. 🌊

DigitalOcean

19,853 просмотров • 2 месяцев назад

Tired of guessing which AI model is best? 🤔 We've got you covered! 👀 Here's a sneak peek of our new model comparison feature in action! Run the same prompt across multiple models and see which one works best for YOU. Which models are you excited to test? #Inferium #AI #Inference #Compare
0:34

Tired of guessing which AI model is best? 🤔 We've got you covered! 👀 Here's a sneak peek of our new model comparison feature in action! Run the same prompt across multiple models and see which one works best for YOU. Which models are you excited to test? #Inferium #AI #Inference #Compare

Inferium

12,332 просмотров • 1 год назад

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊
0:23

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊

DigitalOcean

10,297 просмотров • 5 месяцев назад

Nous Research just dropped MOA (Mixture of Agents) presets inside Hermes Agent. I made a quick video showing how to set it up and create your own MOA. The idea: mix multiple models to get capabilities beyond any single model you can use right now. How it works: Normally Hermes sends your conversation + tools to one model. With MOA you get several reference models plus one aggregator. The references read the conversation and offer thoughts and suggestions, but they get no tool access and never reply to you directly. The aggregator is the one that actually acts. It sees the normal conversation plus the private advice from the references, then makes the tool calls and writes the final response. From Hermes's side, the aggregator's output IS the model's response, so you can use /goal or anything else like that. Cool idea, curious to see how it really performs!
4:40

Nous Research just dropped MOA (Mixture of Agents) presets inside Hermes Agent. I made a quick video showing how to set it up and create your own MOA. The idea: mix multiple models to get capabilities beyond any single model you can use right now. How it works: Normally Hermes sends your conversation + tools to one model. With MOA you get several reference models plus one aggregator. The references read the conversation and offer thoughts and suggestions, but they get no tool access and never reply to you directly. The aggregator is the one that actually acts. It sees the normal conversation plus the private advice from the references, then makes the tool calls and writes the final response. From Hermes's side, the aggregator's output IS the model's response, so you can use /goal or anything else like that. Cool idea, curious to see how it really performs!

tonbi

147,521 просмотров • 1 месяц назад

Codex Monitor now fully supports the Codex collab feature; it can spawn any number of new agents at your request. Here is a demo! Orchestration is just a prompt and a bit of UI now!
0:22

Codex Monitor now fully supports the Codex collab feature; it can spawn any number of new agents at your request. Here is a demo! Orchestration is just a prompt and a bit of UI now!

Thomas Ricouard

26,788 просмотров • 6 месяцев назад

The funny Goo physics add-on is now available for anyone to grab. All of my side projects were basically carried by this one tool, I can safely say that its really strong once you get used to it. Give it a try.
0:45

The funny Goo physics add-on is now available for anyone to grab. All of my side projects were basically carried by this one tool, I can safely say that its really strong once you get used to it. Give it a try.

Terrible Joe

350,863 просмотров • 3 месяцев назад

Introducing Parallel Chat 💬 New models keep dropping and comparing them is still a pain. So I built an app with Glaze: Send one prompt, run it across multiple models in parallel, and compare output side by side. Add an OpenRouter key and try it 👉
0:40

Introducing Parallel Chat 💬 New models keep dropping and comparing them is still a pain. So I built an app with Glaze: Send one prompt, run it across multiple models in parallel, and compare output side by side. Add an OpenRouter key and try it 👉

Thomas Paul Mann

12,696 просмотров • 21 дней назад

On-device inference is not limited to one model at a time, but orchestration is critical! Here is a concurrency load test for running 4 leading models in real-time totalling 3 billion parameters on Apple Neural Engine: - Qwen3-TTS (1.7b) - Parakeet v2 (0.6b) - Canary v2 (0.6b) - Sortformer (0.1b)
0:32

On-device inference is not limited to one model at a time, but orchestration is critical! Here is a concurrency load test for running 4 leading models in real-time totalling 3 billion parameters on Apple Neural Engine: - Qwen3-TTS (1.7b) - Parakeet v2 (0.6b) - Canary v2 (0.6b) - Sortformer (0.1b)

Atila

12,523 просмотров • 5 месяцев назад

From POC to production inference. 🤖🌁 Join us at #DOdeploy in San Francisco where we'll discuss inference-first architectures, predictable inference economics, operational simplicity at scale, & more.
0:26

From POC to production inference. 🤖🌁 Join us at #DOdeploy in San Francisco where we'll discuss inference-first architectures, predictable inference economics, operational simplicity at scale, & more.

DigitalOcean

12,195 просмотров • 5 месяцев назад

Skiff is a new, small tool for deploying static marketing sites using Kamal. Built on #NoBuild ideas, stone-age tools like Server Side Includes, and running with nginx. We use it to run and already. Enjoy!
12:11

Skiff is a new, small tool for deploying static marketing sites using Kamal. Built on #NoBuild ideas, stone-age tools like Server Side Includes, and running with nginx. We use it to run and already. Enjoy!

DHH

130,424 просмотров • 2 лет назад