Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

From POC to production inference. 🤖🌁 Join us at #DOdeploy in San Francisco where we'll discuss inference-first architectures, predictable inference economics, operational simplicity at scale, & more.

DigitalOcean

221,293 subscribers

12,195 views • 4 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Stop prototyping, start deploying. ☁️🤖 Join us at #DOdeploy SF to master production #AI inference. Grounded in real-world costs & reliability, we'll show you how to scale with DigitalOcean. 🌁

Stop prototyping, start deploying. ☁️🤖 Join us at #DOdeploy SF to master production #AI inference. Grounded in real-world costs & reliability, we'll show you how to scale with DigitalOcean. 🌁

DigitalOcean

10,326 views • 5 months ago

Most AI projects don't fail because models aren't good enough. They fail because inference economics don't scale. During #CXOSpice, Roman Chernin Nebius broke it down: ✅Closed models kill margins ✅Open models unlock control, if you can run them well ✅DataData only becomes a moat when inference is sustainable One team cut inference costs 26× in production. Only 30% of orgs use AI at scale, mostly in 1% of workloads. We're just getting started. Full conversation: #AI #Inference #TechInnovation Learn more about Nebius Token Factory:

Most AI projects don't fail because models aren't good enough. They fail because inference economics don't scale. During #CXOSpice, Roman Chernin Nebius broke it down: ✅Closed models kill margins ✅Open models unlock control, if you can run them well ✅DataData only becomes a moat when inference is sustainable One team cut inference costs 26× in production. Only 30% of orgs use AI at scale, mostly in 1% of workloads. We're just getting started. Full conversation: #AI #Inference #TechInnovation Learn more about Nebius Token Factory:

Helen Yu

13,662 views • 5 months ago

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.

.Grok Build is on DigitalOcean Marketplace. 🆕☁️🤖 SSH in. Run grok. Build. @xAI's coding agent, pre-configured on DigitalOcean Serverless Inference.

DigitalOcean

805,831 views • 28 days ago

.AMD Instinct™ MI350X GPU Droplets are live on DigitalOcean's Agentic Inference Cloud. 🆕 Lower latency. Higher throughput. ✅ Transparent pricing and production-ready scale. ✅ AI without the infrastructure headache. 💯

.AMD Instinct™ MI350X GPU Droplets are live on DigitalOcean's Agentic Inference Cloud. 🆕 Lower latency. Higher throughput. ✅ Transparent pricing and production-ready scale. ✅ AI without the infrastructure headache. 💯

DigitalOcean

25,539 views • 4 months ago

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

NVIDIA

81,834 views • 3 months ago

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 views • 3 months ago

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

DigitalOcean

591,367 views • 1 month ago

The first-ever hydrogen-powered NVIDIA GB300 NVL72 systems are online. Training & inference at scale — with zero emissions, zero water. Lambda × Supermicro × ECL →

The first-ever hydrogen-powered NVIDIA GB300 NVL72 systems are online. Training & inference at scale — with zero emissions, zero water. Lambda × Supermicro × ECL →

Lambda

17,276 views • 9 months ago

AI answers your questions in seconds, but behind that speed is something called inference—the compute-intensive process where trained models generate responses. At AWS, we've built custom chips like Trainium, intelligent routing systems, and unified infrastructure to make inference faster and more affordable. As AI agents handle complex multi-step tasks, inference accounts for 80-90% of AI computing power. We're engineering at planetary scale to keep those milliseconds reliable.

AI answers your questions in seconds, but behind that speed is something called inference—the compute-intensive process where trained models generate responses. At AWS, we've built custom chips like Trainium, intelligent routing systems, and unified infrastructure to make inference faster and more affordable. As AI agents handle complex multi-step tasks, inference accounts for 80-90% of AI computing power. We're engineering at planetary scale to keep those milliseconds reliable.

Amazon Web Services

27,021 views • 4 months ago

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊

#Heroku is transitioning to a “sustaining engineering model”, or dev-speak for no new roadmap. 👀 Let us help you migrate your workloads to an Inference Cloud delivering trusted performance, radically simpler operations, and predictable economics—DigitalOcean. We’re ready to help you evaluate your options in a way that is realistic, structured, and built for the long term. 🌊

DigitalOcean

10,297 views • 5 months ago

⚡️Today marks a big milestone for Nebius. We’re launching Nebius Token Factory, the evolution of Nebius AI Studio, built to make open-source AI production-grade. Token Factory transforms raw open models into governed, scalable systems with dedicated inference, sub-second latency, 99.9% uptime and zero-retention compliance. It’s where inference, post-training and governance converge, turning raw compute into reliable intelligence. Run AI inference at scale:

⚡️Today marks a big milestone for Nebius. We’re launching Nebius Token Factory, the evolution of Nebius AI Studio, built to make open-source AI production-grade. Token Factory transforms raw open models into governed, scalable systems with dedicated inference, sub-second latency, 99.9% uptime and zero-retention compliance. It’s where inference, post-training and governance converge, turning raw compute into reliable intelligence. Run AI inference at scale:

Nebius Token Factory

260,215 views • 8 months ago

Among the fastest DeepSeek V3.2, MiniMax-M2.5, and Qwen 3.5 397B inference in the market, per Artificial Analysis benchmarks (April 2026). ⚡️🤖 Sub-1-second TTFT. 230 tokens per second. Co-designed every layer of the stack with Inferact, performance optimized vLLM, all on NVIDIA HGX B300. Live on DigitalOcean Serverless Inference now. Full breakdown in the comments. ⬇️

Among the fastest DeepSeek V3.2, MiniMax-M2.5, and Qwen 3.5 397B inference in the market, per Artificial Analysis benchmarks (April 2026). ⚡️🤖 Sub-1-second TTFT. 230 tokens per second. Co-designed every layer of the stack with Inferact, performance optimized vLLM, all on NVIDIA HGX B300. Live on DigitalOcean Serverless Inference now. Full breakdown in the comments. ⬇️

DigitalOcean

39,063 views • 2 months ago

A glimpse into one of our core features 👀 Chat, Search, Compare, & Run #Inference for all AI models on ONE Platform: No more complicated setups, just seamless #AI magic. 💫 Be the first to experience - join waitlist now: #Inferium #AI #Inference

A glimpse into one of our core features 👀 Chat, Search, Compare, & Run #Inference for all AI models on ONE Platform: No more complicated setups, just seamless #AI magic. 💫 Be the first to experience - join waitlist now: #Inferium #AI #Inference

Inferium

1,079,170 views • 2 years ago

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.

DigitalOcean Inference Router is now available through OpenCode & setup is 3 steps. ☁️🆕🤝 Run/connect & it automatically routes to the right model for the job. No more paying frontier prices for a commit message.

DigitalOcean

20,992 views • 1 month ago

AI Bull vs Bear #1: 60-70% gross margins on AI inference. Gavin Baker Gavin Baker of Atreides ran the math on BG2 Pod: inference revenue exits 2026 above $200B, and he calls $300B a low estimate for 2027. Ed Zitron's Ed Zitron bear case says costs scale with revenue, so the curve never bends. Baker's number says the unit economics already work at the inference layer. The catch: that is gross margin, not the whole P&L. It does not answer OpenAI's $21B operating loss. Where the bull margin math meets Zitron's receipts:

AI Bull vs Bear #1: 60-70% gross margins on AI inference. Gavin Baker Gavin Baker of Atreides ran the math on BG2 Pod: inference revenue exits 2026 above $200B, and he calls $300B a low estimate for 2027. Ed Zitron's Ed Zitron bear case says costs scale with revenue, so the curve never bends. Baker's number says the unit economics already work at the inference layer. The catch: that is gross margin, not the whole P&L. It does not answer OpenAI's $21B operating loss. Where the bull margin math meets Zitron's receipts:

Podcast Alpha

15,261 views • 21 days ago

Accelerate AI innovation with ASI:Cloud, a high-performance cloud platform focusing on inference and AI workloads. Designed with performance, permissionless access, transparent pricing, and access to industry-leading LLMs, including ASI:One, the platform helps builders, developers, and enterprise teams move from idea to inference at scale. Ready to start your ASI infrastructure journey? Explore here:

Accelerate AI innovation with ASI:Cloud, a high-performance cloud platform focusing on inference and AI workloads. Designed with performance, permissionless access, transparent pricing, and access to industry-leading LLMs, including ASI:One, the platform helps builders, developers, and enterprise teams move from idea to inference at scale. Ready to start your ASI infrastructure journey? Explore here:

SingularityNET

24,547 views • 9 months ago

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).

.Character.AI, AMD, & #DigitalOcean are scaling the Qwen3-235B open-weight Mixture-of-Experts AI model to serve approximately 20M users. 🤖📈☁️ This required tuning a 5600/140 (ISL/OSL) workload with FP8 inference on AMD Instinct™ MI325X GPUs to maximize request throughput (QPS).

DigitalOcean

27,714 views • 6 months ago

✨ Inferium 2024 Wrapped! ✨ This year, we shattered boundaries, innovated at lightning speed, and revolutionized the way you interact with AI inference 🤖🌌 📊 Milestones, magic, and momentum – all wrapped up just for you. 🎥 Watch our 2024 Wrapped to see how we’ve transformed #inference forever👇 Here’s to shaping the future in 2025!

✨ Inferium 2024 Wrapped! ✨ This year, we shattered boundaries, innovated at lightning speed, and revolutionized the way you interact with AI inference 🤖🌌 📊 Milestones, magic, and momentum – all wrapped up just for you. 🎥 Watch our 2024 Wrapped to see how we’ve transformed #inference forever👇 Here’s to shaping the future in 2025!

Inferium

26,175 views • 1 year ago

SN50 is here, the fastest chip built for agentic AI. Max speed of up to 5X faster; run agentic AI at a 3X lower cost than GPUs, unlocking cloud-scale inference economics. We’ve also planned a multi-year strategic collaboration with Intel &raised $350M+ from Vista Equity Partners, Cambium Capital & T. Rowe Price to scale manufacturing &cloud capacity. Learn more:

SN50 is here, the fastest chip built for agentic AI. Max speed of up to 5X faster; run agentic AI at a 3X lower cost than GPUs, unlocking cloud-scale inference economics. We’ve also planned a multi-year strategic collaboration with Intel &raised $350M+ from Vista Equity Partners, Cambium Capital & T. Rowe Price to scale manufacturing &cloud capacity. Learn more:

SambaNova

77,847 views • 4 months ago

Demo of Tether's QVAC running local inference on a mobile device at incredible speed, via llama.cpp + LLAMA 3.2 1B parameters. QVAC is a generalized inference and fine-tuning runtime able to adapt to any device, from smartphones, to laptops and servers. Lots of models being supported already. More to come. No limits. Infinite intelligence. Coming soon

Demo of Tether's QVAC running local inference on a mobile device at incredible speed, via llama.cpp + LLAMA 3.2 1B parameters. QVAC is a generalized inference and fine-tuning runtime able to adapt to any device, from smartphones, to laptops and servers. Lots of models being supported already. More to come. No limits. Infinite intelligence. Coming soon

Paolo Ardoino 🤖

42,074 views • 1 year ago