Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

AkashML is live! A fully managed AI inference service on Akash Network. Deploying open models like DeepSeek shouldn’t cost $50K/month or require complex setup. AkashML makes inference simple, affordable, and automatic, so developers can run AI workloads on decentralized GPUs with ease. Try it out here 👇 Read More... show more

Akash Network

128,765 subscribers

37,017 views • 7 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

At #RenderCon Jules Urbach shared a view for the future of AI and decentralized compute, discussing how the industry is shifting from focusing on pre-training models towards inference time AI applications and agents that can run on The Render Network high performance consumer GPUs.

At #RenderCon Jules Urbach shared a view for the future of AI and decentralized compute, discussing how the industry is shifting from focusing on pre-training models towards inference time AI applications and agents that can run on The Render Network high performance consumer GPUs.

The Render Network

10,904 views • 1 year ago

$META is betting on $AMD for AI inference. As AI models become more commoditized, total cost of ownership for token generation matters more than ever. $AMD GPUs are far more cost-efficient than $NVDA for inference. With 3.5B daily users ready to use its AI models, $META is going all-in on $AMD

$META is betting on $AMD for AI inference. As AI models become more commoditized, total cost of ownership for token generation matters more than ever. $AMD GPUs are far more cost-efficient than $NVDA for inference. With 3.5B daily users ready to use its AI models, $META is going all-in on $AMD

Daniel

20,558 views • 5 months ago

BOOM! Starting today you can use open source frontier LLMs in Visual Studio Code with HF Inference Providers! 🔥 Use your inference credits on SoTA llms like GLM 4.5, Qwen3 Coder, DeepSeek 3.1 and more All of it packaged in one simple extension - try it out today 🤗

BOOM! Starting today you can use open source frontier LLMs in Visual Studio Code with HF Inference Providers! 🔥 Use your inference credits on SoTA llms like GLM 4.5, Qwen3 Coder, DeepSeek 3.1 and more All of it packaged in one simple extension - try it out today 🤗

Vaibhav (VB) Srivastav

41,185 views • 9 months ago

OpenLedger is powering decentralized AI inference with DGrid AI, built on verifiable, onchain infrastructure. DGrid routes AI workloads across a distributed compute network, while OpenLedger anchors execution, attribution, and settlement fully onchain. Together, this enables AI systems that are auditable by design, transparent in cost and performance, and built for real Web3 applications.

OpenLedger is powering decentralized AI inference with DGrid AI, built on verifiable, onchain infrastructure. DGrid routes AI workloads across a distributed compute network, while OpenLedger anchors execution, attribution, and settlement fully onchain. Together, this enables AI systems that are auditable by design, transparent in cost and performance, and built for real Web3 applications.

OpenLedger

196,328 views • 5 months ago

ROCm on Windows? Yes, with WSL. AI developers can now run AMD ROCm on Windows, unlocking easier access to AMD GPUs for AI training, inference, and experimentation — no dual booting required. Get started with ComfyUI:

ROCm on Windows? Yes, with WSL. AI developers can now run AMD ROCm on Windows, unlocking easier access to AMD GPUs for AI training, inference, and experimentation — no dual booting required. Get started with ComfyUI:

AI at AMD

32,154 views • 10 months ago

Crusoe Managed Inference is now available. Run model inference faster, easier, and more cost-effectively. Large-context AI solutions demand fast outputs, massive throughput, and resilient scaling. Crusoe Managed Inference delivers breakthrough speed & reduced input-token spend.

Crusoe Managed Inference is now available. Run model inference faster, easier, and more cost-effectively. Large-context AI solutions demand fast outputs, massive throughput, and resilient scaling. Crusoe Managed Inference delivers breakthrough speed & reduced input-token spend.

Crusoe

12,096,815 views • 7 months ago

Running AI image generation for thousands of users at once has 3 problems: cost, speed, and crashing servers. So we built a different way with and AkashML. One that brings image gen cost down to just 1 cent/image. Watch and read the full breakdown ⏬ Akash Network

Running AI image generation for thousands of users at once has 3 problems: cost, speed, and crashing servers. So we built a different way with and AkashML. One that brings image gen cost down to just 1 cent/image. Watch and read the full breakdown ⏬ Akash Network

RazerAI

65,849 views • 1 month ago

Most AI projects don't fail because models aren't good enough. They fail because inference economics don't scale. During #CXOSpice, Roman Chernin Nebius broke it down: ✅Closed models kill margins ✅Open models unlock control, if you can run them well ✅DataData only becomes a moat when inference is sustainable One team cut inference costs 26× in production. Only 30% of orgs use AI at scale, mostly in 1% of workloads. We're just getting started. Full conversation: #AI #Inference #TechInnovation Learn more about Nebius Token Factory:

Most AI projects don't fail because models aren't good enough. They fail because inference economics don't scale. During #CXOSpice, Roman Chernin Nebius broke it down: ✅Closed models kill margins ✅Open models unlock control, if you can run them well ✅DataData only becomes a moat when inference is sustainable One team cut inference costs 26× in production. Only 30% of orgs use AI at scale, mostly in 1% of workloads. We're just getting started. Full conversation: #AI #Inference #TechInnovation Learn more about Nebius Token Factory:

Helen Yu

13,662 views • 5 months ago

SolRouter beta is live on devnet. SDK for developers. MCP support for agents. And our own agent framework with encrypted token research, multi-agent orchestration, and private inference on decentralized GPUs. Private AI infrastructure for Solana. <encrypted> by default.

SolRouter beta is live on devnet. SDK for developers. MCP support for agents. And our own agent framework with encrypted token research, multi-agent orchestration, and private inference on decentralized GPUs. Private AI infrastructure for Solana. <encrypted> by default.

SolRouter

38,464 views • 4 months ago

Groq founder Jonathan Ross explains why their architecture is better for inference than GPUs. Inference doesn't require as much compute power as training. What matters in inference is speed, cost, and energy consumption. $NVDA was going to lose market share as AI workloads shift to inference. They saw this and made a highly strategic move by striking a deal with Groq. $NVDA is already dominating training, and now it's also well-positioned to dominate inference.

Groq founder Jonathan Ross explains why their architecture is better for inference than GPUs. Inference doesn't require as much compute power as training. What matters in inference is speed, cost, and energy consumption. $NVDA was going to lose market share as AI workloads shift to inference. They saw this and made a highly strategic move by striking a deal with Groq. $NVDA is already dominating training, and now it's also well-positioned to dominate inference.

Oguz Erkan

97,186 views • 6 months ago

Connecting all intelligence with ORA ⏺️ So, how does it work? Let's dive in 👇 At the heart of ORA is the Onchain AI Oracle (OAO), designed to empower dApp developers by seamlessly integrating verifiable AI inference into their applications without sacrificing decentralization. At the center of ORA is Optimistic Machine Learning (opML). This technology ensures that AI inferences originate from the correct models and that results remain untampered. A robust network of nodes independently verifies each AI inference and can raise challenges if tampering is suspected. Want to be part of this decentralized movement? You can easily run your own node using Tora, our user-friendly node software. Built on Optimistic Machine Learning (opML), our Onchain AI Oracle connects the best open-source AI models to the blockchain. This means any dApp can easily become an AI dApp! With our Initial Model Offering (IMO), developers can tokenize open-source models, effectively overcoming the cold start problem by securing essential funding for their projects. ORA is integrated with several L2s, including Mantle Network, Linea.eth, and Arbitrum. This allows you to build on low-cost chains that best suit your needs. ORA is committed to bringing decentralized, verifiable AI to the blockchain. Are you ready to join us? Use OAO: Read more about OAO: Learn about IMO: Use Tora:

Connecting all intelligence with ORA ⏺️ So, how does it work? Let's dive in 👇 At the heart of ORA is the Onchain AI Oracle (OAO), designed to empower dApp developers by seamlessly integrating verifiable AI inference into their applications without sacrificing decentralization. At the center of ORA is Optimistic Machine Learning (opML). This technology ensures that AI inferences originate from the correct models and that results remain untampered. A robust network of nodes independently verifies each AI inference and can raise challenges if tampering is suspected. Want to be part of this decentralized movement? You can easily run your own node using Tora, our user-friendly node software. Built on Optimistic Machine Learning (opML), our Onchain AI Oracle connects the best open-source AI models to the blockchain. This means any dApp can easily become an AI dApp! With our Initial Model Offering (IMO), developers can tokenize open-source models, effectively overcoming the cold start problem by securing essential funding for their projects. ORA is integrated with several L2s, including Mantle Network, Linea.eth, and Arbitrum. This allows you to build on low-cost chains that best suit your needs. ORA is committed to bringing decentralized, verifiable AI to the blockchain. Are you ready to join us? Use OAO: Read more about OAO: Learn about IMO: Use Tora:

ORA

453,160 views • 1 year ago

Training and deploying AI models just got a lot more affordable. 🏷️📉 With new price reductions for EC2 GPU instances, your AI workloads can go further without going over budget. Read more in our blog. 👉

Training and deploying AI models just got a lot more affordable. 🏷️📉 With new price reductions for EC2 GPU instances, your AI workloads can go further without going over budget. Read more in our blog. 👉

Amazon Web Services

10,544 views • 1 year ago

Fireworks AI is now live on EvoSkill v1.3.0! You can now use Fireworks AI directly with EvoSkill to run fast inference on open models as both the evolution harness backend and the LLM scorer. Alongside Claude API and OpenRouter, Fireworks AI is now a first-class provider in EvoSkill.

Fireworks AI is now live on EvoSkill v1.3.0! You can now use Fireworks AI directly with EvoSkill to run fast inference on open models as both the evolution harness backend and the LLM scorer. Alongside Claude API and OpenRouter, Fireworks AI is now a first-class provider in EvoSkill.

Sentient

33,208 views • 3 days ago

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 views • 3 months ago

Open source like DeepSeek doesn’t shrink markets. It grows them. Faster, cheaper training means rising inference demand and a new era of AI hardware.

Open source like DeepSeek doesn’t shrink markets. It grows them. Faster, cheaper training means rising inference demand and a new era of AI hardware.

The Linux Foundation

32,930 views • 1 year ago

AI inference isn’t just about GPUs. The host CPU is critical. On this Signal65 podcast, Ryan Shrout, Russ Fellows, and Mitch Lewis speak with AMD’s Madhu Rangarajan and Curt Waltman on how AMDServer EPYC CPUs improve enterprise AI inference performance. Full episode:

AI inference isn’t just about GPUs. The host CPU is critical. On this Signal65 podcast, Ryan Shrout, Russ Fellows, and Mitch Lewis speak with AMD’s Madhu Rangarajan and Curt Waltman on how AMDServer EPYC CPUs improve enterprise AI inference performance. Full episode:

Six Five Media

120,592 views • 4 months ago

This is HUGE, Hugging Face just shipped Inference Providers on the Hub Partnering with Together AI, @FAL, Replicate and SambaNova! Starting today you can access thousands of Models like DeepSeek R1, Llama, Flux, Whisper, and more Directly from Hugging Face!

This is HUGE, Hugging Face just shipped Inference Providers on the Hub Partnering with Together AI, @FAL, Replicate and SambaNova! Starting today you can access thousands of Models like DeepSeek R1, Llama, Flux, Whisper, and more Directly from Hugging Face!

AK

177,126 views • 1 year ago

OpenAI's Noam Brown says that while AI model performance scales roughly equivalently with more training or inference compute, the cost of inference is on the order of 100 billion times cheaper

OpenAI's Noam Brown says that while AI model performance scales roughly equivalently with more training or inference compute, the cost of inference is on the order of 100 billion times cheaper

Tsarathustra

250,828 views • 1 year ago