正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Crusoe Managed Inference is now available. Run model inference faster, easier, and more cost-effectively. Large-context AI solutions demand fast outputs, massive throughput, and resilient scaling. Crusoe Managed Inference delivers breakthrough speed & reduced input-token spend.

Crusoe

14,933 subscribers

12,096,815 次观看 • 7 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

NVIDIA

81,795 次观看 • 2 个月前

AkashML is live! A fully managed AI inference service on Akash Network. Deploying open models like DeepSeek shouldn’t cost $50K/month or require complex setup. AkashML makes inference simple, affordable, and automatic, so developers can run AI workloads on decentralized GPUs with ease. Try it out here 👇 Read More about it Here 👇

AkashML is live! A fully managed AI inference service on Akash Network. Deploying open models like DeepSeek shouldn’t cost $50K/month or require complex setup. AkashML makes inference simple, affordable, and automatic, so developers can run AI workloads on decentralized GPUs with ease. Try it out here 👇 Read More about it Here 👇

Akash Network

37,017 次观看 • 7 个月前

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 次观看 • 3 个月前

#M5StackNew 🎊 The LLM630 Compute Kit is an #AI large language model (#LLM) inference development kit, powered by the #Axera #AX630C SoC with a 3.2 TOPs NPU, it delivers efficient AI inference for tasks like computer vision (CV) and LLM processing.

#M5StackNew 🎊 The LLM630 Compute Kit is an #AI large language model (#LLM) inference development kit, powered by the #Axera #AX630C SoC with a 3.2 TOPs NPU, it delivers efficient AI inference for tasks like computer vision (CV) and LLM processing.

M5Stack

16,383 次观看 • 1 年前

Groq founder Jonathan Ross explains why their architecture is better for inference than GPUs. Inference doesn't require as much compute power as training. What matters in inference is speed, cost, and energy consumption. $NVDA was going to lose market share as AI workloads shift to inference. They saw this and made a highly strategic move by striking a deal with Groq. $NVDA is already dominating training, and now it's also well-positioned to dominate inference.

Groq founder Jonathan Ross explains why their architecture is better for inference than GPUs. Inference doesn't require as much compute power as training. What matters in inference is speed, cost, and energy consumption. $NVDA was going to lose market share as AI workloads shift to inference. They saw this and made a highly strategic move by striking a deal with Groq. $NVDA is already dominating training, and now it's also well-positioned to dominate inference.

Oguz Erkan

97,186 次观看 • 6 个月前

OpenAI's Noam Brown says that while AI model performance scales roughly equivalently with more training or inference compute, the cost of inference is on the order of 100 billion times cheaper

OpenAI's Noam Brown says that while AI model performance scales roughly equivalently with more training or inference compute, the cost of inference is on the order of 100 billion times cheaper

Tsarathustra

250,828 次观看 • 1 年前

Been looking into token optimization and model routing, I think super obvious optimization to tackle both cost + demand on inference Here’s a small post about different techniques and methods

Been looking into token optimization and model routing, I think super obvious optimization to tackle both cost + demand on inference Here’s a small post about different techniques and methods

Sean Geng

16,405 次观看 • 25 天前

The era of large-scale AI is just beginning, and infrastructure will define what's possible. Meet Maia 200, Microsoft's breakthrough inference accelerator:

The era of large-scale AI is just beginning, and infrastructure will define what's possible. Meet Maia 200, Microsoft's breakthrough inference accelerator:

Microsoft Azure

21,675 次观看 • 5 个月前

We are just a little bit faster than@nvidia GPUs on Qwen 235B...18X faster. inference is blazing fast...come build cool stuff on Cerebras inference

We are just a little bit faster than@nvidia GPUs on Qwen 235B...18X faster. inference is blazing fast...come build cool stuff on Cerebras inference

Andrew Feldman

44,760 次观看 • 11 个月前

Every AI product running in production depends on an inference system someone had to engineer, optimize and more. Scheduling, batching, routing, cost per token. This is a craft. The Inference Frontier Program spotlights the builders behind that work. 💡 Watch the video and nominate a team:

Every AI product running in production depends on an inference system someone had to engineer, optimize and more. Scheduling, batching, routing, cost per token. This is a craft. The Inference Frontier Program spotlights the builders behind that work. 💡 Watch the video and nominate a team:

Nebius

54,224 次观看 • 3 个月前

$META is betting on $AMD for AI inference. As AI models become more commoditized, total cost of ownership for token generation matters more than ever. $AMD GPUs are far more cost-efficient than $NVDA for inference. With 3.5B daily users ready to use its AI models, $META is going all-in on $AMD

$META is betting on $AMD for AI inference. As AI models become more commoditized, total cost of ownership for token generation matters more than ever. $AMD GPUs are far more cost-efficient than $NVDA for inference. With 3.5B daily users ready to use its AI models, $META is going all-in on $AMD

Daniel

20,558 次观看 • 5 个月前

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

Treating every inference request the same is lighting money on fire. DigitalOcean Inference Router sends each request to the right model automatically–lower cost, faster response, and no quality tradeoff. Open-source engine. Drop-in API. Live since April. ✨

DigitalOcean

589,389 次观看 • 23 天前

IN NEWS: Baseten raises a $150M series D round. Tuhin Srivastava (Founder & CEO, Baseten) on the future of inference: “I think the token price goes down and inference should get cheaper over time. And that really just means there is going to be more inference.” “Every time we lower prices or optimize models to make it cheaper, four months later customers are spending more anyway.” “Inference prices will go down, but if the world is run by AI in 10 years, there is going to be a lot of inference. It better be cheap.”

IN NEWS: Baseten raises a $150M series D round. Tuhin Srivastava (Founder & CEO, Baseten) on the future of inference: “I think the token price goes down and inference should get cheaper over time. And that really just means there is going to be more inference.” “Every time we lower prices or optimize models to make it cheaper, four months later customers are spending more anyway.” “Inference prices will go down, but if the world is run by AI in 10 years, there is going to be a lot of inference. It better be cheap.”

TBPN

17,057 次观看 • 9 个月前

train YOLOv9 on your dataset tutorial - run inference with a pre-trained COCO model - fine-tune model on custom dataset - evaluate the trained model - run inference with a fine-tuned model blogpost: ↓ read more

train YOLOv9 on your dataset tutorial - run inference with a pre-trained COCO model - fine-tune model on custom dataset - evaluate the trained model - run inference with a fine-tuned model blogpost: ↓ read more

SkalskiP

111,792 次观看 • 2 年前

ROCm 7 is here! ✅MI350 Series support ✅Enhanced usability and performance ✅Advanced AI features (distributed inference, large-scale training) ✅Easier enterprise AI deployment

ROCm 7 is here! ✅MI350 Series support ✅Enhanced usability and performance ✅Advanced AI features (distributed inference, large-scale training) ✅Easier enterprise AI deployment

AMD

24,099 次观看 • 11 个月前

The bottleneck in LLM inference isn't compute. It's how fast you can move the weights. Our CTO Mathias Lechner, Mathias Lechner, joins Piotr Mazurek, Piotr Mazurek (in SF 🌉), from our inference team, to discuss what actually limits token throughput and how we're optimizing for it.

The bottleneck in LLM inference isn't compute. It's how fast you can move the weights. Our CTO Mathias Lechner, Mathias Lechner, joins Piotr Mazurek, Piotr Mazurek (in SF 🌉), from our inference team, to discuss what actually limits token throughput and how we're optimizing for it.

Liquid AI

21,393 次观看 • 1 个月前

⚡️Today marks a big milestone for Nebius. We’re launching Nebius Token Factory, the evolution of Nebius AI Studio, built to make open-source AI production-grade. Token Factory transforms raw open models into governed, scalable systems with dedicated inference, sub-second latency, 99.9% uptime and zero-retention compliance. It’s where inference, post-training and governance converge, turning raw compute into reliable intelligence. Run AI inference at scale:

⚡️Today marks a big milestone for Nebius. We’re launching Nebius Token Factory, the evolution of Nebius AI Studio, built to make open-source AI production-grade. Token Factory transforms raw open models into governed, scalable systems with dedicated inference, sub-second latency, 99.9% uptime and zero-retention compliance. It’s where inference, post-training and governance converge, turning raw compute into reliable intelligence. Run AI inference at scale:

Nebius Token Factory

259,764 次观看 • 7 个月前

📣 MLPerf Inference v6.0 results are in. Learn how systems powered by NVIDIA Blackwell set the pace on inference, delivering the highest AI factory throughput. 🔗

📣 MLPerf Inference v6.0 results are in. Learn how systems powered by NVIDIA Blackwell set the pace on inference, delivering the highest AI factory throughput. 🔗

NVIDIA Data Center

33,408 次观看 • 2 个月前

A glimpse into one of our core features 👀 Chat, Search, Compare, & Run #Inference for all AI models on ONE Platform: No more complicated setups, just seamless #AI magic. 💫 Be the first to experience - join waitlist now: #Inferium #AI #Inference

A glimpse into one of our core features 👀 Chat, Search, Compare, & Run #Inference for all AI models on ONE Platform: No more complicated setups, just seamless #AI magic. 💫 Be the first to experience - join waitlist now: #Inferium #AI #Inference

Inferium

1,079,140 次观看 • 1 年前

AI answers your questions in seconds, but behind that speed is something called inference—the compute-intensive process where trained models generate responses. At AWS, we've built custom chips like Trainium, intelligent routing systems, and unified infrastructure to make inference faster and more affordable. As AI agents handle complex multi-step tasks, inference accounts for 80-90% of AI computing power. We're engineering at planetary scale to keep those milliseconds reliable.

AI answers your questions in seconds, but behind that speed is something called inference—the compute-intensive process where trained models generate responses. At AWS, we've built custom chips like Trainium, intelligent routing systems, and unified infrastructure to make inference faster and more affordable. As AI agents handle complex multi-step tasks, inference accounts for 80-90% of AI computing power. We're engineering at planetary scale to keep those milliseconds reliable.

Amazon Web Services

27,021 次观看 • 4 个月前