正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

fastest way to move llms between machines for distributed inference

Alex Ziskind

15,538 subscribers

74,282 次观看 • 7 个月前 •via X (Twitter)

教育科学技术

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

The FASTEST way to build CHAT UI for LLMs

The FASTEST way to build CHAT UI for LLMs

abhishek

99,341 次观看 • 3 年前

Cheapest and fastest way to move to Canada 🇨🇦

Cheapest and fastest way to move to Canada 🇨🇦

Ghost 👨🏽‍💻🇨🇦

12,110 次观看 • 4 个月前

Fastest way to move to Canada in 2026🇨🇦

Fastest way to move to Canada in 2026🇨🇦

Ghost 👨🏽‍💻🇨🇦

13,097 次观看 • 4 个月前

She literally broke down the fastest way to move forward when you feel stuck.

She literally broke down the fastest way to move forward when you feel stuck.

Katyayani Shukla

91,015 次观看 • 6 个月前

$100,000,000,000 in 525 days. The fastest to move $100B between networks. And yet, just the beginning. Tether, everywhere.

$100,000,000,000 in 525 days. The fastest to move $100B between networks. And yet, just the beginning. Tether, everywhere.

USDT0

256,907 次观看 • 2 个月前

"To use AI speed mattered. The way we use AI with inference...what we do is the fastest inference in the world. Not by a little bit, but by more than 15X." Cerebras Andrew Feldman #BloombergTech ⏯️

"To use AI speed mattered. The way we use AI with inference...what we do is the fastest inference in the world. Not by a little bit, but by more than 15X." Cerebras Andrew Feldman #BloombergTech ⏯️

Bloomberg Live

16,254 次观看 • 3 个月前

Your Mac is about to run inference like a datacenter. Coming soon to MLX-Swift: Continuous batching: the fastest way to handle multiple inference streams locally. It starts with regular inference and seamlessly upgrades to batched mode when new requests arrive. The best of both worlds. Based on the work of and Awni Hannun

Your Mac is about to run inference like a datacenter. Coming soon to MLX-Swift: Continuous batching: the fastest way to handle multiple inference streams locally. It starts with regular inference and seamlessly upgrades to batched mode when new requests arrive. The best of both worlds. Based on the work of and Awni Hannun

Ronald Mannak

60,570 次观看 • 10 个月前

Introducing Parallax, the first fully distributed inference and serving engine for large language models. Try it now: 🧵

Introducing Parallax, the first fully distributed inference and serving engine for large language models. Try it now: 🧵

Gradient

161,146 次观看 • 1 年前

Accelerate AI innovation with ASI:Cloud, a high-performance cloud platform focusing on inference and AI workloads. Designed with performance, permissionless access, transparent pricing, and access to industry-leading LLMs, including ASI:One, the platform helps builders, developers, and enterprise teams move from idea to inference at scale. Ready to start your ASI infrastructure journey? Explore here:

Accelerate AI innovation with ASI:Cloud, a high-performance cloud platform focusing on inference and AI workloads. Designed with performance, permissionless access, transparent pricing, and access to industry-leading LLMs, including ASI:One, the platform helps builders, developers, and enterprise teams move from idea to inference at scale. Ready to start your ASI infrastructure journey? Explore here:

SingularityNET

24,547 次观看 • 11 个月前

Defeating Nondeterminism in LLM Inference. Had to slop up Horace He and Thinking Machines excellent work.

Defeating Nondeterminism in LLM Inference. Had to slop up Horace He and Thinking Machines excellent work.

SemiAnalysis

16,997 次观看 • 7 个月前

Quote i heard this morning “regenerative agriculture is the fastest way to move to the front page of the farm weekly and then move it to the back page….”

Quote i heard this morning “regenerative agriculture is the fastest way to move to the front page of the farm weekly and then move it to the back page….”

Michael Hart

11,544 次观看 • 1 年前

introducing fast inference ( fast inference is an LLM API for devs who want to go faster access the fastest Kimi K3, GLM, DeepSeek, etc for $9/mo integrations with Claude Code, Codex, OpenCode & more speeds compounds. waiting for Claude does not

introducing fast inference ( fast inference is an LLM API for devs who want to go faster access the fastest Kimi K3, GLM, DeepSeek, etc for $9/mo integrations with Claude Code, Codex, OpenCode & more speeds compounds. waiting for Claude does not

Sam Hogan 🇺🇸

158,674 次观看 • 14 天前

Microsoft researchers release bitnet.cpp, the official inference framework for 1-bit LLMs like BitNet b1.58. It has optimized kernels for fast, lossless inference on CPUs, achieving impressive speedups on ARM and x86 CPUs and significant energy reductions.

Microsoft researchers release bitnet.cpp, the official inference framework for 1-bit LLMs like BitNet b1.58. It has optimized kernels for fast, lossless inference on CPUs, achieving impressive speedups on ARM and x86 CPUs and significant energy reductions.

Microsoft Research

75,161 次观看 • 1 年前

guys i am making the fastest way to switch between your most used apps. and its so fun

guys i am making the fastest way to switch between your most used apps. and its so fun

Rudra Das

117,538 次观看 • 4 个月前

Forged in Move. Sharpened for Markets and Machines. Aptos.

Forged in Move. Sharpened for Markets and Machines. Aptos.

Aptos

27,661 次观看 • 3 个月前

bro casually explains RL tuning for LLMs and the three critical components: training, inference, and environments. basically any RLVR algorithm such as GRPO comes down to this super simple concept.

bro casually explains RL tuning for LLMs and the three critical components: training, inference, and environments. basically any RLVR algorithm such as GRPO comes down to this super simple concept.

ℏεsam

102,426 次观看 • 7 个月前

This is how large language models turn objects to vector representations. In this video, we explore how large language models (LLMs) convert objects into internal representations, especially when translating between languages like English and Hindi. Using real-world examples, we highlight the challenges of gender inference, grammatical structure, and why direct word-to-word translations often fail. If you're curious about how LLMs deal with multilingual contexts and what it takes to improve translation quality across languages, this video is for you. #LLMs #Vectors #LCM

This is how large language models turn objects to vector representations. In this video, we explore how large language models (LLMs) convert objects into internal representations, especially when translating between languages like English and Hindi. Using real-world examples, we highlight the challenges of gender inference, grammatical structure, and why direct word-to-word translations often fail. If you're curious about how LLMs deal with multilingual contexts and what it takes to improve translation quality across languages, this video is for you. #LLMs #Vectors #LCM

Gaurav Sen

27,368 次观看 • 1 年前

Fastest way to have a second passport for just $270 🇦🇲

Fastest way to have a second passport for just $270 🇦🇲

Ghost 👨🏽‍💻🇨🇦

60,792 次观看 • 4 个月前