正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

the inference engine

Kat ⊷ the Poet Engineer

100,867 subscribers

94,731 次观看 • 2 个月前 •via X (Twitter)

艺术科学技术教育

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Real-time Moondream inference using our new inference engine

Real-time Moondream inference using our new inference engine

vik

144,677 次观看 • 7 个月前

First steps for a specialized DeepSeek v4 Flash inference engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.

First steps for a specialized DeepSeek v4 Flash inference engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.

antirez

14,220 次观看 • 5 个月前

Step 4 to achieve truly serverless GPUs for AI inference: skip over unserializable inference engine setup steps like CUDA graph capture and Torch compilation by stacking GPU snapshots and CPU snapshots.

Step 4 to achieve truly serverless GPUs for AI inference: skip over unserializable inference engine setup steps like CUDA graph capture and Torch compilation by stacking GPU snapshots and CPU snapshots.

Charles 🎉 Frye

17,452 次观看 • 5 个月前

Batching for vision models is now available in Beta with our latest MLX engine update 👾 The updated engine also brings major improvements to caching for faster inference overall. Turn on Developer Mode, choose the beta runtime channel, and select LM Studio MLX v1.8.1.

Batching for vision models is now available in Beta with our latest MLX engine update 👾 The updated engine also brings major improvements to caching for faster inference overall. Turn on Developer Mode, choose the beta runtime channel, and select LM Studio MLX v1.8.1.

LM Studio

48,156 次观看 • 5 个月前

PHPStan 2.3.0 is out with massive leap in performance, generics improvements, detecting unused variables, improved closure type inference, inferring static variable types from assignments, and engine rewrite!

PHPStan 2.3.0 is out with massive leap in performance, generics improvements, detecting unused variables, improved closure type inference, inferring static variable types from assignments, and engine rewrite!

Ondřej Mirtes

11,475 次观看 • 19 天前

The fastest search meets the fastest inference! Exa 🤝 Cerebras

The fastest search meets the fastest inference! Exa 🤝 Cerebras

Exa

35,365 次观看 • 3 个月前

The sun sneaking through the bypass space of the Engine. Can you guess this Engine?

The sun sneaking through the bypass space of the Engine. Can you guess this Engine?

Aero vance

27,776 次观看 • 5 个月前

5-Day Blind Box Creator Challenge Powered by WAN 2.6 × Alibaba Cloud × GMI Built on GMI Inference Engine. Cash rewards up to $75 for EVERYONE Pick a number. Open a blind box prompt. Ship a short video. Details below

5-Day Blind Box Creator Challenge Powered by WAN 2.6 × Alibaba Cloud × GMI Built on GMI Inference Engine. Cash rewards up to $75 for EVERYONE Pick a number. Open a blind box prompt. Ship a short video. Details below

GMI Cloud

101,441 次观看 • 10 个月前

First AI Credit Marketplace + inference trading on @Arc. Coming soon. 👀 Sell unused AI credits. Buy inference for less. Trade OpenAI ↔ Claude and more. AI inference is becoming a market.

First AI Credit Marketplace + inference trading on @Arc. Coming soon. 👀 Sell unused AI credits. Buy inference for less. Trade OpenAI ↔ Claude and more. AI inference is becoming a market.

AI Flow

36,810 次观看 • 1 个月前

Dispatches from the Double Engine. Double Engine infrastructure can’t even withstand a regular monsoon.

Dispatches from the Double Engine. Double Engine infrastructure can’t even withstand a regular monsoon.

Sagarika Ghose

42,474 次观看 • 3 个月前

5-engine Boeing 747? Look closely at the extra engine pod mounted next to the upper deck. 📹:

5-engine Boeing 747? Look closely at the extra engine pod mounted next to the upper deck. 📹:

Aviation

236,222 次观看 • 2 个月前

left the engine running

left the engine running

Posts Of Cats

5,248,983 次观看 • 3 年前

The engine is purrari

The engine is purrari

Antidepressant Content

179,752 次观看 • 1 年前

the engine is good

the engine is good

Posts Of Cats

1,497,303 次观看 • 1 年前

The engine is running

The engine is running

Kitten Cat

26,276 次观看 • 5 个月前

Now they look and sound nice. I guess it was not the same in the 1940s... BF-109 engine start-up (by the looks of it, a "real" one, using the DB Engine and not the RR Engine)

Now they look and sound nice. I guess it was not the same in the 1940s... BF-109 engine start-up (by the looks of it, a "real" one, using the DB Engine and not the RR Engine)

Air Safety #OTD by Francisco Cunha

25,131 次观看 • 8 个月前

Staking near:native, farming inference 🤯

Staking near:native, farming inference 🤯

Tyler

12,034 次观看 • 1 个月前