正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Real-time Moondream inference using our new inference engine

vik

28,110 subscribers

144,677 次观看 • 7 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

the inference engine

the inference engine

Kat ⊷ the Poet Engineer

94,731 次观看 • 2 个月前

Step 4 to achieve truly serverless GPUs for AI inference: skip over unserializable inference engine setup steps like CUDA graph capture and Torch compilation by stacking GPU snapshots and CPU snapshots.

Step 4 to achieve truly serverless GPUs for AI inference: skip over unserializable inference engine setup steps like CUDA graph capture and Torch compilation by stacking GPU snapshots and CPU snapshots.

Charles 🎉 Frye

17,452 次观看 • 5 个月前

First steps for a specialized DeepSeek v4 Flash inference engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.

First steps for a specialized DeepSeek v4 Flash inference engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.

antirez

14,220 次观看 • 5 个月前

Dot Staking. A new economic layer for AI inference. 9 days.

Dot Staking. A new economic layer for AI inference. 9 days.

Dot

16,196 次观看 • 24 天前

First AI Credit Marketplace + inference trading on @Arc. Coming soon. 👀 Sell unused AI credits. Buy inference for less. Trade OpenAI ↔ Claude and more. AI inference is becoming a market.

First AI Credit Marketplace + inference trading on @Arc. Coming soon. 👀 Sell unused AI credits. Buy inference for less. Trade OpenAI ↔ Claude and more. AI inference is becoming a market.

AI Flow

36,810 次观看 • 29 天前

Staking near:native, farming inference 🤯

Staking near:native, farming inference 🤯

Tyler

12,034 次观看 • 1 个月前

Introducing DeepThought-8B: Transparent reasoning model built on LLaMA-3.1 with test-time compute scaling. - JSON-structured thought chains & controllable inference paths. - ~16GB VRAM, competitive w/ 70B models. - Open model weights, and inference scripts.

Introducing DeepThought-8B: Transparent reasoning model built on LLaMA-3.1 with test-time compute scaling. - JSON-structured thought chains & controllable inference paths. - ~16GB VRAM, competitive w/ 70B models. - Open model weights, and inference scripts.

Ruliad

219,315 次观看 • 1 年前

Batching for vision models is now available in Beta with our latest MLX engine update 👾 The updated engine also brings major improvements to caching for faster inference overall. Turn on Developer Mode, choose the beta runtime channel, and select LM Studio MLX v1.8.1.

Batching for vision models is now available in Beta with our latest MLX engine update 👾 The updated engine also brings major improvements to caching for faster inference overall. Turn on Developer Mode, choose the beta runtime channel, and select LM Studio MLX v1.8.1.

LM Studio

48,156 次观看 • 5 个月前

Video generation is powerful but too slow for real-world robotic tasks. How can we enable both video and action generation while ensuring real-time policy inference? Check out our work on the Unified Video Action Model (UVA) to find out! (1/7)

Video generation is powerful but too slow for real-world robotic tasks. How can we enable both video and action generation while ensuring real-time policy inference? Check out our work on the Unified Video Action Model (UVA) to find out! (1/7)

Shuang Li

68,008 次观看 • 1 年前

The team at Runway is pushing the frontier of what's possible in world models. We're proud to work with them to power real-time inference for Runway Characters.

The team at Runway is pushing the frontier of what's possible in world models. We're proud to work with them to power real-time inference for Runway Characters.

Modal

68,896 次观看 • 7 个月前

Excited to share our NeurIPS 2024 Oral, Convolutional Differentiable Logic Gate Networks, leading to a range of inference efficiency records, including inference in only 4 nanoseconds 🏎️. We reduce model sizes by factors of 29x-61x over the SOTA. Paper:

Excited to share our NeurIPS 2024 Oral, Convolutional Differentiable Logic Gate Networks, leading to a range of inference efficiency records, including inference in only 4 nanoseconds 🏎️. We reduce model sizes by factors of 29x-61x over the SOTA. Paper:

Felix Petersen

157,819 次观看 • 1 年前

Distributed Inference, Now in Hybrid. Try it now:

Distributed Inference, Now in Hybrid. Try it now:

Gradient

34,803 次观看 • 1 年前

diffusion policy trained on 26 minutes of data (80 demos, 20 seconds each) using DDIM noise scheduler for inference with 10 denoising steps

diffusion policy trained on 26 minutes of data (80 demos, 20 seconds each) using DDIM noise scheduler for inference with 10 denoising steps

ahad

319,007 次观看 • 10 个月前

Fireworks blazing fast LLM inference is now available on Poe! Today, we’re excited to bring the power of the new Mistral 7B Instruct model to the Poe powered by our lightning-fast Fireworks inference platform. You can now have conversations with the Mistral 7B bot and even build your own bots on top of it. Try it here:

Fireworks blazing fast LLM inference is now available on Poe! Today, we’re excited to bring the power of the new Mistral 7B Instruct model to the Poe powered by our lightning-fast Fireworks inference platform. You can now have conversations with the Mistral 7B bot and even build your own bots on top of it. Try it here:

Fireworks AI

93,334 次观看 • 3 年前

The Inference - Episode 7 👾 Our second “The Inference” livestream of 2026 is coming! 🗓️ Friday (09.01.26) 🕐 10 AM UTC 📍 On X & YouTube 🎙️ With Josh Goodbody, Luis 👾, 🔥 Special guest: WachAI CTO, {{joey}} Questions? Drop them below - and set a reminder👇

The Inference - Episode 7 👾 Our second “The Inference” livestream of 2026 is coming! 🗓️ Friday (09.01.26) 🕐 10 AM UTC 📍 On X & YouTube 🎙️ With Josh Goodbody, Luis 👾, 🔥 Special guest: WachAI CTO, {{joey}} Questions? Drop them below - and set a reminder👇

Warden

20,068 次观看 • 9 个月前

For fellows. What is your inference from this LV angiogram?

For fellows. What is your inference from this LV angiogram?

Dr G Rajesh (Gopalan Nair Rajesh).

33,810 次观看 • 1 年前

The fastest search meets the fastest inference! Exa 🤝 Cerebras

The fastest search meets the fastest inference! Exa 🤝 Cerebras

Exa

35,365 次观看 • 3 个月前

Animals segmentation & tracking using Ultralytics YOLO26 🫎 How I created this demo: - Data annotation using Ultralytics Platform. - YOLO26 model training using Platform. - Downloaded the trained model. - Run Inference on video files locally. #animal #ai #MachineLearning

Animals segmentation & tracking using Ultralytics YOLO26 🫎 How I created this demo: - Data annotation using Ultralytics Platform. - YOLO26 model training using Platform. - Downloaded the trained model. - Run Inference on video files locally. #animal #ai #MachineLearning

Muhammad Rizwan Munawar

21,656 次观看 • 4 个月前

1/ CyAI is live. Requests are now being served through Cysic’s verifiable inference network. In July, we described what verifiable inference should look like. This is it running. Check it out:

1/ CyAI is live. Requests are now being served through Cysic’s verifiable inference network. In July, we described what verifiable inference should look like. This is it running. Check it out:

Cysic 🇸🇬 TOKEN2049

31,605 次观看 • 1 个月前