Загрузка видео...

Не удалось загрузить видео

На главную

Real-time Moondream inference using our new inference engine

vikhyatk's profile picture

vik

27,805 subscribers

144,409 просмотров • 2 месяцев назад •via X (Twitter)

Наука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Laika AI x Inference Labs Excited to announce our partnership with Inference Labs We're providing our real-time RAG & AI model API to Inference Labs, powering their verification infrastructure with live blockchain data. Inference Labs delivers open-source, trustless verification for AI agent outputs, so you can trust what you see—without relying on centralized gatekeepers.
0:10

Laika AI x Inference Labs Excited to announce our partnership with Inference Labs We're providing our real-time RAG & AI model API to Inference Labs, powering their verification infrastructure with live blockchain data. Inference Labs delivers open-source, trustless verification for AI agent outputs, so you can trust what you see—without relying on centralized gatekeepers.

Laika AI

13,727 просмотров • 1 год назад

Step 4 to achieve truly serverless GPUs for AI inference: skip over unserializable inference engine setup steps like CUDA graph capture and Torch compilation by stacking GPU snapshots and CPU snapshots.
0:11

Step 4 to achieve truly serverless GPUs for AI inference: skip over unserializable inference engine setup steps like CUDA graph capture and Torch compilation by stacking GPU snapshots and CPU snapshots.

Charles 🎉 Frye

17,384 просмотров • 1 месяц назад

First steps for a specialized DeepSeek v4 Flash inference engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.
0:12

First steps for a specialized DeepSeek v4 Flash inference engine focused on inference quality / stability at different quantizations, with networked API that is batching capable. This is the 2 bit quants model running on my M3 Max 128GB.

antirez

14,159 просмотров • 1 месяц назад

Introducing DeepThought-8B: Transparent reasoning model built on LLaMA-3.1 with test-time compute scaling. - JSON-structured thought chains & controllable inference paths. - ~16GB VRAM, competitive w/ 70B models. - Open model weights, and inference scripts.
0:16

Introducing DeepThought-8B: Transparent reasoning model built on LLaMA-3.1 with test-time compute scaling. - JSON-structured thought chains & controllable inference paths. - ~16GB VRAM, competitive w/ 70B models. - Open model weights, and inference scripts.

Ruliad

219,315 просмотров • 1 год назад

Batching for vision models is now available in Beta with our latest MLX engine update 👾 The updated engine also brings major improvements to caching for faster inference overall. Turn on Developer Mode, choose the beta runtime channel, and select LM Studio MLX v1.8.1.
0:11

Batching for vision models is now available in Beta with our latest MLX engine update 👾 The updated engine also brings major improvements to caching for faster inference overall. Turn on Developer Mode, choose the beta runtime channel, and select LM Studio MLX v1.8.1.

LM Studio

46,015 просмотров • 1 месяц назад

The team at Runway is pushing the frontier of what's possible in world models. We're proud to work with them to power real-time inference for Runway Characters.
0:15

The team at Runway is pushing the frontier of what's possible in world models. We're proud to work with them to power real-time inference for Runway Characters.

Modal

68,896 просмотров • 2 месяцев назад

Video generation is powerful but too slow for real-world robotic tasks. How can we enable both video and action generation while ensuring real-time policy inference? Check out our work on the Unified Video Action Model (UVA) to find out! (1/7)
0:13

Video generation is powerful but too slow for real-world robotic tasks. How can we enable both video and action generation while ensuring real-time policy inference? Check out our work on the Unified Video Action Model (UVA) to find out! (1/7)

Shuang Li

67,367 просмотров • 1 год назад

Excited to share our NeurIPS 2024 Oral, Convolutional Differentiable Logic Gate Networks, leading to a range of inference efficiency records, including inference in only 4 nanoseconds 🏎️. We reduce model sizes by factors of 29x-61x over the SOTA. Paper:
0:12

Excited to share our NeurIPS 2024 Oral, Convolutional Differentiable Logic Gate Networks, leading to a range of inference efficiency records, including inference in only 4 nanoseconds 🏎️. We reduce model sizes by factors of 29x-61x over the SOTA. Paper:

Felix Petersen

157,435 просмотров • 1 год назад

Distributed Inference, Now in Hybrid. Try it now:
0:12

Distributed Inference, Now in Hybrid. Try it now:

Gradient

34,773 просмотров • 10 месяцев назад

Fireworks blazing fast LLM inference is now available on Poe! Today, we’re excited to bring the power of the new Mistral 7B Instruct model to the Poe powered by our lightning-fast Fireworks inference platform. You can now have conversations with the Mistral 7B bot and even build your own bots on top of it. Try it here:
0:19

Fireworks blazing fast LLM inference is now available on Poe! Today, we’re excited to bring the power of the new Mistral 7B Instruct model to the Poe powered by our lightning-fast Fireworks inference platform. You can now have conversations with the Mistral 7B bot and even build your own bots on top of it. Try it here:

Fireworks AI

93,334 просмотров • 2 лет назад

For fellows. What is your inference from this LV angiogram?
0:11

For fellows. What is your inference from this LV angiogram?

Dr G Rajesh (Gopalan Nair Rajesh).

33,810 просмотров • 1 год назад

The Inference - Episode 7 👾 Our second “The Inference” livestream of 2026 is coming! 🗓️ Friday (09.01.26) 🕐 10 AM UTC 📍 On X & YouTube 🎙️ With Josh Goodbody, Luis 👾, 🔥 Special guest: WachAI CTO, {{joey}} Questions? Drop them below - and set a reminder👇
0:12

The Inference - Episode 7 👾 Our second “The Inference” livestream of 2026 is coming! 🗓️ Friday (09.01.26) 🕐 10 AM UTC 📍 On X & YouTube 🎙️ With Josh Goodbody, Luis 👾, 🔥 Special guest: WachAI CTO, {{joey}} Questions? Drop them below - and set a reminder👇

Warden

20,068 просмотров • 5 месяцев назад

Grok 2 mini is now 2x faster than it was yesterday. In the last three days Lianmin Zheng and Saeed Maleki rewrote our inference stack from scratch using SGLang ( This has also allowed us to serve the big Grok 2 model, which requires multi-host inference, at a reasonable speed. Both models didn’t just get faster, but also slightly more accurate. Stay tuned for further speed improvements!
0:11

Grok 2 mini is now 2x faster than it was yesterday. In the last three days Lianmin Zheng and Saeed Maleki rewrote our inference stack from scratch using SGLang ( This has also allowed us to serve the big Grok 2 model, which requires multi-host inference, at a reasonable speed. Both models didn’t just get faster, but also slightly more accurate. Stay tuned for further speed improvements!

Igor Babuschkin

1,803,113 просмотров • 1 год назад

Move from experimentation to real AI outcomes with secure data, modern networking, and inference at the edge. Turn your ambition into reality with HPE.
0:15

Move from experimentation to real AI outcomes with secure data, modern networking, and inference at the edge. Turn your ambition into reality with HPE.

HPE

1,743,946 просмотров • 3 месяцев назад

just walked into one of our ai inference teammates’ workplace at Liquid AI Cambridge! lots of ice packs, toasters, and coffee machines. 🖱️
0:19

just walked into one of our ai inference teammates’ workplace at Liquid AI Cambridge! lots of ice packs, toasters, and coffee machines. 🖱️

Ramin

82,749 просмотров • 10 дней назад

Real-time distributed inference monitoring is live on exo intern home AI cluster It comes with out of the box support for PrometheusMonitoring metrics and Grafana dashboards Helps diagnose performance bottlenecks in your exo cluster
0:13

Real-time distributed inference monitoring is live on exo intern home AI cluster It comes with out of the box support for PrometheusMonitoring metrics and Grafana dashboards Helps diagnose performance bottlenecks in your exo cluster

Alex Cheema - e/acc

17,798 просмотров • 1 год назад

🏎️ Incredible Speeds with Groq's LPU-Powered Inference 🕔 The langchain-groq package exposes inference capabilities powered by Groq Inc's Language Processing Units (LPUs), soaring to new heights with up to 500 tokens per second on this Mistral AI Mixtral model. Welcome to the fast lane of language processing!
0:16

🏎️ Incredible Speeds with Groq's LPU-Powered Inference 🕔 The langchain-groq package exposes inference capabilities powered by Groq Inc's Language Processing Units (LPUs), soaring to new heights with up to 500 tokens per second on this Mistral AI Mixtral model. Welcome to the fast lane of language processing!

LangChain

27,387 просмотров • 2 лет назад

We’re amazed: AMD now beats Nvidia in inference for Image-to-Video generation. 20% faster and 35% cheaper when using our Higgsfield DoP model. AMD MI300X also has a very easy setup. Details and tests are below. 🧩 1/8
0:15

We’re amazed: AMD now beats Nvidia in inference for Image-to-Video generation. 20% faster and 35% cheaper when using our Higgsfield DoP model. AMD MI300X also has a very easy setup. Details and tests are below. 🧩 1/8

Higgsfield AI 🧩

841,843 просмотров • 1 год назад

[ Comparison Video ] Truth & Inference Series Optimization ▸ Photographer A-Tier Costume – "D.M." Source • •
0:17

[ Comparison Video ] Truth & Inference Series Optimization ▸ Photographer A-Tier Costume – "D.M." Source • •

Identity V | News

167,443 просмотров • 2 месяцев назад

PRIMA.CPP Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
0:17

PRIMA.CPP Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters

AK

48,241 просмотров • 1 год назад