Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

LLMs + Elixir: distributed tracing for targeted processes anywhere on the cluster with realtime UI. Idea to shipped, sub 30min:

chris_mccord's profile picture

Chris McCord

23,571 subscribers

12,014 görüntüleme • 5 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

M4 Mac Mini AI Cluster Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).
0:19

M4 Mac Mini AI Cluster Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).

Alex Cheema

3,516,274 görüntüleme • 1 yıl önce

playing with realtime diffusion ui
0:14

playing with realtime diffusion ui

Ryan Stephen

970,236 görüntüleme • 13 gün önce

Real-time distributed inference monitoring is live on exo intern home AI cluster It comes with out of the box support for PrometheusMonitoring metrics and Grafana dashboards Helps diagnose performance bottlenecks in your exo cluster
0:13

Real-time distributed inference monitoring is live on exo intern home AI cluster It comes with out of the box support for PrometheusMonitoring metrics and Grafana dashboards Helps diagnose performance bottlenecks in your exo cluster

Alex Cheema - e/acc

17,798 görüntüleme • 1 yıl önce

New UI for AI Prompts already shipped.
0:15

New UI for AI Prompts already shipped.

Kevin Kern

48,905 görüntüleme • 1 yıl önce

Elixir is the default gateway for RWA holders to enter DeFi
0:19

Elixir is the default gateway for RWA holders to enter DeFi

Elixir

21,340 görüntüleme • 1 yıl önce

Distributed training on M4 Mac Mini cluster We implemented Google DeepMind DiLoCo on Apple Silicon to train large models with 100-1000x less bandwidth compared to DDP baseline. AI is entering a new era where a distributed network of consumer devices can train large models.
0:16

Distributed training on M4 Mac Mini cluster We implemented Google DeepMind DiLoCo on Apple Silicon to train large models with 100-1000x less bandwidth compared to DDP baseline. AI is entering a new era where a distributed network of consumer devices can train large models.

EXO Labs

347,670 görüntüleme • 1 yıl önce

Pretty sure Kartik just shipped the fastest, easiest way to get on hyperEVM anywhere in crypto. (from your Farcaster wallet)
0:12

Pretty sure Kartik just shipped the fastest, easiest way to get on hyperEVM anywhere in crypto. (from your Farcaster wallet)

horsefacts

14,315 görüntüleme • 1 yıl önce

Check this!! A 100% open-source toolkit to work with LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!
0:17

Check this!! A 100% open-source toolkit to work with LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!

Avi Chawla

74,778 görüntüleme • 1 yıl önce

shipped this! lots more I wanted to do with color selection and ui, but its in a good place.
0:16

shipped this! lots more I wanted to do with color selection and ui, but its in a good place.

Lyle Klyne

36,427 görüntüleme • 1 yıl önce

Running DeepSeek-V3 on M4 Mac Mini AI Cluster 671B MoE model distributed across 8 M4 Pro 64GB Mac Minis. Apple Silicon with unified memory is a great fit for MoE.
0:18

Running DeepSeek-V3 on M4 Mac Mini AI Cluster 671B MoE model distributed across 8 M4 Pro 64GB Mac Minis. Apple Silicon with unified memory is a great fit for MoE.

EXO Labs

719,293 görüntüleme • 1 yıl önce

oh stop it with Vercel hate. - $750K paid for 15 bounties - shipped package to fix in 1 command - frequent updates with full transparency - they even made an *entire UI* to patch React2Shell come on. what other company does this?!
0:13

oh stop it with Vercel hate. - $750K paid for 15 bounties - shipped package to fix in 1 command - frequent updates with full transparency - they even made an *entire UI* to patch React2Shell come on. what other company does this?!

Dan ⚡️

59,937 görüntüleme • 6 ay önce

You asked, we shipped 🚀 Image cropper components are now available on Origin UI!
0:12

You asked, we shipped 🚀 Image cropper components are now available on Origin UI!

Pasquale Vitiello

42,702 görüntüleme • 1 yıl önce

The IRGC also targeted Tel Aviv with a ballistic missile carrying a cluster warhead, with submunitions seen dispersing and descending through the sky.
0:09

The IRGC also targeted Tel Aviv with a ballistic missile carrying a cluster warhead, with submunitions seen dispersing and descending through the sky.

OSINTWarfare

18,396 görüntüleme • 2 ay önce

Roll away the pain with ease! 🌿 Perfect for on-the-go muscle care, our #CBD Pain Relief Roll-On delivers targeted relief anytime, anywhere. 💚Shop NOW ✨ ✨ #SaraJayCBD #PainRelief
0:18

Roll away the pain with ease! 🌿 Perfect for on-the-go muscle care, our #CBD Pain Relief Roll-On delivers targeted relief anytime, anywhere. 💚Shop NOW ✨ ✨ #SaraJayCBD #PainRelief

Bare Self Care

35,572 görüntüleme • 1 yıl önce

Earlier, an Iranian ballistic missile equipped with a cluster warhead targeted central Israel, with submunitions seen dispersing and falling through the sky.
0:16

Earlier, an Iranian ballistic missile equipped with a cluster warhead targeted central Israel, with submunitions seen dispersing and falling through the sky.

OSINTWarfare

18,785 görüntüleme • 3 ay önce

"It's on my todo to build my own stack of apple minis and run Llama on my own little cluster on my desk." - Garry Tan Quick AI homelab tutorial: - Install EXO Labs on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for faster/more reliable results, connected over Thunderbolt/Ethernet. Devices will auto-discover each other and auto-shard the LLMs. - Now you can chat to your cluster with your preferred LLM GUI (the tiny corp tinychat ships with exo)
0:12

"It's on my todo to build my own stack of apple minis and run Llama on my own little cluster on my desk." - Garry Tan Quick AI homelab tutorial: - Install EXO Labs on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for faster/more reliable results, connected over Thunderbolt/Ethernet. Devices will auto-discover each other and auto-shard the LLMs. - Now you can chat to your cluster with your preferred LLM GUI (the tiny corp tinychat ships with exo)

Alex Cheema - e/acc

243,248 görüntüleme • 1 yıl önce

.KeenTools has shipped its first major release of the year featuring an overhauled FaceBuilder for Blender 🔶 with a revised workflow, updated UI and controls, and the ability to capture face identity from photos with non-neutral expressions. More: #b3d
0:18

.KeenTools has shipped its first major release of the year featuring an overhauled FaceBuilder for Blender 🔶 with a revised workflow, updated UI and controls, and the ability to capture face identity from photos with non-neutral expressions. More: #b3d

80 LEVEL

116,563 görüntüleme • 2 yıl önce

Thank you so much Caelum_VT😈💙 for letting me build your PC! Ready to be packaged and shipped! Cyberlazu Help contribute and came up with the idea 💛
0:14

Thank you so much Caelum_VT😈💙 for letting me build your PC! Ready to be packaged and shipped! Cyberlazu Help contribute and came up with the idea 💛

Moxxie 💛

19,331 görüntüleme • 2 yıl önce