Loading video...

Video Failed to Load

Go Home

LLMs + Elixir: distributed tracing for targeted processes anywhere on the cluster with realtime UI. Idea to shipped, sub 30min:

chris_mccord's profile picture

Chris McCord

23,571 subscribers

12,014 views • 5 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

M4 Mac Mini AI Cluster Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).
0:19

M4 Mac Mini AI Cluster Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).

Alex Cheema

3,516,399 views • 1 year ago

playing with realtime diffusion ui
0:14

playing with realtime diffusion ui

Ryan Stephen

972,279 views • 19 days ago

Real-time distributed inference monitoring is live on exo intern home AI cluster It comes with out of the box support for PrometheusMonitoring metrics and Grafana dashboards Helps diagnose performance bottlenecks in your exo cluster
0:13

Real-time distributed inference monitoring is live on exo intern home AI cluster It comes with out of the box support for PrometheusMonitoring metrics and Grafana dashboards Helps diagnose performance bottlenecks in your exo cluster

Alex Cheema - e/acc

17,798 views • 1 year ago

New UI for AI Prompts already shipped.
0:15

New UI for AI Prompts already shipped.

Kevin Kern

48,905 views • 1 year ago

Neat realtime VFX trick by TUATARA : combine depth masking with bump offset to project sprites onto geometry while preserving scene depth. Great for fake lighting, UI indicators, hit impacts, and damage overlays—simple idea, tons of mileage. #realtimeVFX #UnrealEngine
0:10

Neat realtime VFX trick by TUATARA : combine depth masking with bump offset to project sprites onto geometry while preserving scene depth. Great for fake lighting, UI indicators, hit impacts, and damage overlays—simple idea, tons of mileage. #realtimeVFX #UnrealEngine

GameZone

13,207 views • 8 days ago

Elixir is the default gateway for RWA holders to enter DeFi
0:19

Elixir is the default gateway for RWA holders to enter DeFi

Elixir

21,340 views • 1 year ago

Distributed training on M4 Mac Mini cluster We implemented Google DeepMind DiLoCo on Apple Silicon to train large models with 100-1000x less bandwidth compared to DDP baseline. AI is entering a new era where a distributed network of consumer devices can train large models.
0:16

Distributed training on M4 Mac Mini cluster We implemented Google DeepMind DiLoCo on Apple Silicon to train large models with 100-1000x less bandwidth compared to DDP baseline. AI is entering a new era where a distributed network of consumer devices can train large models.

EXO Labs

347,670 views • 1 year ago

Pretty sure Kartik just shipped the fastest, easiest way to get on hyperEVM anywhere in crypto. (from your Farcaster wallet)
0:12

Pretty sure Kartik just shipped the fastest, easiest way to get on hyperEVM anywhere in crypto. (from your Farcaster wallet)

horsefacts

14,315 views • 1 year ago

Check this!! A 100% open-source toolkit to work with LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!
0:17

Check this!! A 100% open-source toolkit to work with LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!

Avi Chawla

74,778 views • 1 year ago

shipped this! lots more I wanted to do with color selection and ui, but its in a good place.
0:16

shipped this! lots more I wanted to do with color selection and ui, but its in a good place.

Lyle Klyne

36,427 views • 1 year ago

oh stop it with Vercel hate. - $750K paid for 15 bounties - shipped package to fix in 1 command - frequent updates with full transparency - they even made an *entire UI* to patch React2Shell come on. what other company does this?!
0:13

oh stop it with Vercel hate. - $750K paid for 15 bounties - shipped package to fix in 1 command - frequent updates with full transparency - they even made an *entire UI* to patch React2Shell come on. what other company does this?!

Dan ⚡️

59,937 views • 6 months ago

Running DeepSeek-V3 on M4 Mac Mini AI Cluster 671B MoE model distributed across 8 M4 Pro 64GB Mac Minis. Apple Silicon with unified memory is a great fit for MoE.
0:18

Running DeepSeek-V3 on M4 Mac Mini AI Cluster 671B MoE model distributed across 8 M4 Pro 64GB Mac Minis. Apple Silicon with unified memory is a great fit for MoE.

EXO Labs

719,293 views • 1 year ago

You asked, we shipped 🚀 Image cropper components are now available on Origin UI!
0:12

You asked, we shipped 🚀 Image cropper components are now available on Origin UI!

Pasquale Vitiello

42,702 views • 1 year ago

The IRGC also targeted Tel Aviv with a ballistic missile carrying a cluster warhead, with submunitions seen dispersing and descending through the sky.
0:09

The IRGC also targeted Tel Aviv with a ballistic missile carrying a cluster warhead, with submunitions seen dispersing and descending through the sky.

OSINTWarfare

18,396 views • 3 months ago

Roll away the pain with ease! 🌿 Perfect for on-the-go muscle care, our #CBD Pain Relief Roll-On delivers targeted relief anytime, anywhere. 💚Shop NOW ✨ ✨ #SaraJayCBD #PainRelief
0:18

Roll away the pain with ease! 🌿 Perfect for on-the-go muscle care, our #CBD Pain Relief Roll-On delivers targeted relief anytime, anywhere. 💚Shop NOW ✨ ✨ #SaraJayCBD #PainRelief

Bare Self Care

35,572 views • 1 year ago

.KeenTools has shipped its first major release of the year featuring an overhauled FaceBuilder for Blender 🔶 with a revised workflow, updated UI and controls, and the ability to capture face identity from photos with non-neutral expressions. More: #b3d
0:18

.KeenTools has shipped its first major release of the year featuring an overhauled FaceBuilder for Blender 🔶 with a revised workflow, updated UI and controls, and the ability to capture face identity from photos with non-neutral expressions. More: #b3d

80 LEVEL

116,563 views • 2 years ago

"It's on my todo to build my own stack of apple minis and run Llama on my own little cluster on my desk." - Garry Tan Quick AI homelab tutorial: - Install EXO Labs on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for faster/more reliable results, connected over Thunderbolt/Ethernet. Devices will auto-discover each other and auto-shard the LLMs. - Now you can chat to your cluster with your preferred LLM GUI (the tiny corp tinychat ships with exo)
0:12

"It's on my todo to build my own stack of apple minis and run Llama on my own little cluster on my desk." - Garry Tan Quick AI homelab tutorial: - Install EXO Labs on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for faster/more reliable results, connected over Thunderbolt/Ethernet. Devices will auto-discover each other and auto-shard the LLMs. - Now you can chat to your cluster with your preferred LLM GUI (the tiny corp tinychat ships with exo)

Alex Cheema - e/acc

243,248 views • 1 year ago

Earlier, an Iranian ballistic missile equipped with a cluster warhead targeted central Israel, with submunitions seen dispersing and falling through the sky.
0:16

Earlier, an Iranian ballistic missile equipped with a cluster warhead targeted central Israel, with submunitions seen dispersing and falling through the sky.

OSINTWarfare

18,785 views • 3 months ago

Thank you so much Caelum_VT😈💙 for letting me build your PC! Ready to be packaged and shipped! Cyberlazu Help contribute and came up with the idea 💛
0:14

Thank you so much Caelum_VT😈💙 for letting me build your PC! Ready to be packaged and shipped! Cyberlazu Help contribute and came up with the idea 💛

Moxxie 💛

19,331 views • 2 years ago