Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

LLMs + Elixir: distributed tracing for targeted processes anywhere on the cluster with realtime UI. Idea to shipped, sub 30min:

chris_mccord's profile picture

Chris McCord

23,571 subscribers

12,014 Aufrufe • vor 4 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

M4 Mac Mini AI Cluster Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).
0:19

M4 Mac Mini AI Cluster Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).

Alex Cheema

3,515,929 Aufrufe • vor 1 Jahr

Real-time distributed inference monitoring is live on exo intern home AI cluster It comes with out of the box support for PrometheusMonitoring metrics and Grafana dashboards Helps diagnose performance bottlenecks in your exo cluster
0:13

Real-time distributed inference monitoring is live on exo intern home AI cluster It comes with out of the box support for PrometheusMonitoring metrics and Grafana dashboards Helps diagnose performance bottlenecks in your exo cluster

Alex Cheema - e/acc

17,798 Aufrufe • vor 1 Jahr

New UI for AI Prompts already shipped.
0:15

New UI for AI Prompts already shipped.

Kevin Kern

48,905 Aufrufe • vor 1 Jahr

Elixir is the default gateway for RWA holders to enter DeFi
0:19

Elixir is the default gateway for RWA holders to enter DeFi

Elixir

20,922 Aufrufe • vor 1 Jahr

Distributed training on M4 Mac Mini cluster We implemented Google DeepMind DiLoCo on Apple Silicon to train large models with 100-1000x less bandwidth compared to DDP baseline. AI is entering a new era where a distributed network of consumer devices can train large models.
0:16

Distributed training on M4 Mac Mini cluster We implemented Google DeepMind DiLoCo on Apple Silicon to train large models with 100-1000x less bandwidth compared to DDP baseline. AI is entering a new era where a distributed network of consumer devices can train large models.

EXO Labs

347,655 Aufrufe • vor 1 Jahr

Pretty sure Kartik just shipped the fastest, easiest way to get on hyperEVM anywhere in crypto. (from your Farcaster wallet)
0:12

Pretty sure Kartik just shipped the fastest, easiest way to get on hyperEVM anywhere in crypto. (from your Farcaster wallet)

horsefacts

14,255 Aufrufe • vor 1 Jahr

Check this!! A 100% open-source toolkit to work with LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!
0:17

Check this!! A 100% open-source toolkit to work with LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!

Avi Chawla

74,778 Aufrufe • vor 1 Jahr

shipped this! lots more I wanted to do with color selection and ui, but its in a good place.
0:16

shipped this! lots more I wanted to do with color selection and ui, but its in a good place.

Lyle Klyne

35,568 Aufrufe • vor 1 Jahr

oh stop it with Vercel hate. - $750K paid for 15 bounties - shipped package to fix in 1 command - frequent updates with full transparency - they even made an *entire UI* to patch React2Shell come on. what other company does this?!
0:13

oh stop it with Vercel hate. - $750K paid for 15 bounties - shipped package to fix in 1 command - frequent updates with full transparency - they even made an *entire UI* to patch React2Shell come on. what other company does this?!

Dan ⚡️

59,937 Aufrufe • vor 6 Monaten

Running DeepSeek-V3 on M4 Mac Mini AI Cluster 671B MoE model distributed across 8 M4 Pro 64GB Mac Minis. Apple Silicon with unified memory is a great fit for MoE.
0:18

Running DeepSeek-V3 on M4 Mac Mini AI Cluster 671B MoE model distributed across 8 M4 Pro 64GB Mac Minis. Apple Silicon with unified memory is a great fit for MoE.

EXO Labs

719,005 Aufrufe • vor 1 Jahr

You asked, we shipped 🚀 Image cropper components are now available on Origin UI!
0:12

You asked, we shipped 🚀 Image cropper components are now available on Origin UI!

Pasquale Vitiello

42,690 Aufrufe • vor 1 Jahr

The IRGC also targeted Tel Aviv with a ballistic missile carrying a cluster warhead, with submunitions seen dispersing and descending through the sky.
0:09

The IRGC also targeted Tel Aviv with a ballistic missile carrying a cluster warhead, with submunitions seen dispersing and descending through the sky.

OSINTWarfare

18,396 Aufrufe • vor 2 Monaten

Roll away the pain with ease! 🌿 Perfect for on-the-go muscle care, our #CBD Pain Relief Roll-On delivers targeted relief anytime, anywhere. 💚Shop NOW ✨ ✨ #SaraJayCBD #PainRelief
0:18

Roll away the pain with ease! 🌿 Perfect for on-the-go muscle care, our #CBD Pain Relief Roll-On delivers targeted relief anytime, anywhere. 💚Shop NOW ✨ ✨ #SaraJayCBD #PainRelief

Bare Self Care

35,572 Aufrufe • vor 1 Jahr

Earlier, an Iranian ballistic missile equipped with a cluster warhead targeted central Israel, with submunitions seen dispersing and falling through the sky.
0:16

Earlier, an Iranian ballistic missile equipped with a cluster warhead targeted central Israel, with submunitions seen dispersing and falling through the sky.

OSINTWarfare

18,785 Aufrufe • vor 2 Monaten

.KeenTools has shipped its first major release of the year featuring an overhauled FaceBuilder for Blender 🔶 with a revised workflow, updated UI and controls, and the ability to capture face identity from photos with non-neutral expressions. More: #b3d
0:18

.KeenTools has shipped its first major release of the year featuring an overhauled FaceBuilder for Blender 🔶 with a revised workflow, updated UI and controls, and the ability to capture face identity from photos with non-neutral expressions. More: #b3d

80 LEVEL

116,563 Aufrufe • vor 2 Jahren

"It's on my todo to build my own stack of apple minis and run Llama on my own little cluster on my desk." - Garry Tan Quick AI homelab tutorial: - Install EXO Labs on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for faster/more reliable results, connected over Thunderbolt/Ethernet. Devices will auto-discover each other and auto-shard the LLMs. - Now you can chat to your cluster with your preferred LLM GUI (the tiny corp tinychat ships with exo)
0:12

"It's on my todo to build my own stack of apple minis and run Llama on my own little cluster on my desk." - Garry Tan Quick AI homelab tutorial: - Install EXO Labs on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for faster/more reliable results, connected over Thunderbolt/Ethernet. Devices will auto-discover each other and auto-shard the LLMs. - Now you can chat to your cluster with your preferred LLM GUI (the tiny corp tinychat ships with exo)

Alex Cheema - e/acc

243,248 Aufrufe • vor 1 Jahr

Thank you so much Caelum_VT😈💙 for letting me build your PC! Ready to be packaged and shipped! Cyberlazu Help contribute and came up with the idea 💛
0:14

Thank you so much Caelum_VT😈💙 for letting me build your PC! Ready to be packaged and shipped! Cyberlazu Help contribute and came up with the idea 💛

Moxxie 💛

19,331 Aufrufe • vor 2 Jahren

Russian blogger “Zhivoff” admires the Ukrainian distributed digital system of 3D printing for military components. “Our enemy has created a unique distributed production cluster in which there is a place for every household in Ukraine. By the way, this is real digitalization. 1/
0:12

Russian blogger “Zhivoff” admires the Ukrainian distributed digital system of 3D printing for military components. “Our enemy has created a unique distributed production cluster in which there is a place for every household in Ukraine. By the way, this is real digitalization. 1/

Roy🇨🇦

281,133 Aufrufe • vor 1 Jahr