正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

LLMs + Elixir: distributed tracing for targeted processes anywhere on the cluster with realtime UI. Idea to shipped, sub 30min:

Chris McCord

23,571 subscribers

12,014 次观看 • 5 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

M4 Mac Mini AI Cluster Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).

M4 Mac Mini AI Cluster Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).

Alex Cheema

3,516,399 次观看 • 1 年前

playing with realtime diffusion ui

playing with realtime diffusion ui

Ryan Stephen

972,922 次观看 • 21 天前

Real-time distributed inference monitoring is live on exo intern home AI cluster It comes with out of the box support for PrometheusMonitoring metrics and Grafana dashboards Helps diagnose performance bottlenecks in your exo cluster

Real-time distributed inference monitoring is live on exo intern home AI cluster It comes with out of the box support for PrometheusMonitoring metrics and Grafana dashboards Helps diagnose performance bottlenecks in your exo cluster

Alex Cheema - e/acc

17,798 次观看 • 1 年前

New UI for AI Prompts already shipped.

New UI for AI Prompts already shipped.

Kevin Kern

48,905 次观看 • 1 年前

Neat realtime VFX trick by TUATARA : combine depth masking with bump offset to project sprites onto geometry while preserving scene depth. Great for fake lighting, UI indicators, hit impacts, and damage overlays—simple idea, tons of mileage. #realtimeVFX #UnrealEngine

Neat realtime VFX trick by TUATARA : combine depth masking with bump offset to project sprites onto geometry while preserving scene depth. Great for fake lighting, UI indicators, hit impacts, and damage overlays—simple idea, tons of mileage. #realtimeVFX #UnrealEngine

GameZone

13,277 次观看 • 10 天前

Elixir is the default gateway for RWA holders to enter DeFi

Elixir is the default gateway for RWA holders to enter DeFi

Elixir

21,340 次观看 • 1 年前

Distributed training on M4 Mac Mini cluster We implemented Google DeepMind DiLoCo on Apple Silicon to train large models with 100-1000x less bandwidth compared to DDP baseline. AI is entering a new era where a distributed network of consumer devices can train large models.

Distributed training on M4 Mac Mini cluster We implemented Google DeepMind DiLoCo on Apple Silicon to train large models with 100-1000x less bandwidth compared to DDP baseline. AI is entering a new era where a distributed network of consumer devices can train large models.

EXO Labs

347,697 次观看 • 1 年前

Check this!! A 100% open-source toolkit to work with LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!

Check this!! A 100% open-source toolkit to work with LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!

Avi Chawla

74,778 次观看 • 1 年前

Pretty sure Kartik just shipped the fastest, easiest way to get on hyperEVM anywhere in crypto. (from your Farcaster wallet)

Pretty sure Kartik just shipped the fastest, easiest way to get on hyperEVM anywhere in crypto. (from your Farcaster wallet)

horsefacts

14,315 次观看 • 1 年前

shipped this! lots more I wanted to do with color selection and ui, but its in a good place.

shipped this! lots more I wanted to do with color selection and ui, but its in a good place.

Lyle Klyne

36,432 次观看 • 1 年前

oh stop it with Vercel hate. - $750K paid for 15 bounties - shipped package to fix in 1 command - frequent updates with full transparency - they even made an *entire UI* to patch React2Shell come on. what other company does this?!

oh stop it with Vercel hate. - $750K paid for 15 bounties - shipped package to fix in 1 command - frequent updates with full transparency - they even made an entire UI to patch React2Shell come on. what other company does this?!

Dan ⚡️

59,937 次观看 • 7 个月前

Running DeepSeek-V3 on M4 Mac Mini AI Cluster 671B MoE model distributed across 8 M4 Pro 64GB Mac Minis. Apple Silicon with unified memory is a great fit for MoE.

Running DeepSeek-V3 on M4 Mac Mini AI Cluster 671B MoE model distributed across 8 M4 Pro 64GB Mac Minis. Apple Silicon with unified memory is a great fit for MoE.

EXO Labs

719,293 次观看 • 1 年前

You asked, we shipped 🚀 Image cropper components are now available on Origin UI!

You asked, we shipped 🚀 Image cropper components are now available on Origin UI!

Pasquale Vitiello

42,702 次观看 • 1 年前

The IRGC also targeted Tel Aviv with a ballistic missile carrying a cluster warhead, with submunitions seen dispersing and descending through the sky.

The IRGC also targeted Tel Aviv with a ballistic missile carrying a cluster warhead, with submunitions seen dispersing and descending through the sky.

OSINTWarfare

18,396 次观看 • 3 个月前

Roll away the pain with ease! 🌿 Perfect for on-the-go muscle care, our #CBD Pain Relief Roll-On delivers targeted relief anytime, anywhere. 💚Shop NOW ✨ ✨ #SaraJayCBD #PainRelief

Roll away the pain with ease! 🌿 Perfect for on-the-go muscle care, our #CBD Pain Relief Roll-On delivers targeted relief anytime, anywhere. 💚Shop NOW ✨ ✨ #SaraJayCBD #PainRelief

Bare Self Care

35,572 次观看 • 1 年前

.KeenTools has shipped its first major release of the year featuring an overhauled FaceBuilder for Blender 🔶 with a revised workflow, updated UI and controls, and the ability to capture face identity from photos with non-neutral expressions. More: #b3d

.KeenTools has shipped its first major release of the year featuring an overhauled FaceBuilder for Blender 🔶 with a revised workflow, updated UI and controls, and the ability to capture face identity from photos with non-neutral expressions. More: #b3d

80 LEVEL

116,563 次观看 • 2 年前

"It's on my todo to build my own stack of apple minis and run Llama on my own little cluster on my desk." - Garry Tan Quick AI homelab tutorial: - Install EXO Labs on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for faster/more reliable results, connected over Thunderbolt/Ethernet. Devices will auto-discover each other and auto-shard the LLMs. - Now you can chat to your cluster with your preferred LLM GUI (the tiny corp tinychat ships with exo)

"It's on my todo to build my own stack of apple minis and run Llama on my own little cluster on my desk." - Garry Tan Quick AI homelab tutorial: - Install EXO Labs on each mini (open source, steps in README) - Make sure all the minis are on the same WiFi network or for faster/more reliable results, connected over Thunderbolt/Ethernet. Devices will auto-discover each other and auto-shard the LLMs. - Now you can chat to your cluster with your preferred LLM GUI (the tiny corp tinychat ships with exo)

Alex Cheema - e/acc

243,248 次观看 • 1 年前

Earlier, an Iranian ballistic missile equipped with a cluster warhead targeted central Israel, with submunitions seen dispersing and falling through the sky.

Earlier, an Iranian ballistic missile equipped with a cluster warhead targeted central Israel, with submunitions seen dispersing and falling through the sky.

OSINTWarfare

18,785 次观看 • 3 个月前

Thank you so much Caelum_VT😈💙 for letting me build your PC! Ready to be packaged and shipped! Cyberlazu Help contribute and came up with the idea 💛

Thank you so much Caelum_VT😈💙 for letting me build your PC! Ready to be packaged and shipped! Cyberlazu Help contribute and came up with the idea 💛

Moxxie 💛

19,331 次观看 • 2 年前