正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

FastMLX: Turn your powerful Mac into an AI home server 🚀 Using my M3 Max (96GB URAM) to run a VLM, streaming responses to my M1 MacBook Air over WiFi.🔥 > pip install -U fastmlx

Prince Canuma

7,187 subscribers

36,558 次观看 • 2 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

LLaVA Llama-3 and Phi-3 now on MLX 🎉🚀 You can now run inference locally on your Mac. pip install -U mlx-vlm I’m getting ~50 tokens on a M3 Max. Model cards 👇🏾

LLaVA Llama-3 and Phi-3 now on MLX 🎉🚀 You can now run inference locally on your Mac. pip install -U mlx-vlm I’m getting ~50 tokens on a M3 Max. Model cards 👇🏾

Prince Canuma

74,448 次观看 • 2 年前

Qwen2.5-VL now on MLX 🚀 You can now run inference or train it locally on your Mac using MLX. > pip install -U mlx-vlm Note: Video support is coming shortly :) Model cards 👇🏾

Qwen2.5-VL now on MLX 🚀 You can now run inference or train it locally on your Mac using MLX. > pip install -U mlx-vlm Note: Video support is coming shortly :) Model cards 👇🏾

Prince Canuma

29,952 次观看 • 1 年前

Ollama can host too: here’s Llama 3.3 70B streaming at ~6.5 tok/s from my M1 Max to my phone. Your laptop is an offline self-sovereign AI server.

Ollama can host too: here’s Llama 3.3 70B streaming at ~6.5 tok/s from my M1 Max to my phone. Your laptop is an offline self-sovereign AI server.

Aaron Ng

53,827 次观看 • 1 年前

Chatterbox Turbo by Resemble AI now on MLX 🚀🎉 You can now run it locally on your Mac and it supports voice cloning and emotion control. I'm getting 3.8x faster than real-time. > pip install -U mlx-audio Model collection 👇🏽

Chatterbox Turbo by Resemble AI now on MLX 🚀🎉 You can now run it locally on your Mac and it supports voice cloning and emotion control. I'm getting 3.8x faster than real-time. > pip install -U mlx-audio Model collection 👇🏽

Prince Canuma

24,953 次观看 • 6 个月前

Still need to do some cable management, but this is a huge upgrade to my setup. I put my M3 MacBook Air on a SVALT dock (heatsink + fan) and thermal throttling is completely gone. Now when I’m home it basically performs like a MacBook Pro 🔥

Still need to do some cable management, but this is a huge upgrade to my setup. I put my M3 MacBook Air on a SVALT dock (heatsink + fan) and thermal throttling is completely gone. Now when I’m home it basically performs like a MacBook Pro 🔥

Fabrizio Rinaldi

351,407 次观看 • 1 年前

Sam 3 by Facebook now on MLX 🚀 Here is a realtime object tracking running on M3 Max 96GB.

Sam 3 by Facebook now on MLX 🚀 Here is a realtime object tracking running on M3 Max 96GB.

Prince Canuma

180,321 次观看 • 3 个月前

Oh my 🤯 By instructing the LLM to answer using the MDC syntax with your Vue components, it brings AI responses to a whole new level! These responses seamlessly integrate into your UI at runtime 😍

Oh my 🤯 By instructing the LLM to answer using the MDC syntax with your Vue components, it brings AI responses to a whole new level! These responses seamlessly integrate into your UI at runtime 😍

Sébastien Chopin

33,273 次观看 • 1 年前

Qwen3-TTS Web UI on Mac! Qwen3-TTS web UI now works on Macs too, thanks to contribution from Pierre Bruno, who is also our Pinokio community mod. Thank you! Just install fresh and it should work, I've confirmed this working on my Macbook M1 Max here

Qwen3-TTS Web UI on Mac! Qwen3-TTS web UI now works on Macs too, thanks to contribution from Pierre Bruno, who is also our Pinokio community mod. Thank you! Just install fresh and it should work, I've confirmed this working on my Macbook M1 Max here

cocktail peanut

50,663 次观看 • 5 个月前

A Python decorator is all you need to deploy AI apps! Beam is an open-source alternative to Modal for deploying serverless AI workloads. Simply pip install beam, add a decorator, and turn any function into a serverless endpoint! 100% open-source.

A Python decorator is all you need to deploy AI apps! Beam is an open-source alternative to Modal for deploying serverless AI workloads. Simply pip install beam, add a decorator, and turn any function into a serverless endpoint! 100% open-source.

Akshay 🚀

40,365 次观看 • 1 年前

llama 3 70b beamed to my phone from my M1 Max ~7.6 tok/s with mlx. your own little gpt-4 at home

llama 3 70b beamed to my phone from my M1 Max ~7.6 tok/s with mlx. your own little gpt-4 at home

Aaron Ng

1,116,956 次观看 • 2 年前

Cool video (sped-up) running Mixtral 8x22B on a M3 Max (h/t PSA since I get this question a lot: asitop is the monitoring tool on the right (pip install asitop) glances is on the bottom (pip install glances)

Cool video (sped-up) running Mixtral 8x22B on a M3 Max (h/t PSA since I get this question a lot: asitop is the monitoring tool on the right (pip install asitop) glances is on the bottom (pip install glances)

Awni Hannun

70,804 次观看 • 2 年前

Llama 3.3 70B streaming at 7.8 tok/s on an M1 Pro to my phone. Not the fastest, but wild that you can serve something this powerful to your whole house without internet.

Llama 3.3 70B streaming at 7.8 tok/s on an M1 Pro to my phone. Not the fastest, but wild that you can serve something this powerful to your whole house without internet.

Aaron Ng

301,000 次观看 • 1 年前

NariLabs Dia-1.6B by Toby Kim now on MLX 🚀 Get started: > pip install -U mlx-audio Model Card 👇🏾

NariLabs Dia-1.6B by Toby Kim now on MLX 🚀 Get started: > pip install -U mlx-audio Model Card 👇🏾

Prince Canuma

24,057 次观看 • 1 年前

How to turn your dishwasher into an air conditioner:

How to turn your dishwasher into an air conditioner:

Steve 🇺🇸

195,736 次观看 • 7 个月前

i'm building an AI soccer coach to improve my shooting using: - roboflow RF-DETR to detect the ball / net / player - mediapipe to record body angles when striking the ball - python to analyze and annotate the video i'll also try adding a VLM into the pipeline for coaching feedback

i'm building an AI soccer coach to improve my shooting using: - roboflow RF-DETR to detect the ball / net / player - mediapipe to record body angles when striking the ball - python to analyze and annotate the video i'll also try adding a VLM into the pipeline for coaching feedback

AA

300,872 次观看 • 1 个月前

Tutorial Time: Run any open-source LLM locally. Now we will run an LLM on your M1/2 Mac. And its fast. All you need is moved to: @lmstudio let's get started. Good to be back. A thread

Tutorial Time: Run any open-source LLM locally. Now we will run an LLM on your M1/2 Mac. And its fast. All you need is moved to: @lmstudio let's get started. Good to be back. A thread

Linus ✦ Ekenstam

915,787 次观看 • 2 年前

AGI at home Running DeepSeek R1 across my 7 M4 Pro Mac Minis and 1 M4 Max MacBook Pro. Total unified memory = 496GB. Uses EXO Labs distributed inference with 4-bit quantization. Next goal is fp8 (requires >700GB)

AGI at home Running DeepSeek R1 across my 7 M4 Pro Mac Minis and 1 M4 Max MacBook Pro. Total unified memory = 496GB. Uses EXO Labs distributed inference with 4-bit quantization. Next goal is fp8 (requires >700GB)

Alex Cheema

1,934,842 次观看 • 1 年前

China has banned VPNs for years. To stop people from using VPNs, Chinese police have been going from door-to-door to force everyone to install a government spyware, the 'anti-fraud' app. ——If the app detects you are trying to install VPNs, it immediately sends an alert to police..then an AI system will immediately freeze your bank account and police will come to your home for further investigation.

China has banned VPNs for years. To stop people from using VPNs, Chinese police have been going from door-to-door to force everyone to install a government spyware, the 'anti-fraud' app. ——If the app detects you are trying to install VPNs, it immediately sends an alert to police..then an AI system will immediately freeze your bank account and police will come to your home for further investigation.

Songpinganq

459,945 次观看 • 9 个月前