Loading video...

Video Failed to Load

Go Home

DeepSeek-R1-0528-Qwen3-8B running on iPhone 16 with MLX

Hesamation's profile picture

ℏεsam

83,714 subscribers

17,287 views • 1 year ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

DeepSeek R1 distilled to Qwen 1.5B easily runs on my iPhone 16 with MLX swift. Here's the 4-bit model reasoning entirely on device at almost 60 toks/sec:
0:19

DeepSeek R1 distilled to Qwen 1.5B easily runs on my iPhone 16 with MLX swift. Here's the 4-bit model reasoning entirely on device at almost 60 toks/sec:

Awni Hannun

1,139,656 views • 1 year ago

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible
0:17

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible

Adrien Grondin

493,561 views • 10 months ago

Our Deepseek-R1-0528 is also live on Hugging Face!
0:15

Our Deepseek-R1-0528 is also live on Hugging Face!

Novita AI

25,967 views • 1 year ago

DeepSeek-R1-0528 is live on AkashChat. This open source update to DeepSeek-R1 approaches the performance of OpenAI's o3 on several benchmarks.
0:17

DeepSeek-R1-0528 is live on AkashChat. This open source update to DeepSeek-R1 approaches the performance of OpenAI's o3 on several benchmarks.

Akash Network

12,130 views • 1 year ago

Running DeepSeek R1 on my desk Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run the full (671B, 8-bit) DeepSeek R1 distributed across 2 M3 Ultra 512GB Mac Studios (1TB total Unified Memory). Runs at 11 tok/sec. Theoretical max is ~20 tok/sec.
0:14

Running DeepSeek R1 on my desk Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run the full (671B, 8-bit) DeepSeek R1 distributed across 2 M3 Ultra 512GB Mac Studios (1TB total Unified Memory). Runs at 11 tok/sec. Theoretical max is ~20 tok/sec.

Alex Cheema

992,865 views • 1 year ago

Google’s Gemma 4 E2B running on-device on iPhone 17 Pro Gemma 4 is built from the same research as Gemini 3, has image understanding capabilities and can reason if needed Running at ~40tk/s with MLX optimized for Apple Silicon
0:12

Google’s Gemma 4 E2B running on-device on iPhone 17 Pro Gemma 4 is built from the same research as Gemini 3, has image understanding capabilities and can reason if needed Running at ~40tk/s with MLX optimized for Apple Silicon

Adrien Grondin

1,044,994 views • 4 months ago

MLX Swift LLM example works with: - Mistral / Llama - Phi-2 - Qwen 1.5 - Starcoder 2 Quick-start: Qwen 1.5 0.5B runs pretty fast in 16-bit on my iPhone 14, no quantization needed:
0:17

MLX Swift LLM example works with: - Mistral / Llama - Phi-2 - Qwen 1.5 - Starcoder 2 Quick-start: Qwen 1.5 0.5B runs pretty fast in 16-bit on my iPhone 14, no quantization needed:

Awni Hannun

30,441 views • 2 years ago

Playing with Qwen3-TTS is and MLX-Audio locally on Mac Studio M3 Ultra 🔥 Amazing model by Qwen and great work by Prince Canuma bringing this magic to MLX! Tuning the voice with instructions feels like magic! Command and prompts to run it are in the video.
0:17

Playing with Qwen3-TTS is and MLX-Audio locally on Mac Studio M3 Ultra 🔥 Amazing model by Qwen and great work by Prince Canuma bringing this magic to MLX! Tuning the voice with instructions feels like magic! Command and prompts to run it are in the video.

Ivan Fioravanti ᯅ

35,720 views • 7 months ago

Another demo of the iPhone 17 Pro’s on-device LLM performance This time with Ling mini 2.0 by InclusionAI, a 16B MoE model with 1.4B active parameters running at ~120tk/s Thanks to Awni Hannun for the MLX DWQ 2-bit quants
0:11

Another demo of the iPhone 17 Pro’s on-device LLM performance This time with Ling mini 2.0 by InclusionAI, a 16B MoE model with 1.4B active parameters running at ~120tk/s Thanks to Awni Hannun for the MLX DWQ 2-bit quants

Adrien Grondin

46,205 views • 11 months ago

DeepSeek DeepSeek is now live on Heurist. Open source AI just reached new heights. Access DeepSeek-R1 and DeepSeek-V3 for smarter inference at a fraction of cost. Try it via Heurist API or explore on Pondera.
0:19

DeepSeek DeepSeek is now live on Heurist. Open source AI just reached new heights. Access DeepSeek-R1 and DeepSeek-V3 for smarter inference at a fraction of cost. Try it via Heurist API or explore on Pondera.

Heurist

25,671 views • 1 year ago

fullmoon v1.2.0 is now available on the App Store so you can reason free, locally, and privately on all of your devices - adds DeepSeek-R1-Distill-Qwen-1.5B - completely free and open source - works on iPhone, iPad, Mac, and Vision
0:12

fullmoon v1.2.0 is now available on the App Store so you can reason free, locally, and privately on all of your devices - adds DeepSeek-R1-Distill-Qwen-1.5B - completely free and open source - works on iPhone, iPad, Mac, and Vision

fullmoon

36,279 views • 1 year ago

Quick demo of LFM 2.5 VL 1.6B model by Liquid AI that I recently added to Locally AI - Local AI Chat Running locally on iPhone 17 Pro at ~90tk/s with MLX Small vision-language models are improving fast
0:10

Quick demo of LFM 2.5 VL 1.6B model by Liquid AI that I recently added to Locally AI - Local AI Chat Running locally on iPhone 17 Pro at ~90tk/s with MLX Small vision-language models are improving fast

Adrien Grondin

32,556 views • 7 months ago

Mac Studio M2 Ultra is best Apple Silicon ever (so far!) 🔥75 t/s and 0 throttling 🔥 Even after 20 mins of uninterrupted token generation with Apple MLX and mlx-community/Meta-Llama-3.1-8B-Instruct-8bit model!
0:13

Mac Studio M2 Ultra is best Apple Silicon ever (so far!) 🔥75 t/s and 0 throttling 🔥 Even after 20 mins of uninterrupted token generation with Apple MLX and mlx-community/Meta-Llama-3.1-8B-Instruct-8bit model!

Ivan Fioravanti ᯅ

11,041 views • 1 year ago

Llama 3.2 1B in 4-bit runs at ~60 toks/sec with MLX Swift on my iPhone 15 pro. It's quite good and easily runs on-device:
0:17

Llama 3.2 1B in 4-bit runs at ~60 toks/sec with MLX Swift on my iPhone 15 pro. It's quite good and easily runs on-device:

Awni Hannun

492,428 views • 1 year ago

DeepSeek R1 on Groq is insanely fast. Thought for 0 seconds hahaha ⚡ * video isn't sped up
0:10

DeepSeek R1 on Groq is insanely fast. Thought for 0 seconds hahaha ⚡ * video isn't sped up

Daniel Nguyen

543,424 views • 1 year ago

GLM-4.7 Flash by Z.ai running on M3 Ultra using MLX! 4bit at 81 toks/s 🔥 8bit at 64 toks/s 🔥 (video below) Model converted from transformers to MLX on the fly with Codex + GPT-5.2 HIgh!
0:19

GLM-4.7 Flash by Z.ai running on M3 Ultra using MLX! 4bit at 81 toks/s 🔥 8bit at 64 toks/s 🔥 (video below) Model converted from transformers to MLX on the fly with Codex + GPT-5.2 HIgh!

Ivan Fioravanti ᯅ

75,425 views • 7 months ago

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework
0:14

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework

Adrien Grondin

351,153 views • 4 months ago