Loading video...

Video Failed to Load

Go Home

Using Generable with MLX Swift! 🤩

rudrank's profile picture

Rudrank Riyam

14,910 subscribers

14,077 views • 9 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible
0:17

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible

Adrien Grondin

493,418 views • 8 months ago

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework
0:14

Google's Gemma 4 26B A4B running on MacBook Pro M5 Max 100% native Swift Achieving over 100tk/s with Apple MLX framework

Adrien Grondin

350,222 views • 1 month ago

Qwen2.5-VL now on MLX 🚀 You can now run inference or train it locally on your Mac using MLX. > pip install -U mlx-vlm Note: Video support is coming shortly :) Model cards 👇🏾
0:18

Qwen2.5-VL now on MLX 🚀 You can now run inference or train it locally on your Mac using MLX. > pip install -U mlx-vlm Note: Video support is coming shortly :) Model cards 👇🏾

Prince Canuma

29,952 views • 1 year ago

Helium 2B running locally on an iPhone 16 Pro at 28 tok/s, faster than you can read, all thanks to mlx-swift with q4 quantization!
0:13

Helium 2B running locally on an iPhone 16 Pro at 28 tok/s, faster than you can read, all thanks to mlx-swift with q4 quantization!

kyutai

59,240 views • 1 year ago

Llama 3.2 1B in 4-bit runs at ~60 toks/sec with MLX Swift on my iPhone 15 pro. It's quite good and easily runs on-device:
0:17

Llama 3.2 1B in 4-bit runs at ~60 toks/sec with MLX Swift on my iPhone 15 pro. It's quite good and easily runs on-device:

Awni Hannun

492,305 views • 1 year ago

GLM-4.7 Flash by Z.ai running on M3 Ultra using MLX! 4bit at 81 toks/s 🔥 8bit at 64 toks/s 🔥 (video below) Model converted from transformers to MLX on the fly with Codex + GPT-5.2 HIgh!
0:19

GLM-4.7 Flash by Z.ai running on M3 Ultra using MLX! 4bit at 81 toks/s 🔥 8bit at 64 toks/s 🔥 (video below) Model converted from transformers to MLX on the fly with Codex + GPT-5.2 HIgh!

Ivan Fioravanti ᯅ

75,425 views • 4 months ago

DeepSeek R1 distilled to Qwen 1.5B easily runs on my iPhone 16 with MLX swift. Here's the 4-bit model reasoning entirely on device at almost 60 toks/sec:
0:19

DeepSeek R1 distilled to Qwen 1.5B easily runs on my iPhone 16 with MLX swift. Here's the 4-bit model reasoning entirely on device at almost 60 toks/sec:

Awni Hannun

1,139,656 views • 1 year ago

MLX Swift LLM example works with: - Mistral / Llama - Phi-2 - Qwen 1.5 - Starcoder 2 Quick-start: Qwen 1.5 0.5B runs pretty fast in 16-bit on my iPhone 14, no quantization needed:
0:17

MLX Swift LLM example works with: - Mistral / Llama - Phi-2 - Qwen 1.5 - Starcoder 2 Quick-start: Qwen 1.5 0.5B runs pretty fast in 16-bit on my iPhone 14, no quantization needed:

Awni Hannun

30,441 views • 2 years ago

Today I'm launching a very early release of MLX Model Manager ( A Swift package for quickly and easily adding LLM/VLMs with just a couple of lines of code into your MacOS/iOS applications for local and private inferencing. This is built on the amazing work of the MLX team & what they have done with MLX Model Manager unifies the work they have done with MLXLLM as well as MLXVLM into one package with added abstractions to simplify the usage. I've also added support for Google's new Paligemma2 Vision Model ( You can see a demonstration in the video below! Huge shoutout to Awni Hannun for the creation of MLX, David Koski on leading the charge for MLXVLM and Prince Canuma for the creation of MLX-VLM. Three massive pillars in the MLX community among many others.
0:11

Today I'm launching a very early release of MLX Model Manager ( A Swift package for quickly and easily adding LLM/VLMs with just a couple of lines of code into your MacOS/iOS applications for local and private inferencing. This is built on the amazing work of the MLX team & what they have done with MLX Model Manager unifies the work they have done with MLXLLM as well as MLXVLM into one package with added abstractions to simplify the usage. I've also added support for Google's new Paligemma2 Vision Model ( You can see a demonstration in the video below! Huge shoutout to Awni Hannun for the creation of MLX, David Koski on leading the charge for MLXVLM and Prince Canuma for the creation of MLX-VLM. Three massive pillars in the MLX community among many others.

Kunal Batra

104,815 views • 1 year ago

chat app with the new mlx foundation models
0:15

chat app with the new mlx foundation models

xavier

58,451 views • 1 year ago

Running Kimi K2.5 on my desk. Runs at 24 tok/sec with 2 x 512GB M3 Ultra Mac Studios connected with Thunderbolt 5 (RDMA) using EXO Labs / MLX backend. Yes, it can run clawdbot.
0:18

Running Kimi K2.5 on my desk. Runs at 24 tok/sec with 2 x 512GB M3 Ultra Mac Studios connected with Thunderbolt 5 (RDMA) using EXO Labs / MLX backend. Yes, it can run clawdbot.

Alex Cheema

3,039,300 views • 4 months ago

DeepSeek-R1-0528-Qwen3-8B running on iPhone 16 with MLX
0:16

DeepSeek-R1-0528-Qwen3-8B running on iPhone 16 with MLX

ℏεsam

17,285 views • 1 year ago

Taylor Swift is us watching Simone Biles! 🤩 #USAGTrials24
0:15

Taylor Swift is us watching Simone Biles! 🤩 #USAGTrials24

On Her Turf

187,448 views • 1 year ago

I was exploring MLX Swift and created a workout assistant to train for my runs! 🏃🏽‍♂️ It uses my workout data from HealthKit for personalization and Qwen 2.5 3B for local inference!
0:13

I was exploring MLX Swift and created a workout assistant to train for my runs! 🏃🏽‍♂️ It uses my workout data from HealthKit for personalization and Qwen 2.5 3B for local inference!

Rudrank Riyam

19,965 views • 1 year ago

GLF Motion Design w/ MLX
0:16

GLF Motion Design w/ MLX

Kyrik

35,251 views • 1 year ago

NariLabs Dia-1.6B by Toby Kim now on MLX 🚀 Get started: > pip install -U mlx-audio Model Card 👇🏾
0:11

NariLabs Dia-1.6B by Toby Kim now on MLX 🚀 Get started: > pip install -U mlx-audio Model Card 👇🏾

Prince Canuma

24,057 views • 1 year ago