Alex

@Alex_tra_memory • 1,168 subscribers

@fluidinference , AI Researcher https://t.co/8ko2FKWp4A

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Thanks for the model, we were able to port Laya to coreml with 99.5% of the ops on ANE + benchmarked too. it is now blazing fast with 3.7 ms per decision on an M5 Pro. Release: Models:

Thanks for the model, we were able to port Laya to coreml with 99.5% of the ops on ANE + benchmarked too. it is now blazing fast with 3.7 ms per decision on an M5 Pro. Release: Models:

120,068 views • 1 month ago

LFM3-1.7B just read the whole of Pride and Prejudice on a M5 Pro using MLX. It read 100k tokens in about 28 s (sped up 8× in the clip), then answered 100 questions back to back in 27 s, including finding a password hidden somewhere in the book.

LFM3-1.7B just read the whole of Pride and Prejudice on a M5 Pro using MLX. It read 100k tokens in about 28 s (sped up 8× in the clip), then answered 100 questions back to back in 27 s, including finding a password hidden somewhere in the book.

14,620 views • 4 days ago

We got EmbeddingGemma 2 running 100% on the Apple Neural Engine 🍎 M5 Pro 10,080 posts sorted into topics live, ~620/s on a MacBook, then any topic splits into subtopics in under a second. Fully on-device. 🤗 💻

We got EmbeddingGemma 2 running 100% on the Apple Neural Engine 🍎 M5 Pro 10,080 posts sorted into topics live, ~620/s on a MacBook, then any topic splits into subtopics in under a second. Fully on-device. 🤗 💻

40,731 views • 24 days ago

We distilled clef-flash into a 0.6B model and supporting ANE option. 1,000 support tickets triaged on a M5 pro in 57 s: team, urgency and refund for each, 48 ms per ticket. Within a few points of the 9B on classification. 🤗 💻

We distilled clef-flash into a 0.6B model and supporting ANE option. 1,000 support tickets triaged on a M5 pro in 57 s: team, urgency and refund for each, 48 ms per ticket. Within a few points of the 9B on classification. 🤗 💻

32,227 views • 23 days ago

Decision 3.0 now on Core ML 🍎 d3-lite triaging 1,000 pull requests into vllm-sr workgroups, live on an M5 Pro: 0.12 s per PR, 8.3 PRs/s, nothing leaves the Mac ⚡ lite, nano and mini are all converted and in one repo 👇 🤗 🛠️

Decision 3.0 now on Core ML 🍎 d3-lite triaging 1,000 pull requests into vllm-sr workgroups, live on an M5 Pro: 0.12 s per PR, 8.3 PRs/s, nothing leaves the Mac ⚡ lite, nano and mini are all converted and in one repo 👇 🤗 🛠️

28,274 views • 21 days ago

Inspired by Shahir's demo, FluidAudio Phonon 2 coreml transcribing an hour of audio in 5.6 s and a full 24 hours in 2 min 19 s on a M5 Pro. Phonon-2 Core ML 1 hour rtfx went from 480× → 644×. test-clean wer the same while 150 -> 195 rtfx

Inspired by Shahir's demo, FluidAudio Phonon 2 coreml transcribing an hour of audio in 5.6 s and a full 24 hours in 2 min 19 s on a M5 Pro. Phonon-2 Core ML 1 hour rtfx went from 480× → 644×. test-clean wer the same while 150 -> 195 rtfx

14,278 views • 20 days ago

finetuned Unlimited-OCR on a M5 Pro, Baidu's whole 14-page paper in Core ML reads the pages, MLX writes ~200 tokens/s.

finetuned Unlimited-OCR on a M5 Pro, Baidu's whole 14-page paper in Core ML reads the pages, MLX writes ~200 tokens/s.

12,459 views • 20 days ago

No more content to load