🔥Apple MLX first 6bit model is on Hugging Face!🔥... Qwen2.5-Coder-32B-Instruct-6bit! 3bit conversion and test in progress! Video 8x below on M4 Max 40GPU: - Prompt: 38 tokens, 61.731 tokens-per-sec - Generation: 1181 tokens, 16.939 tokens-per-sec - Peak memory: 25.122 GBshow more

MLX + M3 Ultra 512GB + Qwen3-235B-A22B-8bit = 🔥... "write a beautiful p5js particles animation that reacts to mouse clicks movements" Prompt: 22 tokens, 64.471 tokens-per-sec Generation: 6197 tokens, 18.916 tokens-per-sec Peak memory: 251.077 GBshow more

MLX MiniMax 2.5 running LOCALLY on a single M3... Ultra 512GB! Writing a poem on LLMs at 6bit quantization! 🔥 Let's start some coding, context and distributed tests! Generation: 40.2 tokens-per-sec Peak memory: 186 GBshow more

DeepSeek R1 Qwen 7B 4bit M2 Ultra vs M4... Max on Apple MLX 🤫 Let them think... (video 4x in center part) M2 Ultra: 114.9 tokens per sec M4 Max (14"): 88.3 tokens per secshow more

You are not prepared for this, 250+ tokens/sec, 1B... model < 2GB memoryshow more

2000 tokens/sec gives me dopamine high on opencode

Latest mlx-lm has faster and lower memory prompt processing!... Thanks to causal fused attention from Jagrit Digani 7B 4-bit Mistral v3 can do ~30,000 tokens under a minute on my M4 Max laptop and only needs 8.5GB:show more

/1 Gemma 4 31B just crushed Qwen 3.6 27B... in a local LLM gamedev contest inside atomic.chat (prompt is below) Device: MacBook Pro M5 Max, 64GB RAM Results: Qwen 3.6 27B: 32 tokens/sec · 18m 04s · 33,946 tokens Gemma 4 31B: 27 tokens/sec · 3m 51s · 6,209 tokens So what is more important: tokens per second, or the quality of the final answer? Qwen made a very long response and showed more creativity and visual style. But Gemma gave a shorter, clearer, and more logical answer in much less time. In this one-shot Pac-Man gamedev contest, Gemma 4 31B was the clear winner. Its game logic was stronger: click reactions were smoother, and it handled interactions with elements like walls, ghosts, and particle effects better. But this was only one test. Maybe Qwen 3.6 27B can show better results with better settings. Open the comments, try our prompt, and share your result below.show more

Introducing FlashCompact - the first specialized model for context... compaction 33k tokens/sec 200k → 50k in ~1.5s Fast, high quality compactionshow more

The first natively trained 1-bit model: BitNet 2B. Trained... on 4 trillion tokens. that can run on CPUs like Apple M2 Native 1.58-bit weights and 8bit activations W158A8 Outperforms LLaMA &close to Qwen 2.5 1.5B in while using only 0.4GB memory versus 2GB and processes tokens 40%show more

🦉 Owls Labs x Magic Eden 🪄 Lights are... switching on 👉 Magic Eden 🪄 4,000 mintable Owls NFTs WL: Max 5 Tokens per Wallet Price: 0,08 SOL Public: Max 5 Tokens per Wallet Price: 0,12 SOL Set your alarms for 12th! ⏰show more

Qwen/Qwen3-30B-A3B is absolute game changer 🤯 ⬇️ Are you... on a Mac? then use MLX weights - getting 100 tokens/sec here. It changes everything for real world use cases.show more

GEMMA 4 FINISHED 14 MINUTES FASTER THAN QWEN 3.6... DESPITE LOWER TOKENS PER SECOND BY USING 5X FEWER TOKENSshow more

Don't miss out on HOTTEST AIRDROP! 🔥 First 10M... $WHALE Tokens - Limited time available! Use Refer-a-friend program and get $WHALE Tokens, while you sleep! #crypto #airdrop #whaletokenshow more

Apparently SeeDance 2 is down for the time being... on BytePlus but here's a young wizard with his dragon companion. It's a very cool video model. This video cost $0.72 USD to generate which seems reasonable. (300,000 tokens for a 15 secs at $0.0024 USD per 1000 tokens.)show more

🟪 Qwen3-235B 2507 Instruct is live on Cerebras 1400... TPS • 131K Context • 230ms TTFT $0.6 | $1.2 per M tokens Try chat: Get API key: Pay-as-you-go viashow more

First real test on M4 Max 40GPU to transcribe... 3 hours of video with mlx_whisper 0.4.1 - M4 Max 2:19 mins (Max Fan no throttling) - M4 Max 2:29 mins (System Fan throttling towards end) GPU freq goes 1.578 --> 952 Here the video (8x) showing throttling kicking in at the end.show more

Pricing is simple and efficient: • 1 million tokens... for $1 • The first 1 million tokens are free • No subscription or credit card needed Type “DataLumoris” in the chat for 10 million bonus tokensshow more

Imagine tokens raining down like a storm from the... sky.. Use Power-Ups like: — Income per Tap — Energy Limit — Energy Recovery — Energy Consumption Get the MAX out of every tap and watch the tokens pour in. Start tapping NOW!show more

Fuck yeah! MaskGCT - New open SoTA Text to... Speech model! 🔥 > Zero-shot voice cloning > Emotional TTS > Trained on 100K hours of data > Long form synthesis > Variable speed synthesis > Bilingual - Chinese & English > Available on Hugging Face Fully non-autoregressive architecture: > Stage 1: Predicts semantic tokens from text, using tokens extracted from a speech self-supervised learning (SSL) model > Stage 2: Predicts acoustic tokens conditioned on the semantic tokens. Synthesised: "Would you guys personally like to have a fake fireplace, an electric one, in your house? Or would you rather have a real fireplace? Let me know down below. Okay everybody, that's all for today's video and I hope you guys learned a bunch of furniture vocabulary!" TTS scene keeps getting lit! 🐐show more

We are thrilled to be a launch partner for... Meta Llama 3. Experience Llama 3 now at up to 350 tokens per second for Llama 3 8B and up to 150 tokens per second for Llama 3 70B, running in full FP16 precision on the Together API! 🤯show more