Abdur Rahim's banner
Abdur Rahim's profile picture

Abdur Rahim

@_ARahim_ • 1,341 subscribers

mlx-tune (1.4k+ ⭐): https://t.co/ImNGF9FUpX mlx-dspark (650+ ⭐): https://t.co/gMdGltbhIf kaggle-tpu-lab (500+⭐️): https://t.co/ItckUllZ1F

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

GLM-5.3-Flash (320B MoE) serving on Kaggle's free TPU: ~64 tok/s, 262k context. No stack could run this model on a TPU, so I wrote a JAX engine for it: 3-bit experts (from Unsloth AI) in HBM; Pallas kernels decode them inside the matmul. Z.ai Kaggle
0:43
_ARahim_'s profile picture

GLM-5.3-Flash (320B MoE) serving on Kaggle's free TPU: ~64 tok/s, 262k context. No stack could run this model on a TPU, so I wrote a JAX engine for it: 3-bit experts (from Unsloth AI) in HBM; Pallas kernels decode them inside the matmul. Z.ai Kaggle

Abdur Rahim

107,726 Aufrufe • vor 11 Tagen

Keine weiteren Inhalte verfügbar