Omar Sanseviero's banner
Omar Sanseviero's profile picture

Omar Sanseviero

@osanseviero • 73,769 subscribers

MTS at @GoogleDeepMind Building Gemini, Gemma, AI Studio and more. My views ex-Chief Llama Officer @huggingface 🇵🇪🇲🇽

Shorts

Argon helped Gemma break 120,000+ tokens/sec on a single A100 on vLLM 🚀 The team optimized Gemma 4 E2B, unlocking a ~2.9x speedup (124k prefill, 111k e2e) with zero quality degradation Here's what it looks like in practice: generating 64 live Python simulations at once 👇

Argon helped Gemma break 120,000+ tokens/sec on a single A100 on vLLM 🚀 The team optimized Gemma 4 E2B, unlocking a ~2.9x speedup (124k prefill, 111k e2e) with zero quality degradation Here's what it looks like in practice: generating 64 live Python simulations at once 👇

94,334 Aufrufe

Join us in celebrating the upcoming 1 billion downloads of Gemma models🥳 A fun in-person evening with live demos and great people from the open models community Excited to see you all there!

Join us in celebrating the upcoming 1 billion downloads of Gemma models🥳 A fun in-person evening with live demos and great people from the open models community Excited to see you all there!

142,296 Aufrufe

Videos

Keine weiteren Inhalte verfügbar