Ivan Burazin's banner
Ivan Burazin's profile picture

Ivan Burazin

@ivanburazin16,761 subscribers

building @daytonaio

Shorts

From GitHub stars to Times Square lights: We're ending 2024 by lighting up the crossroads of the world! 🗽✨ For us, Times Square perfectly embodies the intersection of ambition and achievement. Here's to an even brighter 2025!

From GitHub stars to Times Square lights: We're ending 2024 by lighting up the crossroads of the world! 🗽✨ For us, Times Square perfectly embodies the intersection of ambition and achievement. Here's to an even brighter 2025!

13,206 просмотров

Videos

ivanburazin's profile picture

Dylan Patel says GPUs are no longer the biggest bottleneck. According to Dylan Patel, now CPUs are the constraint. In the early AI era, CPUs were the laggers. You used them for storage, checkpointing, pre-processing, etc. (pretty light workloads) The models weren't agentic and couldn't go step by step. Just string in and string out (simple inference) Then OpenAI launched O1 preview in September '24, and RL training loops have since tightened every month. - initially it was checking model output with regex - then running classifiers - followed by code unit tests + compilation - and finally agentic flows calling databases & scientific simulations The model outputs to an environment, gets verified, and trains on it. Coding agent revenue went from a couple billion to north of $10B in roughly 6 months. Something like Codex 5.4 can work agentically on its own for 6-7 hrs straight - doing all sorts of calls (databases, cron servers, scraping) That requires insane CPU capabilities. And over the last two quarters, the entire cloud market ran out of CPUs. - GitHub has been really unstable lately - Amazon's CPU server installations 3x'd year over year - Microsoft sold all of its spare CPUs to Anthropic & OpenAI Earlier, it was 100 megawatts of GPUs served by 1 megawatt of CPUs. Now that ratio is getting much closer for both RL training and agentic inference. There's simply no capacity anywhere, and it's causing massive instability.

Ivan Burazin

303,474 просмотров • 2 месяцев назад

Больше нет контента для загрузки