CAT

I interviewed Neil Movva for Substrate on latency-insensitive inference, alternative chips, and why massive datacenters face diseconomies of scale. "We've always predicted that async inference is going to eat the world. That could easily be 95% or more of inference demand." Neil's been at the frontier of inference for years, from NVIDIA to co-founding Sail Research. I learned a lot from our conversation - you can listen below.