正在加载视频...
视频加载失败
Will AI data centers become more consolidated — or more distributed? jsun, Founder of FLock.io, sees inference pushing compute outward. Unlike large-scale training, many inference workloads don’t require massive, tightly connected clusters. That could make smaller sites with underused power viable as “mini data centers.” Desmond Lim, Co-founder &... show more
27,123 次观看 • 3 天前 •via X (Twitter)
6 条评论

@0x7SUN @flock_io Mini data centers = democratized AI access. Imagine edge applications we haven't even dreamed of yet. Can't wait to see the impact!

The distributed inference argument is getting stronger. Smaller compute sites can make sense when workloads can be routed to where power and capacity are available. But I think both views can coexist: centralized infrastructure for training, distributed infrastructure for inference.

@0x7SUN @flock_io Inference at the edge makes sense, but i think the real bottleneck isn't compute location, it's latency + data gravity.

@0x7SUN @flock_io Inference distributes, capital still consolidates

@0x7SUN @flock_io NFA

@0x7SUN @flock_io inference goes edhe but capital stays core
