Distillation is the future.

Hello. Are you currently busy with any products at the moment?

Distillation on top of open source chinese model?

Distill frontier -> open source

I work with f500 in this space they don’t need frontier models for the use cases they’re trying to solve right now to a certain degree, the enterprise space is just laying down the foundation and rails for future autonomous apps, but OS models are truly good enough for now

ppl obsessed with frontier benchmarks when distillation is where the actual product value is hidden

distillation only works if the student can generalize

Depends on the use case

what specific type of distillation? sounds like you mean AI model compression but curious if there's another angle

Not gonna happen. Microsoft and Satya feel comfortable with platforms and ecosystems because the only thing they've ever understood, but AI is the ultimate flattener, the singularity. Anything else will be just inferior forces trying to steer the innevitability of the convergence.

Satya needs to resign. That's the thing he needs to be contemplating. New blood is needed at Microsoft, it has been in a rot for a long time. The rot starts at the top.

He’s warning enterprises that if they don't own their model sovereignty, they are literally handing their moat over to external infrastructure providers.

Hmmmm…

Posted my views here Couldn’t agree more

Which startup?

Thx

Hell yeah, distilling big models is exactly how we build a stable AI ecosystem that actually works for everyone.

AI incinerates cash Economics suck

You can actually hear yourself saying the wrong words.

distillation slaps but the real cost is data quality. garbage teacher in, garbage student out, just faster and cheaper garbage