Andrej Karpathy on Tensor Cores and TF32 precision

He's an awesome teacher! I just love his clean style of explaining things!

he really has it in him

Can you share a full source please?

So basically TF32 is a lie.

Where does he post this?

Lmao what are the odds that the moment I get to this part of the video on my first time watch, i see this on twitter right after

i'm watching you :)

TF32 just means ur neural net’s matmuls are running on 18-bit numerics (FP 18 precision) apple (mlx) easily lets u control this (by setting intermediate weights and values to FP 16) don’t see how TF32 is anything special. seems like a marketing gimmick

@HeyGenLabs english spanish