gpt2 layerwise average activations

repo:

🚨 $QQQ is up over 2% again 🚨 Yesterday evening, we tweeted about the $11.9M+ in bullish golden sweeps on $QQQ for 8/08 (today) and 8/09 expiries. $QQQ is up over $8 today. Want to see trades like this? Try our 7 day free trial at:

you should add the logit lens token at each layer

last layer logits were added. but not sure of method for mapping to each layer?

Is this hidden state or MLP?

separated em out,

Nice, another variant that would be cool is to highlight the tokens with the highest scores at each new token

done

You just gained a follower.

🫡