TensorTonic's banner
TensorTonic's profile picture

TensorTonic

@TensorTonic6,546 subscribers

Run ML algorithms in cloud-native sandbox at https://t.co/1f7hGOZw21

Shorts

We’ve added interactive visualizations to all coding problems. You can now understand each coding problem more clearly and in depth before solving. Here’s an example using positional encodings from the transformer paper.

We’ve added interactive visualizations to all coding problems. You can now understand each coding problem more clearly and in depth before solving. Here’s an example using positional encodings from the transformer paper.

33,033 views

Part 2/30 of the LLM Series: RoPE (Rotary Position Embedding) How does a transformer know the difference between - "the dog bit the man" and "the man bit the dog"? The words are almost identical, but the meaning changes completely. RoPE encodes position as rotation, allowing transformers to understand relative order through geometry. Read more:

Part 2/30 of the LLM Series: RoPE (Rotary Position Embedding) How does a transformer know the difference between - "the dog bit the man" and "the man bit the dog"? The words are almost identical, but the meaning changes completely. RoPE encodes position as rotation, allowing transformers to understand relative order through geometry. Read more:

11,766 views

Videos

No more content to load