Sinusoidal Positional Encoding

Interactive visualization of transformer position embeddings.

I created a simple webapp on the sinusoidal positional encoding in Transformers to develop intuition on how different settings affect the encoding patterns. Check it out here!

(More description coming soon)