ModelViz
Understand the math behind your model.

Language Model Visualizations

Interactive visualizations to help understand how large language models work

Attention

Explore how attention mechanisms work in transformers

Sampling

Understand how models sample the next token from probability distributions

Prediction

See how language models predict the next token

Vector Space

Visualize word embeddings in vector space

Tokenization

Understand how text is converted into tokens