◕

Tokenizer Playground

See how an LLM actually reads your text — split into tokens with the real GPT-4 (cl100k_base) byte-pair encoding, live in your browser.

</> Source

0tokens

0characters

0chars / token

Loading tokenizer…

Uses gpt-tokenizer (cl100k_base, the GPT-3.5/GPT-4 encoding). Everything runs locally — your text never leaves the page.