Tiktokenizer

Tiktokenizer is a free browser-based token counter and tokenizer explorer for people working with large language model prompts. Paste text and choose a supported model to view a token count. For supported local tokenizers, the interface shows colored token boundaries and token IDs. Results distinguish exact counts, compatible tokenizers, estimates and reference encodings, so users can see how each number was produced. Plain text and chat body modes are available, with chat-body counts excluding provider wrappers. A separate raw encoding explorer helps inspect individual encodings, and dedicated token cost calculators help estimate API costs. No sign-up or API key is required to use the tool.