gpt-tokenizer
niieani esm cjs
A pure JavaScript BPE tokenizer with model metadata and pricing for GPT-5, GPT-4o, o-series, and other OpenAI models
Version 4.0.0 License MIT
Keywords
BPEencoderdecodertokenizerGPTGPT-2GPT-3GPT-3.5GPT-4GPT-4.1GPT-4oGPT-5o1o3o4
INSTALL
Top version - 0
Full gpt-tokenizer Download Stats 
ShareKeywords
BPE
encoder
decoder
tokenizer
GPT
GPT-2
GPT-3
GPT-3.5
GPT-4
GPT-4.1
GPT-4o
GPT-5
o1
o3
o4
gpt-oss
tiktoken
tokens
LLM
token counting
API pricing
NLP
Natural Language Processing
Text Generation
OpenAI
Machine Learning
ml
Get a badge for your package
