bpe-lite
esm cjs
Offline BPE tokenizer for OpenAI, Anthropic, and Gemini — zero dependencies
Version 0.5.2 License MIT
Keywords
tokenizerbpeopenaianthropicgeminitokensllm
INSTALL
Offline BPE tokenizer for OpenAI, Anthropic, and Gemini — zero dependencies