@meistrari/gpt-tokenizer

esm cjs

A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 / Claude Instant / Claude 2

Version 0.3.2 License MIT

Keywords

BPEencoderdecodertokenizerGPTGPT-2GPT-3GPT-3.5GPT-4NLPNatural Language ProcessingText GenerationOpenAIMachine Learningml

INSTALL

Version:

Statistics

Requests 0

Bandwidth 0

Top version - 0

Keywords

BPE

encoder

decoder

tokenizer

GPT

GPT-2

GPT-3

GPT-3.5

GPT-4

NLP

Natural Language Processing

Text Generation

OpenAI

Machine Learning

Get a badge for your package