llama3-tokenizer-js

esm

JS tokenizer for LLaMA 3

Version 1.2.0 License MIT

Keywords

llamallmtokenizer

INSTALL

Type: ESM Default

Version:

<script type="module"> import llama3TokenizerJs from 'https://cdn.jsdelivr.net/npm/llama3-tokenizer-js@1.2.0/+esm' </script>

Statistics Browse CDN

Statistics

Requests 8

Bandwidth 10 MB

Top version - 1.2.0 6

/bundle/ commonjs-llama3-tokenizer-with-baked-data.min.js

All files

/npm/llama3-tokenizer-js@1.2.0/LICENSE.md

/npm/llama3-tokenizer-js@1.2.0/package.json

/npm/llama3-tokenizer-js@1.2.0/README.md

/npm/llama3-tokenizer-js@1.2.0/types.d.ts

Selected files

No files selected. Select the files you want to use using the switches on the left.