llama3-tokenizer-js

esm

JS tokenizer for LLaMA 3

Version 1.2.0 License MIT

Keywords

llamallmtokenizer

INSTALL

Type: ESM Default

Version:

<script type="module"> import llama3TokenizerJs from 'https://cdn.jsdelivr.net/npm/llama3-tokenizer-js@1.2.0/+esm' </script>

Statistics Browse CDN

Statistics

Requests 46

Bandwidth 43 MB

Top version - 1.2.0 39

/bundle/ commonjs-llama3-tokenizer-with-baked-data.min.js

All files

114

14

4

/npm/llama3-tokenizer-js@1.2.0/LICENSE.md

2

/npm/llama3-tokenizer-js@1.2.0/package.json

10

/npm/llama3-tokenizer-js@1.2.0/README.md

7

/npm/llama3-tokenizer-js@1.2.0/types.d.ts

2

Selected files

No files selected. Select the files you want to use using the switches on the left.