llama3-tokenizer-js

llama3-tokenizer-js JS library on GitHub llama3-tokenizer-js JS library on npm Download llama3-tokenizer-js JS library

JS tokenizer for LLaMA 3

Version 1.2.0 License MIT
llama3-tokenizer-js has no homepage
llama3-tokenizer-js JS library on GitHub
llama3-tokenizer-js JS library on npm
Download llama3-tokenizer-js JS library
Keywords
llamallmtokenizer
INSTALL
Type:
<script type="module"> import llama3TokenizerJs from 'https://cdn.jsdelivr.net/npm/llama3-tokenizer-js@1.2.0/+esm' </script>
Learn more