mistral-tokenizer-js

esm
JS tokenizer for Mistral-based LLMs
Version 1.0.0 License MIT
Keywords
mistralllmtokenizer
<script src=" https://cdn.jsdelivr.net/npm/mistral-tokenizer-js@1.0.0/mistral-tokenizer.min.js "></script>
Selected files