tokenizer2

smallhelm
js
tokenizer2 JS library on GitHub tokenizer2 JS library on npm Download tokenizer2 JS library

tokenize any text stream given some basic regex rules to match tokens

Version 2.0.1 License MIT
tokenizer2 has no homepage
tokenizer2 JS library on GitHub
tokenizer2 JS library on npm
Download tokenizer2 JS library
Keywords
tokenizerthroughstream
INSTALL
Version:
Learn more
Readme Files Statistics Browse CDN