parse-robots

ArcaneDigital
js
parse-robots JS library on GitHub parse-robots JS library on npm Download parse-robots JS library

Promise based parser for robots.txt files.

Version 3.2.0 License MIT
parse-robots has no homepage
parse-robots JS library on GitHub
parse-robots JS library on npm
Download parse-robots JS library
Keywords
crawlwebrobots.txtseorobotstxtrobotsrobots-txtsitemap
INSTALL
Version:
Learn more
Readme Files Statistics Browse CDN