axios-robots

hyperfluid-tech
cjs
axios-robots JS library on GitHub axios-robots JS library on npm Download axios-robots JS library

A lightweight Axios interceptor that enforces robots.txt compliance for web scrapers and bots

Version 0.4.0 License BSD-3-Clause
axios-robots has no homepage
axios-robots JS library on GitHub
axios-robots JS library on npm
Download axios-robots JS library
Keywords
axiosrobotsrobots.txtinterceptorscrapingbotcrawler
INSTALL
Version:
Learn more
Readme Files Statistics Browse CDN