crawler-user-agents
js
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
Version 1.28.0 License MIT
INSTALL
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.