simplecrawler
Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.
Version 1.1.9 License BSD-2-Clause
Keywords
simplecrawlerspidercachequeuesimplecrawlereventemitter
INSTALL