4 lines (3 loc) · 200 Bytes

src_crawler

This project is setup to crawling information and source code of 3rd party libraries. We will scrape info of 3rd from the websites listed in scrape_list.txt with scrapy crawler engine.