Scrapy

  859 downloads
1.0.3 BSD License
5.0/5 3
A light Web crawling framework written in Python to help with screen-scraping procedures and the extraction of data from the Web

description

download

specifications

changelog

Scrappy is written 100% in Python and can be utilized for simple data mining, to page monitoring, Web search engines and even for code testing.

Scrapy is not a search engine in the true meaning of the word, but it acts like one (without the indexing part). Nevertheless Scrapy can be a great tool to build your search engine logic on.

The true power of this framework relies in its core's versatility, Scrapy being a system on which to build generic or dedicated search spiders (crawlers) on.

While this might sound very complicated to non-technical users, with a quick look over the documentation and available tutorials, it's pretty simple to see how Scrapy has managed to take out all the hard-work out of this and reduce the entire process to just a few lines of code (for easier, smaller crawlers).
READ MORE   
Last updated on August 13th, 2015

0 User reviews so far.

SUBMIT