Scrapy 0.24.4

A light Web crawling framework written in Python to help with screen-scraping procedures and the extraction of data from the Web

  Add it to your Download Basket!

 Add it to your Watch List!

0/5

Rate it!

What's new in Scrapy 0.24.0:

  • Add UTF8 encoding header to templates
  • Telnet console now binds to 127.0.0.1 by default
  • Update debian/ubuntu install instructions
  • Disable smart strings in lxml XPath evaluations
Read full changelog
send us
an update
LICENSE TYPE:

BSD License

USER RATING:
5.0/5 3
DEVELOPED BY:
Pablo Hoffman
HOMEPAGE:
scrapy.org
LANGUAGE:
Python
CATEGORY:
C: \ Development Tools \ HTML and HTML5 Tools
Scrappy is written 100% in Python and can be utilized for simple data mining, to page monitoring, Web search engines and even for code testing.

Scrapy is not a search engine in the true meaning of the word, but it acts like one (without the indexing part). Nevertheless Scrapy can be a great tool to build your search engine logic on.

The true power of this framework relies in its core's versatility, Scrapy being a system on which to build generic or dedicated search spiders (crawlers) on.

While this might sound very complicated to non-technical users, with a quick look over the documentation and available tutorials, it's pretty simple to see how Scrapy has managed to take out all the hard-work out of this and reduce the entire process to just a few lines of code (for easier, smaller crawlers).

Last updated on August 20th, 2014

Runs on: Windows / Linux / Mac OS / BSD / Solaris

feature list requirements

#data mining #web crawler #page parser #data #mining #parse #crawler

Add your review!

SUBMIT