Softpedia
 
HomepageWindowsGamesDriversMacLinuxScripts buttonMobileHandheldNews


SCRIPTS CATEGORIES:



NEWS ARCHIVE >>
SOFTPEDIA REVIEWS >>
MEET THE EDITORS >>
WEEK'S BEST
  • PeoplePods 0.9
  • Brackets Sprint 8
  • elFinder 2.0 RC1
  • BBClone 0.6.1
  • Twitter Follow Box...
  • Multilingual Press...
  • SimplePie 1.2.1
  • TinyTips 1.2
  • SWFUpload 2.2.0.1 ...
  • Head Cleaner 1.4.2.9
    		•
    Home > Scripts > Search Engines

    Python Web Crawler 1.0.1
    Download button


    Clicks: 169  Tell us about an update
    User Rating:
    Rated by:    		 NOT RATED
    0 user(s)
    Developer:

    Website:

    License / Price:


    Platforms:

    Databases:

    Language:

    Last Updated:

    Category:         		Binpress | More scripts
    www.binpress.com
    Commercial License ($9.99) 
    BUY the full version

    Windows / Linux / Mac OS / BSD / Solaris
    MySQL
    Python
    July 8th, 2011, 16:04 GMT
    C: \ Search Engines

     Read user reviews (0)  Refer to a friend  Subscribe

    Python Web Crawler description

    This is a simple web scrapper written in Python for retrieving links from a page

    It can differentiate from normal navigation links and static data like files, image sources and other multimedia files usually found embedded in a web page.

    A PHP version is also available.

    Here are some key features of "Python Web Crawler":

    · Multi-processed crawling to improve speed
    · MySQL database to save the links
    · Easy to extend
    · Clean and readable Pythonic code
    · URL validator via regular expressions



    TAGS:

    		 web scraper | link indexing | data mining | search | link | scrape



    HTML code for linking to this page:


    Go to top

    WindowsGamesDriversMacLinuxScriptsMobileHandheldNews

    SUBMIT PROGRAM   |   ADVERTISE   |   GET HELP   |   SEND US FEEDBACK   |   RSS FEEDS   |   UPDATE YOUR SOFTWARE   |   ROMANIAN FORUM
    © 2001 - 2012 Softpedia. All rights reserved.
    Softpedia® and the Softpedia® logo are
    registered trademarks of SoftNews NET SRL.    		 Copyright Information | Privacy Policy | Terms of Use