Logo Search packages:      
Sourcecode: webcheck version File versions

crawler::Site Class Reference

List of all members.


Detailed Description

Class to represent gathered data of a site.

The available properties of this class are:

  linkMap    - a map of urls to link objects
  bases      - a list of base link object
   

Definition at line 92 of file crawler.py.


Public Member Functions

def __init__
def add_external_re
def add_internal
def add_internal_re
def add_yanked_re
def crawl
def get_link
def postprocess

Public Attributes

 base
 bases
 linkMap

Private Member Functions

def _get_robotparser
def _is_internal
def _is_yanked

Private Attributes

 _external_res
 _internal_res
 _internal_urls
 _robotparsers
 _yanked_res

The documentation for this class was generated from the following file:

Generated by  Doxygen 1.6.0   Back to index