WWW::Search::Crawler - class for searching Crawler

NAME

WWW::Search::Crawler - class for searching Crawler

SUPPORTED PLATFORMS

This module is not included with the standard ActivePerl distribution. It is available as a separate download using PPM.

SYNOPSIS

    require WWW::Search;
    $search = new WWW::Search('Crawler');

DESCRIPTION

This class is an Crawler specialization of WWW::Search. It handles making and interpreting Fireball searches http://www.crawler.de.

This class exports no public interface; all interaction should be done through WWW::Search objects.

SEE ALSO

To make new back-ends, see the WWW::Search manpage.

HOW DOES IT WORK?

native_setup_search is called before we do anything. It initializes our private variables (which all begin with underscores) and sets up a URL to the first results page in {_next_url}.

native_retrieve_some is called (from WWW::Search::retrieve_some) whenever more hits are needed. It calls the LWP library to fetch the page specified by {_next_url}. It parses this page, appending any search hits it finds to {cache}. If it finds a ``next'' button in the text, it sets {_next_url} to point to the page for the next set of results, otherwise it sets it to undef to indicate we're done.

AUTHOR

WWW::Search::Crawler has been shamelessly copied by Andreas Borchert, <borchert@mathematik.uni-ulm.de> from WWW::Search::AltaVista by John Heidemann, <johnh@isi.edu>.

COPYRIGHT

The original parts from John Heidemann are subject to following copyright notice:

Copyright (c) 1996-1998 University of Southern California. All rights reserved. 


Redistribution and use in source and binary forms are permitted
provided that the above copyright notice and this paragraph are
duplicated in all such forms and that any documentation, advertising
materials, and other materials related to such distribution and use
acknowledge that the software was developed by the University of
Southern California, Information Sciences Institute.  The name of the
University may not be used to endorse or promote products derived from
this software without specific prior written permission.

THIS SOFTWARE IS PROVIDED ``AS IS'' AND WITHOUT ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, WITHOUT LIMITATION, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.

 WWW::Search::Crawler - class for searching Crawler