[olug] Spider

[Jay Hannah]

On Sep 28, 2004, at 8:29 AM, John Dickson wrote:
> Does anyone have any suggestions on a Spider server that collects site 
> (web servers) information on predefined criteria? By that I mean I 
> would like to have a server hit sites to look for terms or collect 
> terms and filter later.

Roll your own!

http://search.cpan.org/~petdance/WWW-Mechanize-1.04/lib/WWW/Mechanize.pm

j
Omaha Perl Mongers: http://omaha.pm.org