[ale] need web spider

[Chris Fowler]

Well,

I *was* going to suggest a few perl programs.  But I think you need
something bigger.  I beleive google will allow you to index your sites and
search them.  I'm not sure if they do this as a private index for a fee.



-----Original Message-----
From: Armsby John-G16665 [mailto:John.Armsby at motorola.com]
To: ale at ale.org
Sent: Thursday, March 21, 2002 4:53 PM
To: 'ale at ale.org'
Subject: [ale] need web spider


Anyone have any recommendations for a web spider which indexes filenames,
and content?  I have several large file systems (NT) which are part of a web
document file system (no html, just a big bag if files), some classic web
sites, and some HPUX web sites composed of a bunch of raster, pdf, and
Office files.
My volume is probably about 500,000 files.

I see a lot of stuff out there but.......


John


---
This message has been sent through the ALE general discussion list.
See http://www.ale.org/mailing-lists.shtml for more info. Problems should be
sent to listmaster at ale dot org.




---
This message has been sent through the ALE general discussion list.
See http://www.ale.org/mailing-lists.shtml for more info. Problems should be 
sent to listmaster at ale dot org.