Web crawling

Páxina inicial
Anexos:
Mensaxe orixinal
+ (text/plain)
Borrar esta mensaxe
Responder a esta mensaxe
Autor: Nathan England
Data:  
Para: plug-discuss
Asunto: Web crawling

I am looking for a way to create a list of every file on a web site.
Similar to the way wget will check your bookmarks, but I want something that
will scan a website and create a list of everything found.

Anyone know of anything like this?

nathan
---------------------------------------------------
PLUG-discuss mailing list -
To subscribe, unsubscribe, or to change you mail settings:
http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss