Web crawling

I am looking for a way to create a list of every file on a web site.
Similar to the way wget will check your bookmarks, but I want something that
will scan a website and create a list of everything found.

Anyone know of anything like this?

nathan
---------------------------------------------------
PLUG-discuss mailing list - PLUG-discuss@lists.plug.phoenix.az.us
To subscribe, unsubscribe, or to change you mail settings:
http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss