automation of collecting web site size
sinck@ugive.com
sinck@ugive.com
Fri, 13 Oct 2000 12:13:05 -0700
\_ : There must be a way to get this info, without either sucking the whole
\_ : site down, or having access to the webserver?
\_ :
\_ : Anyone have any ideas, suggestions, etc.?
\_
\_ lynx -dump -head $URL | grep Content-Length | cut -d: -f 2
Hum, this could lead to amusing issues if it hits a cgi script (or
other) that doesn't play nice with issuing Content-Length.
Furthermore just getting the head doesn't tell you what else might be
linked to it down the tree.
David