automation of collecting web site size

sinck@ugive.com sinck@ugive.com
Fri, 13 Oct 2000 12:13:05 -0700


\_ : There must be a way to get this info, without either sucking the whole
\_ : site down, or having access to the webserver?
\_ : 
\_ : Anyone have any ideas, suggestions, etc.?
\_ 
\_ lynx -dump -head $URL | grep Content-Length | cut -d: -f 2

Hum, this could lead to amusing issues if it hits a cgi script (or
other) that doesn't play nice with issuing Content-Length.
Furthermore just getting the head doesn't tell you what else might be
linked to it down the tree.

David