automation of collecting web site size

Top Page
Attachments:
Message as email
+ (text/plain)
Delete this message
Reply to this message
Author: sinck@ugive.comsinckugive.com
Date:  
Subject: automation of collecting web site size
\_ : There must be a way to get this info, without either sucking the whole
\_ : site down, or having access to the webserver?
\_ :
\_ : Anyone have any ideas, suggestions, etc.?
\_
\_ lynx -dump -head $URL | grep Content-Length | cut -d: -f 2

Hum, this could lead to amusing issues if it hits a cgi script (or
other) that doesn't play nice with issuing Content-Length.
Furthermore just getting the head doesn't tell you what else might be
linked to it down the tree.

David