Thanks to everyone for their suggestions. I looked further in my logs, and lots of Chinese spiders are hitting my site. I extracted the IPs from the log files and blocked them with iptables. The database is now stable. I still have to find the root cause of why spiders cause Plone to expand the database, but at lease the db is not growing out of control!
Thanks again!
Mark
I would just use an IPTABLES firewall entry and block him before hit hits your webserver.
sending a message to abuse@.... doesn't hurt either (it establishes an electronic paper trail).
However, trying to get an admin at a foreign ISP (especially in a place where a lot of cybergangs are known to operate) to do anything about it is going to be difficult, at best.
On 7/26/10 12:10 PM, Mark Phillips wrote:
I have a server running a school newspaper site. I keep getting hit from a server in Belgrade with a bad request, which creates an error and causes my database to grow by 1MB/hit. I am trying to track down the bug in the database, so my question is really about getting the guy to stop hitting my server with this request.<snip>
The IP for the request is 212.95.54.48, and I think it is a spider as I get other requests from this IP for my site map, contacts page, etc. I looked up the IP and I got this from Whois:
What is the best way to handle this? Send an email to abuse@inferno.name <mailto:abuse@inferno.name>, or am I just inviting more abuse? Is there a way for apache to block these addresses before it hits my site (apache is in front of a plone/zope combination)? I have a robots.txt file at the root of my site...
Sitemap: http://ahsnews.com/google-sitemaps.xml
User-agent: *
Disallow: /
but it doesn't stop him from hitting me anyway.
Thanks for any suggestions you may have!
Mark
---------------------------------------------------
PLUG-discuss mailing list - PLUG-discuss@lists.plug.phoenix.az.us
To subscribe, unsubscribe, or to change your mail settings:
http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss
---------------------------------------------------
PLUG-discuss mailing list - PLUG-discuss@lists.plug.phoenix.az.us
To subscribe, unsubscribe, or to change your mail settings:
http://lists.PLUG.phoenix.az.us/mailman/listinfo/plug-discuss