4 messages in com.googlegroups.google-gadgets-apiRe: Google Gadget Server Issues... VE...| From | Sent On | Attachments |
|---|---|---|
| javalizard | 29 Feb 2008 07:07 | |
| Jerome (Guru) | 29 Feb 2008 09:32 | |
| javalizard | 29 Feb 2008 11:20 | |
| javalizard | 29 Feb 2008 11:47 |
| Subject: | Re: Google Gadget Server Issues... VERY IMPORTANT |
|---|---|
| From: | Jerome (Guru) (jero...@gmail.com) |
| Date: | 02/29/2008 09:32:18 AM |
| List: | com.googlegroups.google-gadgets-api |
Hey Brad,
I just scanned the logs on my servers and luckily I have not been visited by these 3 mad Googlebots severs last night...
I would suggest you provide the URL of your gadget, as this would hopefully help the Googlers speed up the research on what happened. Were the bots trying to get to your gadget XML, or some other cached content?
Jerome
On Feb 29, 9:07 am, javalizard <java...@gmail.com> wrote:
This morning i woke up and found that my server was inundated with requests. I did some investigation and found that 74.125.17.11, 72.14.193.165, 74.125.16.34 were all making requests but were stuck in the writing phase of the request. My server is a beast but even 2048 slots on the apache server weren't enough to make a difference. These servers were requesting the SAME files hundreds of times and each was stuck in the write phase. This is REALLY not cool because the amount of bandwidth Google went through last night(whenever it started) was 300 Gigabytes of transfer.... that is NOT cheap at about $1/GB! Shall I send the bill to google? Anyway. I blocked these three servers using the apache deny mechanism and things have returned back to some kind of working status whereby there are about 150 requests being processed at any given second (my keep alive time is 15 seconds). The number of requests (which includes requests denied from the three servers) is 230 requests / second.
Can you PLEASE fix or take these servers offline? They are doing _EXTREME_ damage to my wallet. Even when these requests are blocked it taking about 200-250k/second of traffic which is HUGE. my normal load for this time is 50-60k/second with only 18 requests per second.