[geeklog-devel] Yahoo bot becoming a pain

[Dirk Haun]

Dirk Haun wrote:

>This bot has gone completely bonkers ...

Still no change, btw. Since the majority of its requests are for /forum/
viewtopic.php, I've modified that file now to give Slurp a 503. Doesn't
seem to impress it too much yet:

74.6.69.31 - - [08/Jun/2007:16:35:39 -0400] "GET /forum/viewtopic.php?
forum=3&showtopic=47113 HTTP/1.0" 503 0 "-" "Mozilla/5.0 (compatible;
Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
74.6.21.164 - - [08/Jun/2007:16:35:39 -0400] "GET /forum/viewtopic.php?
showtopic=14219 HTTP/1.0" 503 0 "-" "Mozilla/5.0 (compatible; Yahoo!
Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
74.6.18.103 - - [08/Jun/2007:16:35:39 -0400] "GET /forum/viewtopic.php?
forum=3&showtopic=31759 HTTP/1.0" 503 0 "-" "Mozilla/5.0 (compatible;
Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"

That was the best I could think of, short of blocking it entirely. And
who wants to block the #2 search engine, even if it's a pain? :-/

I hope it slows down a bit eventually, so that I can let at least get
some requests through again ...

bye, Dirk


-- 
http://www.geeklog.net/
http://geeklog.info/