[geeklog-devel] GoogleBot likes the File Management plugin

[Dirk Haun]

I wrote:

>Well, the answer is: GoogleBot. Of the 1453 downloads that file currently
>has, 1284 come from the GooglBot!

More details: On April 26th alone, 344 instances of Googlebot (all from
different IP addresses) downloaded 360 copies of the file.

Fortunately, the File Management plugin is only 140 KB, so this amounted
to 50 MB of traffic - on one day. If you have huge files and a traffic
limit, this could become expensive.

It may be a good idea to add a pointer to <http://www.robotstxt.org/> to
the documentation of the File Management plugin ...

bye, Dirk


-- 
http://www.haun-online.de/
http://mypod.de/