[geeklog-devel] GoogleBot likes the File Management plugin
Dwight Trumbower
dwight at trumbower.com
Thu May 1 10:14:00 EDT 2003
At 03:41 PM 5/1/2003 +0200, you wrote:
>I wrote:
>
> >Well, the answer is: GoogleBot. Of the 1453 downloads that file currently
> >has, 1284 come from the GooglBot!
>
>More details: On April 26th alone, 344 instances of Googlebot (all from
>different IP addresses) downloaded 360 copies of the file.
>
>Fortunately, the File Management plugin is only 140 KB, so this amounted
>to 50 MB of traffic - on one day. If you have huge files and a traffic
>limit, this could become expensive.
>
>It may be a good idea to add a pointer to <http://www.robotstxt.org/> to
>the documentation of the File Management plugin ...
>
>bye, Dirk
>
>
>--
>http://www.haun-online.de/
>http://mypod.de/
What are the ip address range, maybe they are not really from googlebot?
Dwight
More information about the geeklog-devel
mailing list