« sql for rollup stats in the dspace database | Main | truncated dates in ISO 8601 »

Googlebot probing our AgEcon search engine

The Googlebot is sending in simple search requests to AgEcon. This calls our search engine. The IP that was sent the commands was 66.249.70.195 which is a legitimate google robot.

Start time : 01/Mar/2009:04:02:25
Stop time: 04/Mar/2009:09:33:29
Number of Commands: 70
Break down of commands:
query number
bse 41
Canavari 16
EQIP 13

A couple of notes, Google employs more IPs than 66.249.70.195, so there may be other queries being sent to our simple search interface. Also the ip 66.249.70.195 sent a total of 48,736 requests in that time range, so this is a small effort. I do not know why they are doing this. It may be an attempt to confirm that they are getting all the papers by "Canavari". A type of sanity check on their crawler, but I don't really know.

Post a comment

(If you haven't left a comment here before, you may need to be approved by the site owner before your comment will appear. Until then, it won't appear on the entry. Thanks for waiting.)