Announcement

Collapse
No announcement yet.

robots cursor

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

    robots cursor

    A client has asked me how to block a spider called "cursor" from spidering their site as it appears to be eating bandwidth.

    I can find very little about "cursor" except that it refers me to a Hungarian site called adcenter dot hu

    anyone seen or heard of this ?

    I just want to add an exclusion in a robots file, I can't find anything useful on robotstxt dot org or any where else on www

    #2
    The only other reference I have found of this is a search for 'Spider Cursor' that brings up a document on a data analysis tool. Does any one else know anything about this one?

    Kind regards,
    Bruce King
    SellerDeck

    Comment


      #3
      since its in the logs, can i have the ip address and other information thats the spider wanted? what about the files it was interested in? 404s it made? searching for mp3/mpg/swf/html?


      edit ==>
      look here too, however, you'll not find 'cursor' sounds new.
      http://www.user-agents.org/index.shtml

      Comment


        #4
        is this the string:
        Code:
        Kurzor/1.0 (Kurzor; http://adcenter.hu/docs/en/bot.html; cursor@easymail.hu)

        if so, the this:
        http://kurzor.hu/

        is the search engine spidering your client.

        its blockable. its only for hungarian people.

        /me spits on hungarian search engine.

        Comment


          #5
          that looks like the pesky thing...

          I've got no more info in the AWstats other than under Robots/Spiders visitors, "Cursor" is the top visitor at 1106 hits this month.

          again in awstats you can click on "cursor" which takes you to adcentre dot hu

          So to disallow this one i'd use

          User-agent: Kurzor
          Disallow: /
          User-agent: *
          Disallow:

          or even

          User-agent: Cursor
          Disallow: /
          User-agent: Kurzor
          Disallow: /
          User-agent: *
          Disallow:

          Comment

          Working...
          X