A client has asked me how to block a spider called "cursor" from spidering their site as it appears to be eating bandwidth.
I can find very little about "cursor" except that it refers me to a Hungarian site called adcenter dot hu
anyone seen or heard of this ?
I just want to add an exclusion in a robots file, I can't find anything useful on robotstxt dot org or any where else on www
I can find very little about "cursor" except that it refers me to a Hungarian site called adcenter dot hu
anyone seen or heard of this ?
I just want to add an exclusion in a robots file, I can't find anything useful on robotstxt dot org or any where else on www
Comment