|
2013-10-17, 01:39 PM | #1 |
You can now put whatever you want in this space :)
|
Blocking Unknown Robots/Spiders?
So you guys do care on what scans your domains?
if so what techniques do you guys use? I came across this blog post: http://michael.langley.id.au/blog/posts/28 Dunno if it is the better way to do this kind of thing... I'm interested in this because I check the stats on one of mine domains and got a lot of unknown robots...
__________________
|
|
|