Do you have a question? Post it now! No Registration Necessary. Now with pictures!
November 16, 2003, 12:23 am
rate this thread
a few days ago i added a robots.txt to several sites... the useragent was a
specific annoying robot (but not googlebot and there was no * in the whole
page)... it seems that 80% of the sites just dropped like a rock (many not
found in first 15 pages when they used to be on the 1st page) about 2 days
after... (i noticed this today)...
soo... has anyone noticed this before? it seems quite coincidental to me....
i just removed the robots.txt file from all sites and now will wait to see
if they come back up... is it a fluke not related to robots.txt? or i guess
it can be a permanent change? we shall see...
but i am wondering if anyone has ever seen this?