Do you have a question? Post it now! No Registration Necessary. Now with pictures!
- Posted on
- Yahoo is crawling like hell
- Gerhard Buergmann
December 14, 2004, 10:15 am
rate this thread
Re: Yahoo is crawling like hell
seperate robots stats from the rest of the stats, and see which robot came
when, what it asked for, what it had problems getting etc etc.
I have seen AW stats come close, but not detailed enough info is shown.
| Yesterday I had 1957 hits from Yahoo bot coming from
| 688 different IP adresses!
| Maybe other bots work similar.
| Of course this destroys my "Unique Visitors" statistic.
| How do you solve this problem?
- » F/A: eBay: PC Games, Software grab bag assortment cheap
- — Previous thread in » Search Engines