Yahoo, MSN Don't Index or Refer

Do you have a question? Post it now! No Registration Necessary.  Now with pictures!

Threaded View
I  have  noticed that MSN and Yahoo index less than 5% of the pages in  my
site  while  Google  is 'aware' of the existence of them all. I  tried  to
think  if  MSN  and  Yahoo  are hindered  by  JavaScript,  but  there  are
JavaScript-free routes to all pages.

Why  is it that Yahoo and MSN will not crawl deep or at least index  pages
that  are  buried  deeper in the site? Judging by the logs,  they  consume
(spider) just about as much traffic as Google. When it comes to referrals,
Google  delivers  almost 100 times the amount of referrals from Yahoo  and
MSN combined. How can this be?

Help appreciated,


Re: Yahoo, MSN Don't Index or Refer

Roy Schestowitz wrote:

Quoted text here. Click to load it

Looking at last 7 days data, I got 95% of SE traffic from Google, 2.2%
from Yahoo and 0.6% from MSN.  
Yet, the downloaded amount data goes like this:
Yahoo! Slurp: 603.6Mb
msnbot: 278.5MB
Googlebot (Freshbot):112.7MB
Googlebot (Deepbot): 155.9Mb

The only way I can see this happening is that Y and MSN do not deem my
pages important enough to include in the indices, but still important
enough to keep banging on them. I would already disallow both Y! and MSN
if I would not be #1 on one of the most important keywords in both. That
said, however, I have to admit that being #1 on Y! or MSN only warms one's
heart and nothing else :-) as far as traffic is concerned.

See Site Sig Below

Article posted with Web Developer's USENET Archive
Web and RSS gateway to your favorite newsgroup - - 17921 messages and counting!

Site Timeline