Click here to get back home

how to stop google spidering https links

 HomeNewsGroups | Search

alt.www.webmaster - All aspects of webmastering business 

get this group's latest topics as an RSS feed add this group's latest topics to your My MSN content add this group's latest topics to your My Yahoo content
Subject Author Date
how to stop google spidering https links Sparticle 05-18-2009
Posted by Sparticle on May 20, 2009, 9:05 am
Please log in for more thread options
wrote:

show/hide quoted text


I have used absolute links. If you use relative links you end up with
the whole site having a duplication problem. (when you apply SSL to
the domain name.)

The weird thing is that when I tried to create an XML site map.
Any software I used still found both http:// AND https:// links.
[again.... a duplication problem]

If I put "nofollow" that kills off the http:// links being picked up
also.

Thank you.

Sparticle.


Posted by Adrienne Boswell on May 20, 2009, 12:06 pm
Please log in for more thread options

show/hide quoted text

The way that I usually do this is that one has to sign in (via SSL) to
get to something, and since robots are unable to "sign in" they cannot
get any farther than the login page.

--
Adrienne Boswell at Home
Arbpen Web Site Design Services
http://www.cavalcade-of-coding.info
Please respond to the group so others can share


Similar ThreadsPosted
How can I stop search engine spiders from spidering my site, if I don't own a domain? October 24, 2005, 7:56 am
How do I keep google from spidering? September 26, 2005, 10:45 am
Can I Redirect https://www.... to https:// without the www March 15, 2007, 7:04 pm
Google should stop archiving June 15, 2005, 4:15 pm
Re: Google should stop archiving June 16, 2005, 11:57 am
Re: Google should stop archiving June 16, 2005, 11:33 am
Re: Google should stop archiving June 16, 2005, 12:12 pm
Re: Google should stop archiving June 16, 2005, 12:13 pm
Re: Google should stop archiving June 16, 2005, 12:39 pm
Re: Google should stop archiving June 16, 2005, 12:40 pm

Our other projects:

Art Dolls, Fairies and Mermaids - Sunnyfaces.net

Driving a better car - Fuelzilla.com

Cabling site for homeowners and pros alike - Cabling-Design.com

Friends:

Roy's Linux, Programming and Search Engines messages

1-Script XML SitemapXML Sitemap
Privacy Policy