|
Posted by DK on November 18, 2005, 3:35 pm
Please log in for more thread options
I use certain subdirectories (i.e., www.mydomain/proofs/) in my Web site to
put early drafts and proofs of Web pages for my clients to review. I don't
want search engines to find those Web pages, because they are drafts, and I
don't want to password protect them because my clients want quick access to
them. Thus I've made sure that I never link to those pages from my regular
site. I've been under the understanding that a search engine can't find Web
pages unless it finds a link to the Web pages, from other Web pages.
However, these pages end up in the search engines anyway. How is it that
search engines can find these pages, if nobody submits the URL to the search
engine, and no links lead to the page? Can search engines get a directory of
all the files that are within a certain domain, and then index them that
way? My Web hosting company claims that the names of files on a Web site
cannot be accessed by search engines, but that is the only way I can figure
out that the search engines are finding these pages.
How do search engines find pages that have no links going to them? Your help
is appreciated!!
--
DK
| 
XML Sitemap
