Do you have a question? Post it now! No Registration Necessary. Now with pictures!
- Larry Gates
February 24, 2009, 8:33 pm
rate this thread
I made a recent original post and received the following response from a
Larry Gates wrote:
I don't know. It works for me.
However, the site disallows via robots.txt automatic access to their
cgi-bin, so whatever you are attempting to do, you'd better stop doing it.
I thought I would be clever and avoid such issues by chooosing the most
small c catholic thing I stumbled upon and ambled instead on Tad's
However, what you appear to be doing violates Google's ToS:
you agree that when using the Service, you will not:
use any robot, spider, site search/retrieval application, or other
device to retrieve or index any portion of the Service or collect
information about users for any unauthorized purpose;
# end second excerpt
First of all, I don't think of extensions of my keyboard as a robot.
Robots don't consist of 2 sprained hands and no spares.
Secondly, I send these sites many fewer keystrokes with perl than I do with
Thirdly, I've got all the time in the world to obtain explicit legal
permission to do what I want with either of these entities.
How do I do this?
Any false value is gonna be fairly boring in Perl, mathematicians
That's a valid argument. I just don't think it's valid enough. :-)
Re: obtaining permission
If you automate something to obtain data from a remote site
infrequently, you are likely fine, if it's just a replacement for using
your browser and saving a file. If you plan to do it frequently or
have a site that enacts the connection/download each time someone
visits a script/area of your site, then it could be (or will be) more
frequent, even creating a load on the remote site. So, ask that site
admin or webmaster contact. I don't understand the question about how
you get permission, other than to suggest you contact the appropriate
contact person at said site/company and ask. Another issue is if they
block any non common user agents in an effort to prevent automated
scripts. There could be a number of reasons beyond that about why they
forbid it on their site.
Tim Greer, CEO/Founder/CTO, BurlyHost.com, Inc.
Shared Hosting, Reseller Hosting, Dedicated & Semi-Dedicated servers
and Custom Hosting. 24/7 support, 30 day guarantee, secure servers.
Industry's most experienced staff! -- Web Hosting With Muscle!
- » FAQ 7.17 What's the difference between dynamic and lexical (static) scoping? Between loca...
- — Previous thread in » PERL Discussions