obtaining permission

Do you have a question? Post it now! No Registration Necessary.  Now with pictures!

Threaded View

I made a recent original post and received the following response from a
clp.misc regular:

Larry Gates wrote:
Quoted text here. Click to load it

I don't know. It works for me.

However, the site disallows via robots.txt automatic access to their
cgi-bin, so whatever you are attempting to do, you'd better stop doing it.

#end excerpt

I thought I would be clever and avoid such issues by chooosing the most
small c catholic thing I stumbled upon and ambled instead on Tad's

However, what you appear to be doing violates Google's ToS:


    you agree that when using the Service, you will not:
    use any robot, spider, site search/retrieval application, or other
    device to retrieve or index any portion of the Service or collect
    information about users for any unauthorized purpose;

# end second excerpt

First of all, I don't think of extensions of my keyboard as a robot.
Robots don't consist of 2 sprained hands and no spares.

Secondly, I send these sites many fewer keystrokes with perl than I do with
my browser.

Thirdly, I've got all the time in the world to obtain explicit legal
permission to do what I want with either of these entities.

How do I do this?
larry gates

Any false value is gonna be fairly boring in Perl, mathematicians

larry gates

That's a valid argument.  I just don't think it's valid enough.  :-)

Re: obtaining permission

Larry Gates wrote:

Quoted text here. Click to load it
Quoted text here. Click to load it

If you automate something to obtain data from a remote site
infrequently, you are likely fine, if it's just a replacement for using
your browser and saving a file.  If you plan to do it frequently or
have a site that enacts the connection/download each time someone
visits a script/area of your site, then it could be (or will be) more
frequent, even creating a load on the remote site.  So, ask that site
admin or webmaster contact.  I don't understand the question about how
you get permission, other than to suggest you contact the appropriate
contact person at said site/company and ask.  Another issue is if they
block any non common user agents in an effort to prevent automated
scripts.  There could be a number of reasons beyond that about why they
forbid it on their site.
Tim Greer, CEO/Founder/CTO, BurlyHost.com, Inc.
Shared Hosting, Reseller Hosting, Dedicated & Semi-Dedicated servers
and Custom Hosting.  24/7 support, 30 day guarantee, secure servers.
Industry's most experienced staff! -- Web Hosting With Muscle!

Site Timeline