05
Dec
08

If you use Web CEO, SpyFu, or SEOmoz’s Rank Checker then you are dishonest.

Warning: If you’re the type of person who would rather remain in ignorance because you think that makes you innocent of any crime because you don’t know if you’re committing one or not, then you probably won’t want to continue reading. Of course now that you’ve read this it’s too late.

I’m not necessarily accusing you of being a liar, unethical, or dishonest, but I had to get your attention somehow and apparently the post title worked. And if you use one of the tools mentioned in the post title, there’s at least a chance that you are doing something dishonest. First, try out this simple self-test to determine whether you’re an honest person or not:

1. Do you steal things from stores?

2. Do you tell lies or misrepresent things?

3. Have you ever charged a client for SEO services you never provided?

4. Have you ever made outrageous claims you knew were false about your SEO services, just to get a client to sign up?

5. Have you ever signed a contract and then violated it because it was beneficial to you and you knew you could get away with it?

6. Have you ever used Web CEO, SpyFu, SEOmoz’s Rank Checker, or any other similar programs?

If you’re thinking that question #5 doesn’t seem to fit with the others, then you’re where I was a few months ago. But then I started doing some research and stumbled onto section 5.3 of Google’s Terms of Service, which reads:

5.3 You agree not to access (or attempt to access) any of the Services by any means other than through the interface that is provided by Google, unless you have been specifically allowed to do so in a separate agreement with Google. You specifically agree not to access (or attempt to access) any of the Services through any automated means (including use of scripts or web crawlers) and shall ensure that you comply with the instructions set out in any robots.txt file present on the Services.

Tools like Web CEO, SpyFu, and SEOmoz’s Rank Checker (as near I can tell) all perform automatic queries of Google. They also display data from Google within an interface that is not provided by Google. Therefore, these tools violate the Google Terms of Service, as do you when you use these tools.

There seem to be three primary arguments for ignoring section 5.3 of the Google Terms of Service:

1. I’ll never get caught or be punished.

2. Everyone else is doing it.

3. It doesn’t hurt anyone.

4. Google doesn’t care anyway.

5. The intent of section 5.3 isn’t to stop programs like SpyFu or SEOmoz’s Rank Checker.

Let’s take these one at a time.

1. I’ll never get caught or be punished. The same rationalization is used by many, if not most, criminals. Would you say that somebody who has a foolproof way to steal cars and never get caught is an honest person? Of course not. Whether or not someone ever gets caught or punished has nothing to do with whether they are honest or not.

2. Everyone else is doing it. Just because everyone else is doing it doesn’t make it an honest act. The same logic has been used for downloading pirated music and movies, doing drugs, and killing Jews.

3. It doesn’t hurt anyone. To say something doesn’t hurt anyone is speculative at best, and merely a way to make one feel better about actions they are uncomfortable with but want to justify somehow. People use the same logic to steal from Wal-Mart. After all, they’re just a big corporation, so how does me stealing some batteries hurt anyone? That argument can be made, but it is, admittedly, a more difficult argument to make when it comes to automatically querying Google. But it doesn’t matter. Whether or not it hurts Google or anyone else doesn’t change the fact that automatically querying Google is a violation of their terms of service.

4. Google doesn’t care anyway. Just as with #3, the same goes for claiming that Google doesn’t care. First of all, you’re making an assumption that may or may not be true, and second, it doesn’t matter. Violating an agreement is breaking your word and being dishonest, regardless of how the person or entity you’ve made that agreement with feels about it. If they don’t care, then they can let you out of the agreement, but for someone to make an agreement and then break it based on the assumption the other party doesn’t care is still dishonest.

5. The intent of section 5.3 isn’t to stop programs like SpyFu or SEOmoz’s Rank Checker. This is the only way out, but it’s a hard case to make. In order to say that you are not breaking your agreement with Google, you would have to somehow claim that Google does not mean what they seem to be saying. That the words they are using mean something other than what those words generally mean. You would have to be able to prove that when Google says they don’t want you to “access (or attempt to access) any of the Services by any means other than through the interface that is provided by Google” that this does not apply to Web CEO. You would have to be able to read the words “You specifically agree not to access (or attempt to access) any of the Services through any automated means (including use of scripts or web crawlers)” and interpret that as not applying to how SEOmoz’s Rank Checker gets its data. If you can do that, I’d like you to explain it to me, because I can’t see any way around it.

So what is the intent of section 5.3? My opinion is that it truly is not intended to target services like Web CEO or SpyFu. I believe Google included section 5.3 as a safety measure to give them the ability to prosecute anyone doing such things if Google deems it worth pursuing. I can imagine a meeting between Google and their lawyer going something like this:

Google: “Hey, what about this section 5.3? Why do we need that in there?”

Lawyer: “Because you might need to use it some day.”

Google: “What do you mean? I can’t see any reason why I’d need to stop anyone from automatically querying us? I mean, I know these tools like Web CEO and SEOmoz Rank Checker are doing it, but we don’t care about that stuff.”

Lawyer: “You might not see a reason today, and even I can’t think of a reason, but you should put it in there any way just in case. Something may happen that you can’t foresee that damages your business and that section may be the only way you can prosecute the offender and stop it.”

I’m 99.99% sure if Web CEO or any other company talked to Google and Google were completely transparent, Google would say “Go ahead, we don’t care.” But of course Google can’t say that publicly, because that could be used against them in a court of law if they ever did want to sue someone based on section 5.3.

If my opinion is correct, then that’s pretty annoying, isn’t it? After all, how are we supposed to track rankings for our client? By checking them manually? What if we’ve got 50 clients and each one has 200 keywords they’re tracking? Well, then you’ve got a problem. But people have problems all the time. What if everybody said “Hey, I believe in being honest when it’s in my favor, but if it benefits me to break my word then I don’t think that’s dishonest.” That’d be a nice world to live in, wouldn’t it?

Honest people are honest whether or not they’ve got problems and regardless of the money involved. Here’s what real honesty looks like.

Jon Huntsman owned the largest private business in the world–Huntsman Chemical. He’s mostly retired now and is funneling his billions of dollars into curing cancer. In 1986 Jon Huntsman agreed to sell 40% of his company to Emerson Camp, the chairman and CEO of Great Lakes Chemical for $54 million. They shook hands on the deal, but then Emerson lagged on getting the paperwork together. Six months later, nothing had been done on the deal, and Huntsman’s company had done spectacularly well and some things had happened with the economy so that in that short time period that 40%, instead of being worth $54 million, was now worth $225 million, or $171 million more than it was worth just six months earlier.

Emerson came to Huntsman and said that he knew the business was worth about $200 million. Huntsman told him no, it was worth about $225 million. Emerson suggested they split the difference, and that he would pay $125 million for the 40% of the business. Huntsman told him no, he wouldn’t do that deal. He told him he had shook his hand six months earlier and told him he would sell him that part of the business for $54 million, and that’s what he was going to stick to because he had given his word.

So are you an honest person? If you like to think that you are, and you use these SEO tools, then what decision are you going to make that will allow you to sleep at night?

Now, is there some way out of this? Perhaps. A company can try to make an agreement with Google so that they have permission to automatically query the search engine. I’ve tried that myself, but have been unable to get a response. And so far I haven’t found anyone else who has been successful either. If you know of someone who has made such an agreement, I’d love to talk to them. Or if you see some other way around this that allows a company to automatically query Google without violating the terms of service, I’d love to hear about it, because I like these tools and would like to be able to use them without feeling like I’m a dishonest person.


5 Responses to “If you use Web CEO, SpyFu, or SEOmoz’s Rank Checker then you are dishonest.”


  1. 1 Scott Dec 5th, 2008 at 4:35 pm

    Like many others, my early work history includes work at grocery and consumer electronics stores. There was usually a posting some where in the store that asked that you not loiter, you not take pictures, and in some fashion, make the experience unenjoyable for other shoppers – often in lawyerease to be sure…

    Read the first example here:
    http://arstechnica.com/news.ars/post/20081204-editorial-does-amazons-iphone-app-go-too-far.html

    “In the official App Store description of its new iPhone app, the company suggests it can be used for “comparing prices on Amazon and 9,000 other merchants to those in the retail store you are visiting.”"

    So… if the TOS says not to take pictures, guess you can’t take a picture for your pricing app to work or your dishonest, eh? Better just buy those printer cartridges and computer supplies from Staples rather than loitering there, taking up their floor bandwidth.

    You can loiter as a special class, think elderly mall walkers. Hey, they got no place to go eh? But not as a group of kids. Hey, they got no place to go. Both take up “bandwidth” in real life and likely are loitering despite signs asking that people not do so.

    Plus it is disingenuous for Google to say that it doesn’t want apps scanning their database, then they go and do the same thing to others. When they promote “net neutrality” and say that want the internet open to all, so that carriers can’t discriminate against competing apps… so what’s good for the goose is not good for the gander?

    You could put a TOS on your site that says Google must pay you $1,000,000 if it scans your site. Dude, they’re not going to pay. Does this make them dishonest? Does this even mean that their scanning was “illegal”??

  2. 2 Joshua Steimle Dec 5th, 2008 at 4:53 pm

    The TOS doesn’t make automatic querying of their site illegal, it means they have the right to sue for damages in court if the TOS is violated.

    But my point doesn’t have anything to do with legality vs. illegality but rather honesty vs. dishonesty, and they don’t always overlap. The point is that you enter into an agreement with Google when you use their site, and that if you use these tools you are violating that agreement. Whether or not Google would win or lose in court or sue in the first place isn’t the point, the point is that if you knowingly violate the agreement you are breaking your word.

    I suppose you bring up a sixth reason for ignoring the TOS:

    6. Google does dishonest things to others, so why can’t I do it to them? That is, if Google violates the TOS of another website, why shouldn’t we be allowed to violate their TOS? Although somehow this seems fair, it doesn’t meet the definition of honesty. Dishonest actions against a certain party aren’t made honest if the targeted party is dishonest themselves. Stealing from a thief is still stealing.

    So while I agree that it may be disingenuous of Google to have section 5.3 in their TOS when they violate in similar manner the TOS of other sites, that doesn’t change the point I’m making.

  3. 3 David Temple Dec 6th, 2008 at 5:25 am

    Point taken but aren’t you being dishonest yourself? You aay “I’m not necessarily accusing you of being a liar, unethical, or dishonest..” but in fact that’s exactly what you are doing. In fact you are being dishonest about being dishonest and that’s truly dishonest.

  4. 4 Joshua Steimle Dec 6th, 2008 at 12:31 pm

    I’m not accusing somebody who doesn’t know anything about section 5.3 of being dishonest (which I believe covers most people). In addition, somebody might have an interpretation of section 5.3 that they feel doesn’t prohibit them from automatically querying Google. I don’t know how that’s possible, but I’m not ruling it out.

  5. 5 Firestorm Mar 13th, 2009 at 9:34 pm

    @Davit Temple – honestly… nice comment.

    @Joshua Steimle – nice article. ranks well for some specific keyword sets – bravo! we write contracts all the time for specific contingencies for when a client is recalcitrant. most often, a client will violate these sections, but we don’t enforce them, because it was an “honest” mistake… or whatever. point is… well… not sure i have one.

Leave a Reply