Let’s reveal the truth about Google spiders. Let’s find out what exactly the spiders are and how to get them to crawl our websites and deliver us top search engine rankings.
Why is Google So Important?
If you’ve ever used an SEO research tool like Traffic Travis now AffiloTools, you’ll quickly see the answer to this question in the sheer number of searches compared to the other directories:

In other words, any keyword phrase gets double the results in Google than from Yahoo and MSN combined (in this case, almost triple!)
If your main passion in life is doing cross-stitch as a hobby, and you’re quite happy using the net only to find cross-stitch information, Google won’t be so important to you – in fact, you might get better results at Yahoo.
But if you’re an Internet Marketer, and you’re either selling products and services, or trying to make money through passive income methods like affiliate marketing, Google is who you’ll spend a lot of time trying to impress.
Don’t go overboard, however. Just stick to basic, solid SEO practices and you really will be rewarded with Google love, if you’ve done all your homework.
De-Mystifying Spiders – The Truth About Google Spiders
Google’s Spiders “crawling” the web brings a creepy, wonderful vision of hundreds of the monstrous metallic creatures, scurrying industriously through your computer. But the truth about Google spiders is, if we could take a peep inside, Spider Bots would look nothing like this, of course…

If you’re imaginative, you might prefer the cartoon version – but the truth is, a Google Spider Bot is just a software program running a simple, repetitive routine.
Every time a Spider Bot finds a website, it loads in all the pages, and starts following the hyperlinks on every page. When it’s done, it stores your site in it’s memory, ready to come back in a few days or weeks to check what’s new.
The more often it finds new content, the more it is likely to keep “grooming” your site.
It’s really nothing more than a librarian, patiently cataloguing a massive library, from morning to night and beyond.
But of course, “Spider Bots” sound much more dynamic than “librarians”. (Unless you’re a librarian.)
Google Guidelines and Webmaster Tools
You may not want to turn into a World Authority on SEO, but it can only be a Good Thing if you take the time to go get the facts straight from the horse’s mouth – Google.
Google’s search essentials guidelines will lay things out simply, in black and white.
Think about it: Why would you listen to half a dozen conflicting SEO “gurus”, when Google has about 75% of the information you need, right on their site? In fact, if anyone is trying to tell you to do anything, SEO-wise, that contradicts Google’s standards, walk away.
Google – The Ins and Outs of Page Rankings
Let’s demonstrate the importance of Title tags.
If you have pages whose Title tag just says “HardWorkingMarketer.com” instead of each having an individual line of text – the search engine rankings for these pages will be quite low. Your web pages will not appear on the first few pages of Google when someone enters a keyword related to your site.
In other words, this is what happens when you make all your Title tags the same, instead of giving each page an individual title.
The other sinful practice that may consign you to Google’s unofficial garbage compacter – duplicate content.
So you featured a reprint of an article on your site. Will this get that page dumped into the Google limbo, or does Google make some sort of exception for material that is supposed to be reprinted?
Instead of playing guessing games, let’s go back to the basic facts we know:
- Not changing your Title Tag for each page
- Using duplicate content
…are 2 “mistakes” guaranteed to negatively affect your page rank and possibly consign you to the bottom of Google’s Index.
Why take chances?
- Give each page a unique Title
- Write strong, original content (or have a reliable ghostwriter write them for you)
- Don’t use duplicate content.
The Truth About Google Spiders
In other words here’s the truth about Google spiders, make sure your site isn’t just regurgitating ideas and techniques found elsewhere on the web, too. Boring, unoriginal content is also likely to be ruthlessly filed in the Google Index.
As busy Internet Marketers, let’s take the simplest path, with the least resistance.
And stay away from all the “clever” solutions that Aren’t.
For more on the truth about Google spiders click here.
Leave a Reply