People in the search marketing industry are so obsessed with search engines. All they can seem to talk about is how to please the search engines, get on their good sides, and kiss up to Matt Cutts in some way shape or form. But so many people never talk about the different reasons you might want to break off a relationship.
I thought it would be fun to take a look at a few ways you can break up with a search engine and manage your relationships.
Time to call it quits. Maybe you have a private member website, want privacy, or simply don’t want your site to be in the search engine results.
To cut off all communication and break the heart of that poor search engine robot, insert the following into the header section of your pages:
“It’s nothing personal, I still really like you, but we make better friends than lovers.” Maybe you don’t want the search engines to index your pages (maybe you’re trying to combat duplicate content?), but you still want them to follow your links and find other pages of your site.
Use this in the header section of your pages:
The search robot found out you were cheating and decided to pull your rankings. There’s nothing worse than a messy break up. Better make up as soon as possible. Leave behind your unfaithful ways and beg for forgiveness.
Sometimes it’s ok to see other people for a while. Maybe you have a reason to want to include Googlebot, but exclude Yahoo Slurp from your website. Or maybe you want to exclude a specialized bot like Linkscape, image search, etc.
The best way to allow and disallow certain robots is through robots.txt. Here is a link to a very thourough tutorial on the subject of creating and using a robots.txt file.
Let’s face it, you know you are in love. You’ve become obsessed with this relationship. All your friends tell you that you need to break it off. This confined intimacy is killing you, and you don’t even know it. You’ve become so dependent upon approval that your entire livelihood is wrapped up in it. You sit around at home wondering why she doesn’t call (err, crawl) as often as she used to.
Don’t get too obsessed with the search engines. You want a steady long lasting relationship, not a one night stand.
===
Yes, this was more of a fun post, and I didn’t include alot of “details” about how to disallow certain robots, proper use of robots.txt, excluding certain directories, using webmaster tools, etc… so if you have any questions, please comment and I’ll answer any specific questions you have…
Too funny Justin! We also enjoy the “looking for love” websites, the ones wandering around without meta tags… searching for the Mr. Perfect mindreader robot
Always good info - thanks!
What a great blog….and I thought I had to call them….
Bart Smith
Yes, way to funny. But here is an idea, what is the best bait for the search engine lover bot to use while still writing for normal humans?
Great post! Got a laugh out of it, but I don’t think I’ll be breaking up anytime soon. Wish I could figure out how to make the robot monogamous!