MSN Ignoring Robots.txt Files
Posted: May 13, 2006
Is MSN ignoring robots.txt files?
Here’s a screenshot from the MSN search for ‘Marissa Meyer’:
Here’s a screenshot of Google.ca’s robots.txt file:
Seems there’s a discrepancy between Google’s robots.txt file disallowing search results to be indexed and MSN having indexed the Google file: www.google.ca/search?q=marissa+meyer+google.
Might be time to start checking MSN results to make sure certain files aren’t being indexed.
Related Information:
- Google’s Marissa Meyer...
- AdWords Updates Advanced Conversion Implementation Help Files...
- Wordpress Help Files...
- Q&A: How can I tell if Google’s Ads Bot can spider my landing page?...
- links for 2009-04-20...
Comments
Google AdWords
Seminars for Success
Learn about Google AdWords from experts hand selected by Google.
These seminars will educate advertisers on the creation and management of successful AdWords campaigns.
Upcoming Seminars:
Boston AdWords Seminars June 24th & June 25th
Minneapolis AdWords Seminars July 16th & July 17th
Denver AdWords Seminars August 4th & 5th
Learn More about the Seminars:
Seminar Information
Official Google Seminar Page
Suggest a new city
Brad Geddes
Leslie Clark
Other Memberships
