« How Will Ask Profit? Should've Asked the Prophet | Main | MSN adCenter Editorial Review, Review »
Google Can't Do It? That's News To Me!
September 22, 2006
Google, Google, He's Our Man . . .
If Google can't disallow . . . we're all screwed!
Take a look at Google's robots.txt file. In the ninth and tenth position, respectively, you should see the following:
Disallow: /news
Disallow: /nwshp
Now search for either of those exact URLs. If you want to see a disallowed page on an actual serp, try [google news and resources]
Links can produce this effect. See that "News" link on Google's home page? That points to /nwshp. And the reason why /news is showing for [google news and resources]? Take a look at who has the most links pointing to it with Google News and Resources in the anchor.
I guess the link is mightier than the disallow, even if you're Google.
All posts by Tom Lustina
posted by Tom Lustina at September 22, 2006 09:58 AM
Intrapromote: [ Case studies | SEO services | Bios ]
Trackback Pings
To TrackBack this entry, use the following URL:
http://seoblog.intrapromote.com/mt-tb.cgi/289