Having Google +1 button on a page will override robots.txt blocks!

Now this one is interesting.I just found this answer from a google employee in one of their forum threads. The +1 Button is only intended to be used on pages that contain all public content. By putting the button on a page we’re taking it as an indication from you that this page is public content. This means that we will fetch your page even if crawler directives indicate otherwise.

This entry was posted in Uncategorized and tagged , , , , , , , , , . Bookmark the permalink.