Google Indexing AJAX Content Via POST Requests: Facebook & Disqus

Nov 2, 2011 • 8:08 am | comments (10) by twitter Google+ | Filed Under Google Search Engine Optimization
 

AJAXRecently, people started noticing Google being able to index Facebook comments without problem. The hard part is that those comments are rendered in AJAX and only visible via POST requests. GoogleBot, Google's spider, was not able to index that type of content on the web before.

Now, Google announced they have "started experiments to rewrite POST requests to GET." They still recommend using GET requests but for AJAX and some JavaScript becoming really popular, Google knows the importance of crawling this content.

It is widely used for blog comments, such as Facebook comments and Disqus comments.

Matt Cutts confirmed this on Twitter a few hours before the Google blog post:

Cutts AJAX Content

For more details on the technical stuff around this, see the Google blog post.

Forum discussion at WebmasterWorld, Sphinn and Google +.

Previous story: Google Vince 2.0 = Google Panda 2.5.x?
 

Comments:

Web Design Bangalore

11/02/2011 01:04 pm

Really it indexes the Facebook Comments.... Gr888

Gary Stock

11/02/2011 02:01 pm

Hmm... GoogleBot can avoid the dreaded "403 Bad Behavior" (or worse) while making one automated POST after another, around the clock?  Apparently, Facebook ~wants~ Google to have this access. 

HISWebMarketing

11/02/2011 04:18 pm

I haven't seen any evidence of my static site's disqus comments being indexed yet.  I really hope they are soon!  I was going to dig into the API and build a database to store them, but if Google will index them then this will save me a lot of time.

Mark Collier

11/02/2011 08:13 pm

Very surprising they couldn't index these crucial pieces of web content before, but great they can now.

Web Designer

11/05/2011 12:23 pm

Wow,  did Google really  indexes the Facebook Comments...?

Jswati

12/20/2011 07:27 am

I really hope they are soon!  I was going to dig into the API and build a database to store them, but if Google will index them then this will save me a lot of time.

Johnthomas0301

01/04/2012 06:26 am

Hmm... GoogleBot can avoid the dreaded "403 Bad Behavior" (or worse) while making one automated POST after another, around the clock?  Apparently, Facebook ~wants~ Google to have this access.

Usemeplz

01/13/2012 01:08 pm

Interesting news, let's see what Google can do with this system. Frankly speaking, I'm afraid of that big steps by Google in the Internet.

Meinrad Lorimer

03/06/2012 01:23 pm

we have ther pereception of google that it work very drasitcally,  using google analytic and other tools it may be very powefull and make an action.

Spark Junction

10/08/2012 03:04 pm

It's great to read that... but I think again: the big sites will squeeze the most benefits out, since they are more commented than the "small guys" - if these comment indexing stuff will count in ranking in the future...

blog comments powered by Disqus