Brian Fitzpatrick, a software engineer manager at Google, posted on Twitter a screen shot of NBCNews.com not being indexed properly by Google.
He wrote, "NBCNews website vs. GoogleBot" followed by a screen shot showing how GoogleBot was only able to pull the title of the page but not the content or the image.
Here is his image:
The weird thing is that later, I tried it, and GoogleBot had no issues crawling the content and images on that page:
I guess GoogleBot figured it out or maybe NBCNews had a temporary glitch?
Forum discussion at Twitter.