Entries from Search Engine Roundtable tagged with 'indexing'

Here is the weird Bing comment for the day. Brett Yount, the Program Manager at Bing Webmaster Center, told webmasters to submit their site to Digg or Yahoo Buzz to help get their pages indexed. I kid you not! A...

Posted on January 5, 2010 8:32 AM

A Google Webmasters Help thread has a webmaster worried that Google has not downloaded his XML Sitemap file in about five days. I went to check the status of my sitemap file in Google Webmaster Tools and Google has not...

Posted on April 20, 2009 8:31 AM

About a week ago, we ran a poll asking Who's To Credit For Faster Indexing? The options included Google Sitemaps or FeedBurner, due to the topic we were discussing. The results are now in and the majority said, Google Sitemaps,...

Posted on January 15, 2009 9:19 AM

An SEOMoz post charts the positive impact having a Sitemap file can have on the speed of Google and Yahoo crawling and indexing your web pages. The report seems pretty impressive and I myself feel that Sitemaps are important to...

Posted on January 9, 2009 8:36 AM

Many SEOs use the site command to see how healthy their site is in a particular search engine. So you plug in site:www.mydomain.com in a search engine and the search engine will return the number of pages they have indexed...

Posted on November 26, 2008 8:10 AM

I found an interesting tidbit while reading a somewhat detailed thread at Google Groups. The scenario is as follows. You have blocked Googlebot from accessing your site for a 6 month period or so. Then you want to welcome Googlebot...

Posted on November 14, 2008 7:07 AM

A typical thread I see from time to time in the forums are from webmasters who see Googlebot trying to access their site, but their site is not publicly available. For example, a Google Groups thread has a webmaster from...

Posted on October 20, 2008 8:24 AM

A WebmasterWorld thread reports Ask.com's crawler has seemed to slow down to a halt. Some webmasters are reporting zero crawling activity from Ask.com, while others are reporting extremely limited crawling activity. WebmasterWorld moderator, jdMorgan, noticed the slow down to, he...

Posted on July 18, 2008 8:14 AM

An unusual question came up at WebmasterWorld, asking if you can request a site to be completely removed from a country specific Google search engine. For example, the site owner wants to remove his site from Google Netherlands, because the...

Posted on June 20, 2008 8:01 AM

In October, a WebmasterWorld member has been monitoring his website and has noticed that Google is beginning to index pages that seem unlinked from anywhere. He suspects that either Google is using Toolbar data, someone is linking to these pages...

Posted on February 19, 2008 9:26 AM

Just a tidbit based on a Google Groups thread, using the Google Remove URLs feature will only remove the content from Google for 90 days. After 90 days, if you do not block the page from crawlers or tell crawlers...

Posted on January 22, 2008 7:25 AM

A WebmasterWorld thread reports that new installations of the popular blogging software, WordPress, is by default blocking all search engines. He said, when you go to the Privacy Options section in the administration panel, by default, it is set to...

Posted on January 22, 2008 6:53 AM

A Google Groups thread asks if there's any such penalty for using the z-index HTML attribute underneath images. Would that be deceiving the search engines if you're putting text underneath an image that is not apparent to the visitor? Bergy...

Posted on November 15, 2007 10:02 AM

A WebmasterWorld thread has dozens of reports that Google's page index counts of sites have been bouncing up and down like a rollercoaster. By page index site, I assume they mean the number of pages Google reports when you conduct...

Posted on October 2, 2007 8:08 AM

A Cre8asite Forums thread asks how can he generate unique robots.txt files for each domain he has, when each of those sites are sharing the same local files through a form of IIS mirroring? There are several ways to do...

Posted on August 30, 2007 7:03 AM

I found a pretty cool tool in DigitalPoint Forums yesterday, and the concept is very interesting. Instead of typing "site:domain.com" obsessive compulsively in a Google Search box to find out if your site is being indexed, why not get notified...

Posted on August 17, 2007 9:46 AM

It seems to be the consensus on a DigitalPoint Forums thread that if you post your URL to Yahoo! Answers, Yahoo will index your site a lot quicker than you'd normally expect. A member asks how long it takes for...

Posted on July 25, 2007 10:06 AM

Is there any mileage to the claim that it is possible to get your site spidered faster if you integrate the Google Custom Search Engine into your website? This is the question a new webmaster is asking on the High...

Posted on July 16, 2007 9:08 AM

In a Google Groups thread, a member has set up a subdomain on a domain and has duplicate content on the main domain: in a nutshell, domainB.domainA.com and domainB.com is pointing to the same content To avoid duplicate content issues,...

Posted on June 18, 2007 9:36 AM

On a recent WebmasterWorld thread, a member asks how the multitude of identical news stories in Google News are handled. Question: how does the dupe issue effect google giving me credit? The articles are identical but I am not sure...

Posted on April 20, 2007 8:45 AM

A Cre8asite Forums thread links to a blog post named GoogleBot Requested a CSS File. This is not the first time I heard threads where people suspect GoogleBot is crawling their CSS files. But this one has the most discussion...

Posted on January 5, 2007 7:51 AM

A WebmasterWorld thread asks "How does Google determine which pages to crawl?" Google didn't always crawl and index pages as they do now. With the Big Daddy update Google adapted their crawl priorities, which was around April 2006. Google now...

Posted on December 28, 2006 7:43 AM

An Adam Lasnik post in Google Groups sprung a post at Cre8asite Forums explaining that if you have bad HTML, Google will be OK with it. Yes, that is the case, your code does not need to be 100% validated...

Posted on December 25, 2006 8:09 AM