Entries from Search Engine Roundtable tagged with 'indexing'

In October, a WebmasterWorld member has been monitoring his website and has noticed that Google is beginning to index pages that seem unlinked from anywhere. He suspects that either Google is using Toolbar data, someone is linking to these pages...

Posted on February 19, 2008 9:26 AM

Just a tidbit based on a Google Groups thread, using the Google Remove URLs feature will only remove the content from Google for 90 days. After 90 days, if you do not block the page from crawlers or tell crawlers...

Posted on January 22, 2008 7:25 AM

A WebmasterWorld thread reports that new installations of the popular blogging software, WordPress, is by default blocking all search engines. He said, when you go to the Privacy Options section in the administration panel, by default, it is set to...

Posted on January 22, 2008 6:53 AM

A Google Groups thread asks if there's any such penalty for using the z-index HTML attribute underneath images. Would that be deceiving the search engines if you're putting text underneath an image that is not apparent to the visitor? Bergy...

Posted on November 15, 2007 10:02 AM

A WebmasterWorld thread has dozens of reports that Google's page index counts of sites have been bouncing up and down like a rollercoaster. By page index site, I assume they mean the number of pages Google reports when you conduct...

Posted on October 2, 2007 8:08 AM

A Cre8asite Forums thread asks how can he generate unique robots.txt files for each domain he has, when each of those sites are sharing the same local files through a form of IIS mirroring? There are several ways to do...

Posted on August 30, 2007 7:03 AM

I found a pretty cool tool in DigitalPoint Forums yesterday, and the concept is very interesting. Instead of typing "site:domain.com" obsessive compulsively in a Google Search box to find out if your site is being indexed, why not get notified...

Posted on August 17, 2007 9:46 AM

It seems to be the consensus on a DigitalPoint Forums thread that if you post your URL to Yahoo! Answers, Yahoo will index your site a lot quicker than you'd normally expect. A member asks how long it takes for...

Posted on July 25, 2007 10:06 AM

Is there any mileage to the claim that it is possible to get your site spidered faster if you integrate the Google Custom Search Engine into your website? This is the question a new webmaster is asking on the High...

Posted on July 16, 2007 9:08 AM

In a Google Groups thread, a member has set up a subdomain on a domain and has duplicate content on the main domain: in a nutshell, domainB.domainA.com and domainB.com is pointing to the same content To avoid duplicate content issues,...

Posted on June 18, 2007 9:36 AM

On a recent WebmasterWorld thread, a member asks how the multitude of identical news stories in Google News are handled. Question: how does the dupe issue effect google giving me credit? The articles are identical but I am not sure...

Posted on April 20, 2007 8:45 AM

A Cre8asite Forums thread links to a blog post named GoogleBot Requested a CSS File. This is not the first time I heard threads where people suspect GoogleBot is crawling their CSS files. But this one has the most discussion...

Posted on January 5, 2007 7:51 AM

A WebmasterWorld thread asks "How does Google determine which pages to crawl?" Google didn't always crawl and index pages as they do now. With the Big Daddy update Google adapted their crawl priorities, which was around April 2006. Google now...

Posted on December 28, 2006 7:43 AM

An Adam Lasnik post in Google Groups sprung a post at Cre8asite Forums explaining that if you have bad HTML, Google will be OK with it. Yes, that is the case, your code does not need to be 100% validated...

Posted on December 25, 2006 8:09 AM