Ideas on Washing Out Supplemental Results

Oct 31, 2005 • 1:34 pm | comments (3) by twitter Google+ | Filed Under Google Search Engine Optimization
 

A WebmasterWorld thread created by steveb named How to remove (some) Supplemental Listings has a theory on how one might be able to remove some of those supplemental results found for a site command. We all hate them, some are even embarrassed of them, many have travelled great voyages to remove them. This is the tale of SteveB's voyage.

The current situation: Google refuses to recognize a 301 of a Supplemental listing. Google refuses to delete a Supplemental listing that is now a nonexistent 404 (not a custom 404 page, a literal nothing there) no matter if it is linked to from dozens of pages. In both the above situations, even if Google crawls through links every day for six months, it will not remove the Supplemental listing or obey a 301. Google refuses to obey its own URL removal tool for Supplementals. It only "hides" the supplementals for six months, and then returns them to the index.

As of the past couple days, I have succeeded (using the below tactics) to get some Supplementals removed from about 15% of the datacenters. On the other 85% they have returned to being Supplemental however.

Some folks have hundreds or thousands of this type of Supplemental, which would make this strategy nearly impossible, but if you have less than twenty or so...

1) Place a new, nearly blank page on old/supplemental URL.

2) Put no actual words on it (that it could ever rank for in the future). Only put "PageHasMoved" text plus link text like "MySiteMap" or "GoToNewPage" to appropriate pages on your site for a human should they stumble onto this page.

3) If you have twenty supplementals put links on all of them to all twenty of these new pages. In other words, interlink all the new pages so they all have quite a few links to them.

4) Create a new master "Removed" page which will serve as a permanent sitemap for your problem/supplemental URLs. Link to this page from your main page. (In a month or so you can get rid of the front page link, but continue to link to this Removed page from your site map or other pages, so Google will continually crawl it and be continually reminded that the Supplementals are gone.)

5) Also link from your main page (and others if you want) to some of the other Supplementals, so these new pages and the links on them get crawled daily (or as often as you get crawled).

6) If you are crawled daily, wait ten days.

7) After ten days the old Supplemental pages should show their new "PageHasMoved" caches. If you search for that text restricted to your domain, those pages will show in the results, BUT they will still ALSO continue to show for searches for the text on the ancient Supplemental caches.

8) Now put 301s on all the Supplemental URLs. Redirect them too either the page with the content that used to be on the Supplemental, or to some page you don't care about ranking, like an "About Us" page.

9) Link to some or all of the 301ed Supplementals from your main page, your Removed page and perhaps a few others. In other words, make very sure Google sees these new 301s every day.

10) Wait about ten more days, longer if you aren't crawled much. At that point the 15% datacenters should first show no cache for the 301ed pages, and then hours later the listings will be removed. The 85% datacenters will however simply revert to showing the old Supplemental caches and old Supplemental listings, as if nothing happened.

11) Acting on faith that the 15% datacenters will be what Google chooses in the long run, now use the URL removal tool to remove/hide the Supplementals from the 85% datacenters.

Will the above accomplish anything? Probably not. The 85% of the datacenters may just be reflecting the fact that Google will never under any circumstances allow a Supplemental to be permanently removed. However, the 15% do offer hope that Google might actually obey a 301 if brute forced.

Then, from now on, whenever you remove a page be sure to 301 the old URL to another one, even if just to an "About Us" page. Then add the old URL to your "Removed" page where it will regularly be seen and crawled. An extra safe step could be to first make the old page a "PageHasMoved" page before you redirect it, so if it ever does come back as a Supplemental, at least it will come back with no searchable keywords on the page.

Examples of 15% datacenter: 216.239.59.104 216.239.57.99 64.233.183.99 Examples of 85% datacenter: 216.239.39.104 64.233.161.99 64.233.161.105

Three pages of posts later, the thread makes for a real whopper. SteveB writes, "bottom line, no 301 redirect of a Supplemental has been obeyed on 100% of Google's datacenters, even though in all cases there was a current (non-supplemental) page regularly crawled on that URL. (It sounds so confusing to even type...)"

I had a similar issue with a site. What did I do? Some 301's, waited... Some 404's waited... Some more 301s and 404s and waited. Then a combination of more 301s, 404s, more links, and Google Sitemaps. Finally, the site is looking healthier. Took over a year - oh, I didn't work to fast. :)

Previous story: Yahoo & Google Keep Hiring
 

Comments:

Joeduck

11/06/2005 08:13 pm

Supplementals can be high quality pages as well and I'd be interested in other's observations about highly relevant pages that "go supplemental". It appears to me that "going supplemental" is more often a penalty/filter process by Google than anything else, though the Guidelines imply otherwise.

John West

11/07/2005 11:12 pm

Google moves so slowley. One of the reasons I could think of for them not removing suplementals, upon request from webmasters or otherwise, is that when they do they decrease their results count for searches. It's part of their bulstering of finding more pages than all other engines. 20 million pages looks better than 2 million pages for the same query. Thank You, John West ( <a href="http://www.4remotesupport.com"> Remote Support </a>

Jack Costain

04/17/2006 03:16 pm

"The current situation: Google refuses to recognize a 301 of a Supplemental listing." Not in my experience! I currently have 41 supplemental pages shown in site: wwww.myoldsite.co.uk and they are all being permanently redirected to a new domain. Regards Jack

blog comments powered by Disqus