I'm glad somebody is finally reporting on this.
GGW, have you noticed the same change? I sure have over the past few months.
-----------------------------------------------------------
Google Grumbles
By Brian Livingston
February 18, 2004
eWEEK's Brian Livingston finds that Google, the renowned search engine, is having a relevance problem in its search engine results. Read why. Google.com is such a sacred cow in the search business that I hate to be anything other than worshipful. But it's beginning to appear that Google's results pages have developed a problem with relevance, based on my experiences and those of my readers.
In coming to this conclusion, I'm most indebted to John Meyer, the president from 1985 to 1990 of Ventura Software, the maker of Ventura Publisher. He's tested many more examples than I can possibly print here.
Meyer and I compared the results at Google.com against those of Google Groups (the archive of Usenet posts that Google acquired in 2001) and Teoma.com, the technology launched in April 2002 that now powers the Ask.com search engine.
Let's say an executive at your company has copied files from a Mac to a PC. Then you get a phone call. You learn that several files on the PC can't be deleted because they bear characters that are illegal in Windows file names.
Looking for a fix, you type the following words into a search engine: windows delete mac files illegal names.
The top results at Google.com include links about moving Eudora mailboxes, renaming Mac files using various utilities and fixing FTP directories that have blank names. Strangely, there's little or nothing about the actual problem at hand.
It's a different story after jumping over to Google Groups (an easy leap, since a Groups tab is at the top of every Google results page). Most of the top 10 links include at least something useful about the situation you face. (In some posts, you may need to click on the Complete Thread button to see all the related comments.)
Teoma is even more helpful. Its first link is to Experts-Exchange.com, where several knowledgeable people provide solutions. (Visit
www.bri.li/4071 to see the answers.) And the other top links are, at a minimum, partially relevant.
Let's look at another example. This time, another exec wants to change Windows XP's File Open dialog boxes so they always default to the so-called Details view. Can you do it?
Type this string into Google: xp open dialog default details.
The first link in Google is an Office XP macros article that has nothing to do with the immediate task. Other links go to tips on Office file management, how to print a calendar from Outlook and other off-topic hits.
Once again, Google Groups scores better than its big daddy. Most of its first 10 links are directly relevant to the query. Teoma is also on the mark, with links to Experts-Exchange, Annoyances.org and other helpful references. (See
www.bri.li/4072 for one resource page.)
The indexes of each search engine may have changed since I tested the examples above. If so, select a tech support search of your own and let me know the results.
So what's gotten into Google? It's true that some queries will always work better on one search engine than another, as one Google executive pointed out when I asked him about it.
"These are the types of questions that have always been best answered on Google Groupsâ??there are more good technical answers there and fewer unrelated pages," said Peter Norvig, Google's director of search quality. "I think this has always been the case and is not due to any recent changes to Google or the Web."
But I'm convinced that several changes introduced by Google over a period of months have led to unintended side effects in its rankings.
Google's reliance on link popularity may have finally hit a wall. Past a certain point, link counting rewards "optimized" sites rather than lesser-known sites that may contain exactly what you need.
By contrast, Teoma last year introduced something it calls "Subject-Specific Popularity." More weight is given to links between authoritative sites than to other links. This approach looks to me like a winner.
Brian Livingston is editor of Brians Buzz.com. His column appears every other week in eWEEK. To send tips, visit www.briansbuzz.com/contact. Send your comments to eWEEK@ziffdavis.com.
