New Google Search Index 50% Fresher With Caffeine 216
Ponca City, We love you writes "When Google started, it would only update its index every four months. Then, around 2000, it started indexing every month in a process called the 'Google dance' that took a week to 10 days and would provide different results when searching for the same term from different Google data centers. Now PC World reports that Google has introduced a new web indexing system called Caffeine, which delivers results that are closer to 'live' by analyzing the web in small portions and updating the index on a continuous basis. 'Caffeine lets us index web pages on an enormous scale,' writes Carrie Grimes on the official Google Blog. 'Caffeine takes up nearly 100 million gigabytes of storage in one database and adds new information at a rate of hundreds of thousands of gigabytes per day.' Now not only does Caffeine provide results that are 50% fresher than Google's last index, adds Grimes, but the new search index provides a robust foundation that will make it possible for Google to build a faster and more comprehensive search engine that scales with the growth of information online."
And yet Google adds less and less to my .... (Score:4, Interesting)
... productivity.
When Google was new It was a wonder. I could use it to help solve problems (such as identifying error codes when the servers went down), locating reveiws of products (saving me the expense of subscribing to loads of computer magazines and the time searching through them when I needed to buy something) and finding snippets of code when I needed to develop a program. As the web gets older and older there is more and more out of date information that I have to dig through. Plus when Google (and Yahoo) killed off Usenet (with an assist from Andrew Cuomo) the utility of the Usenet information structure has been destroyed (which the world is still trying to recreate with Keywords).
As Google has added more and more information it gets less and less useful. Plus the rise in SEO makes it even harder to find what I need (But I find lots of useless stuff that people have paid to get put in front of my eyes). Of course it probably isn't in Google's best interest to help me locate information that I need in the most efficient way. The more I have to sort through the crap they now deliver the more ad revenue they generate.
Too bad Bing sucks. I would really appreciate and alternative to Google.
Re:And yet Google adds less and less to my .... (Score:2, Interesting)
Re:Caffeine?! (Score:3, Interesting)
Apple has a long standing friendly relationship with Microsoft. They even turned to Microsoft to bail them out of a big financial mess not so many years ago.
yes, this is contrary to Apples television advertisements... but those arent reality.
32 Google indexer visits this month (Score:5, Interesting)
Google has pulled my site robots.txt file 32 times this month and it is only the 9th - about 4 times a day. I'm showing almost 2000 web pages pulled by Google indexers in this same time period. My site is tiny, private, not very large.
By bandwidth, Google is only 2.4% of the total site traffic, so far, this month.
I agree Google is "fresher" than they used to be. OTOH, my non-commercial site has approximately doubled readers in each of the last 6 months by publishing 1 new posting about every other day.
I suspect other, more use sites are hit hourly or even more often by google.
MSN-Bot appears to visit 10 times a day, but is much more selective about which pages it indexes. Since my site is date organized, this seems smarter than what google does. Some times, I do edit older stories with new knowledge or corrections which google will see, eventually and MSN will not. Zero referrals from any microsoft searches seen.
Yahoo! slurp barely touches my site. Only 1 referral has been seen.
Google sends about 30% of the total traffic, but most is from social networking with "hey, check this out" type referrals. Not bad for a technical article site.
Is this new? (Score:4, Interesting)
Re:And yet Google adds less and less to my .... (Score:5, Interesting)
Use Google CodeSearch, it's more adapted to developers:
http://google.com/codesearch [google.com]
Re:Does it run on Linux? (Score:3, Interesting)
AFAIK java is in heavy use at google
java is in heavy use at google but in other places - there is no java involved in serving a search query. with search, it's c++ all the way down.