Google To Offer Free Database Storage for Scientists

An anonymous reader writes "Google has revealed a new project aimed at the scientific community. Called Palimpsest, the site research.google.com will play host to 'terabytes of open-source scientific datasets'. It was originally previewed for scientists last August . 'Building on the company's acquisition of the data visualization technology, Trendalyzer, from the oft-lauded, TED presenting Gapminder team, Google will also be offering algorithms for the examination and probing of the information. The new site will have YouTube-style annotating and commenting features.'"

mining for ads

[spud603 (832173)]

So will they be mining the data for contextual ads?
I'd be curious what their algorithms think my data says I want to buy...

Re:

[Seto89 (986727)]

It managed to pick ads accurately even when I view a GPG encrypted [wikipedia.org] emails through the web-interface - it gave links to proprietary PGP, some Fedora related sites and a page about encryption - all that from a standard header and encrypted text...

Re:

[by Anonymous Coward]

This is more than likely "tweaked" by a savvy google employee. Think of it as the way "750 ml in shots" gives you the right answer. It's clever, but "it" didn't manage to do it; it was just some Google engineer's Friday project which made it to release, because google isn't entirely soulless yet.

Re:

[rtb61 (674572)]

More likely contextual patents based upon data mining scientific research. Also it gives them valued data to sell to three letter government agency about what particular scientists are working on and more importantly what other people are interested in that research.

Got to be careful, a passing interest in bacteriological research might land you on the extreme better safe than sorry terror watch list. Where the systematically dismantle your household in search of dangerous substances, for untidy and scruf

Re:mining for ads

[mikael (484)]

These are data sets that have already been placed in the public domain by the scientists. These could be astronomy images, multi-spectral image photography, remote satellite imagery, seismology recordings, MRI/NMR/CAT scans and many other types of volume, image and signal data.

OMG WTF THIS SUX

[User 956 (568564)]

The new site will have YouTube-style annotating and commenting features.

And hopefully the commentary will be just as insightful and poignant!

oblig

[qw0ntum (831414)]

So we're going to have YouTube-like commenting?

Is this [xkcd.com] the future of scientific discourse?

Scientific Research

[by Anonymous Coward]

This should come in handy for my research on normal variants of the female mammary glands.

Are they insane?

[Hognoxious (631665)]

Why would you want to store a scientist in a database?

Re:Are they insane?

[jd (1658)]

Because you can then replicate the really good ones. I would have thought that obvious.

Re:

[Malevolent Tester (1201209)]

Might be a way to get them to join a union.

Re:

[CastrTroy (595695)]

That'll never happen. Scientists know that unions are for people who hate their job, and don't actually want to do any work. Scientists at least most that I've met, love their jobs, and love to actually work while at their job.

Re:

[jd (1658)]

The whooshing sound you heard was the set logic joke flying overhead.

Even so, though, unions only have a bad rep in America. Interestingly, America is also the country with the greatest number of stress-related illnesses in the western world (more than twice as many heart attacks from stress as in England), and that is tied to their self-destructive yet amazingly narcistic "work ethic" which simultaneously creates unbearable stresses on the human frame whilst producing only minimal extra productivity. Tra

Re:

[kamapuaa (555446)]

Uh, wow, as a reply to "scientists don't like Unions" you state "The Unites States won't last as long as the Roman Empire" and continue on with a lengthy, somewhat nonsensical anti-US rant. It really had very little to do with what the poster stated, or with Google offering free database storage - obviously you're looking for the slightest provocation to rave on against the US, whether or not is has anything to do with the subject at hand.

I realize Slashdot attracts anti-social nerds who often have weird

Re:

[ryanov (193048)]

I like my job, I'm a sysadmin, I'm on call right now, and I'm a committee chair for my union. Guess you don't know everything.

Re:

[jd (1658)]

It also means you can subtract differences. Creationist scientists won't like it, as it's possible to have alternative views.

Re:Are they insane?

[jma05 (897351)]

> Why would you want to store a scientist in a database?

So that these geeks can have normal relationships.

Re:

[Amitz Sekali (891064)]

> Why would you want to store a scientist in a database?

So that these geeks can have normal relationships.

But they probably won't perform as well as before normalization. After all. there will be performance hit in joining tables.

Ahhhh....

[doofusclam (528746)]

... so that explains why the RDBMS dudes were bitching about mapreduce t'other day:

http://it.slashdot.org/article.pl?sid=08/01/18/1813248 [slashdot.org]

Fantastic for Students and New Researchers

[cheesethegreat (132893)]

If this actually happens, and researchers are willing to make their data-sets open source, it would be a huge boon for budding researchers. It would allow students to do more than just work with a sample dataset out of a textbook. Graduate students learning how to do advanced modeling would be able to work with real datasets, vastly improving their skillset and employability. Just consider these two lines on a CV, and ask yourself which one jumps out at you.

"Designed a model for the dataset on the CD-ROM included with the Modeling Organic Systems textbook"

"Designed a model for the WISK-III heart output dataset published in 2006."

New entrants to a field would have instant access to enormous amounts of data very quickly and easily. Although the big kudos comes when you can do totally original work (new data, new analyss), a researcher who could come up with a new critique of older papers and studies would definitely get themselves noticed.

Overall, this is a really positive step for everyone on the lower rungs of the scientific ladder, and especially positive for those with limited resources.

Re:Fantastic for Students and New Researchers

[ushering05401 (1086795)]

I feel your optimism, and support this idea, but the cynical side of me must speak out.

Isn't this information more likely to be capitalized upon by those who already dominate the commercialization of research?

Yes, noobs would have enormous amounts of raw material at their disposal, but wouldn't they find applications derived from this data already covered by patents that were distilled from the data sets through analysis performed by labs full of trained corporate monkeys before they can get their own foot in the door of innovation?

I would love to awaken one day and find that I am just being a jaded fool, but I believe developments like this will help the commercialized overlords more than anyone else as they are the ones with sufficient resources to throw at privatizing the results of scientific research.

Re:Fantastic for Students and New Researchers

[xenocide2 (231786)]

Isn't this information more likely to be capitalized upon by those who already dominate the commercialization of research?

Can't it be both? It's not like by subscribing you're depriving others. And the data uploaded will be made freely available.

You cannot patent mere data, or interpretations of data. Patents are for machines, processes, and the like. Of course, the publication of data doesn't preclude people from patenting a chemical process that results in a specific gene, but this is already happening elsewhere.

In fact, I suspect the entire point of this is for Google to take over maintenance of the Genomic Databases and create new such databases. Many times the academic databases are.. poorly maintained, and certainly not compatible, despite the very similar contents. There's already efforts to make them more compatible, but Google appears to be able to offer some very neat stuff on top of it all. The silliness about shipping RAID arrays mostly seems to be for unis not already hooked up to I2.

Re:Fantastic for Students and New Researchers

[cortex (168860)]

As a neural engineering researcher who routinely generates terabyte size datasets, I have to say that I both like this idea and think it is unlikely to succeed. I would love to have a place to store large datasets and access them from wherever I am at. However, since these datasets will be open sourced, I will be extremely unlikely to put any dataset on google until I am certain I have extracted all of the publishable findings from it. I think that most researchers after putting in years of effort and a lot money into acquiring a dataset will also think twice about open sourcing their data. If the TOS where to include some means for controlling publications which resulted from analysis of the data, then it might be more likely to succeed.

Re:Fantastic for Students and New Researchers

[JanneM (7445)]

If the TOS where to include some means for controlling publications which resulted from analysis of the data, then it might be more likely to succeed.

But in that case, would you want to go anywhere close to someone else's data, for the risk of "contaminating" your research and perhaps end up in a protracted brawl over discovery rights?

I mostly agree with everybody else: it's a neat idea but for a lot of people it's not going to fly.

The one area I think it could be good is for datasets that are already open and that are meant to be shared. In vision research, for instance, or in various fields in machine learning there's quite a lot of sort-of-standard test data sets created by various groups that can make it easier to compare models directly. Having all of those collected in one place would certainly make it easier to find and actually use them rather than reinventing the wheel once again.

Re:Fantastic for Students and New Researchers

[CastrTroy (595695)]

That's really weird that this appeared on Slashdot tonite, just as I was downloading the historical weather data [ec.gc.ca] for Canada. Still waiting for it to download. I was thinking that it would be a nice data set that would be interesting to work with. It's not a huge dataset by any means, only 200 MB zipped, but it's still bigger and more real than any of the stuff I got to use in university. And a lot larger than any real data set I could generate on my own. Does anybody else have any links to interesting open data sets?

Re:

[Dominic_Mazzoni (125164)]

Does anybody else have any links to interesting open data sets?

My favorite: near-real-time medium-resolution satellite images from NASA: http://rapidfire.sci.gsfc.nasa.gov/ [nasa.gov]

Re:

[Dr. Zowie (109983)]

I will be extremely unlikely to put any dataset on google until I am certain I have extracted all of the publishable findings from it

That's so twentieth century. The scarce resource these days is not data, it is mindshare in the science community. In the 1990s, many of the SOHO [nasa.gov] instruments experimented with opening up their data sets to all comers immediately, and those instrument teams have generated about an order of magnitude more publications than their less-forward-thinking cohorts.

You should be so

Re:

[cortex (168860)]

20th century or not, the fact is that if I don't publish papers with my name as first or last author I don't get tenure. I'd be happy to have people publish papers using my data as long as I have already gotten a few first author papers out of it. Of couse, that would only apply to my data that is several years old. Also, what is to stop someome from publishing using my data and not having me as an author at all? The TOS to access the data are going to be very important.

Re:

[Dr. Zowie (109983)]

...what is to stop someone from publishing using my data and not having me as an author at all?

Nothing! On the other hand, it would be a pretty foolish person who tried to do that -- if you made the data you're likely the only one who truly understands it. Other threads in this discussion talk about that problem in the context of elementary particles. For solar observations it is similar -- there are plenty of "gotchas" in every data set, and you'd better be working with the instrument team if you want t

Re:

[Dr. Zowie (109983)]

and you'd better be working with the instrument team if you want to make a fool of yourself.

Hmmm, I seem to have omitted an embarrassing "don't", as in "if you don't want to make a fool of yourself.".

Re:Fantastic for Students and New Researchers

[Gromius (677157)]

As a researcher myself (particle physics), I echo others comments in this thread that a) its a nice idea but b) isnt going to happen. There are three main problems, the first two are solvable, the third isnt

1) trivially, 3TB is no where near enough to store my data

Bit of a non issue for the overall concept but if google wants my data, they really are going to have to up the storage by a few orders of magnitude.

2) as others stated, we work really really hard to acquire our data, research is about 10% inspiration, 90% perspiration. We are not giving up our data till we have milked it for all its worth.

This again is solvable, we release our data after we have all the publishable results we can think of and them let others have a crack. Somebody might find something useful and if not, well its great for younger scientists as you say. At the very least, people can reconfirm results at a later date easier. Main reason I like it.

3) The deal killer, for my field and I suspect others, it is really really difficult to understand our data and its really easy to misinterpret it.

New particles have been "discovered" so many times by grad students (and some professors who should know better) in particle physics data that I'm terrified of what somebody with no training outside the system might conclude from the data. At CDF (a fermilab expt) it took us (800 physicists) about 2-3 years to understand the data from the experiment enough to get proper physics results out of it. Even now, it takes a new comer about a year to get upto speed and thats with help from all the experts. But its very easy to think you understand things after a few weeks when infact your missing some incredibly subtle point and so I'm sure we would be flooded by bogus results due to misinterpretations from the data if we release it.

Anyway this all comes from a particle physics view point but I suspect quite a few other fields will be similar.

Re:

[Unoti (731964)]

But its very easy to think you understand things after a few weeks when infact your missing some incredibly subtle point and so I'm sure we would be flooded by bogus results due to misinterpretations from the data if we release it.

You sound very intelligent and I'm sure you're correct. But I couldn't help but think how much that sounds like the reasons why the Catholic Church conducted mass in Latin for so long, and why they were initially reluctant to have the Bible translated to English.

Re:

[mako1138 (837520)]

Terabytes of scientific data don't purport to hold the answers to life, the universe, and everything. A limit on CP violation probably doesn't have anything to do with getting into heaven.

Re:

[Mad_Rain (674268)]

But I couldn't help but think how much that sounds like the reasons why the Catholic Church conducted mass in Latin for so long, and why they were initially reluctant to have the Bible translated to English.

Yeah, and look how that turned out! We end up with complete Christian loonies [wikipedia.org] instead of reasonable Catholics. (sarcasm intended)

Re:Fantastic for Students and New Researchers

[Gromius (677157)]

Yes I can see how it can appear elitist. And yes it is elitist in a sense. Because its really hard. A PhD student typically has to do about 3 years hard work to get out an analysis sufficient quality and thats with help from experts. Before that they have 4 years of advanced physics. I'm not saying the common man cant do it, just it'll take them years of hard work to understand it to analysis physics results which have already had 800 physicists pour over it to extract most things of value. However as I said, its really easy to think you've understood the data in a week or so and produce bogus results which I suspect most people would do.

As for the few geniuses who can handle the data better than any of us, yes its a noble idea and it sounds nice in practice. However these geniuses are still going to have to slog through the data and its still going to be hard, even for them to do it by them selfs. Its not something some wiz kid will pick up and by the afternoon have a nobel prize. However if they are really interested, they can stop by their local particle physics lab and talk to the people there. Its not as if we dont ever give out our data, lots of students (undergraduates and 6th formers (high schoolers for yanks) over the years have been given a copy and helped to understand it. If you want it badly enough you'll probably get some sort of access to old data. Sure some may fall through the cracks but thats unavoidable.

Also incidentally the most bogus results I'm afraid of are not from the general public but from our theoretical colleagues who are actually the people we are most concerned about hiding the data from :) A lot (but not all) think that data analysis is easy and have a vested interest in proving a certain model so subconsciously they might misinterpret the data or not rigorously check it when it looks like its proving what they want it to prove. Then all of a sudden you have headlines like Prof. X from Ivy League University Y has found a new physics Z in Tevatron/LHC data which if true would be the most significant discovery in physics in the last 30 years and so is splashed all over the media. The public and media just knows this guy is an ivy league professor but doesnt know that he is little more qualified to analysis the results than they are so they believe him. Arguments would then ensure of the significance of the finding and then eventually a retraction is printed. But this would be in the public and in the media and I think this is damaging to science as the general public starts thinking "these stupid scientists, always changing their mind, should we believe anything they say". Plus you would get an increase in the usual crazy science results but this time with data whose analysis most people cant tell is rubbish. Slashdot would be happy as they tend to like crappy science :) but its not something scientists would be happy with.

Is it limited?

[jonsmirl (114798)]

Researchers I know would fill up a yottabyte if they were allowed to. I hope Google has plans for keeping growth of the datasets under control.

Re:

[jd (1658)]

There are those who would argue that this is an open invitation by Google for scientists to try and DDoS their systems, and those who would argue it might not be a bad thing if they succeed. Personally, I disagree with the last part, but DO think that this could lead to Google developing vastly superior search technology. They can search gigantic data sets, sure, but the percentage of false hits is way too high. When you move into scientific data and multi-dimensional non-simply-connected non-linear search

It'll All End In Tears

[turgid (580780)]

This is a Bad Idea. Too much of the world now depends on Google. And people are running to Google, willing to give their data and identity.

/me shakes walking stick and creeps back into cave.

Re:It'll All End In Tears

[by Anonymous Coward]

Do you have any datasets to back up this claim?

Horrible Idea - What are the TOS?

[teknopurge (199509)]

Does google get ownership of anything that is uploaded? I wonder how foolish scientists will be as to unknowingly forfeit their copyrights, IP, etc.

Re:Horrible Idea - What are the TOS?

[hostguy2004 (818334)]

Google are offering this service to store PUBLIC DOMAIN data. If people don't want to release the data as public domain, then this aint the service for them. See http://en.wikipedia.org/wiki/Public_Domain [wikipedia.org]

Re:

[Walt Dismal (534799)]

Dear Scientists; please store your sensitive nuclear data with Google. We promise not to give it to the Chinese. Our company motto: Do No Evil You Can Get Caught Profiting From.

Re:

[hey hey hey (659173)]

Does google get ownership of anything that is uploaded? I wonder how foolish scientists will be as to unknowingly forfeit their copyrights, IP, etc.

Doesn't matter how foolish the scientists are, as the contracts will have to be vetted by the various University legal departments. I'm quite confident that the lawyers will be very careful about their legal rights.

Comment System?

[dysfunct (940221)]

[...] YouTube-style annotating and commenting features.

I'm looking forward to "OMG, ur resrch is teh sux" comments and "CHEEP FUNDING M0RTG4GE" spam from elite universities around the world.

Google Everything

[Dirtside (91468)]

The other day my wife said she wants there to be Google Bank. They'd certainly get the online banking thing done right...

Re:

[ScrewMaster (602015)]

The other day my wife said she wants there to be Google Bank. They'd certainly get the online banking thing done right...

Not necessarily ... nobody in their right mind would trust the Google File System to anything remotely mission critical (not even Google: last I heard they use Oracle for all their in-house data processing needs.) Banks actually do pretty well keeping track of financial data.

Now having said that, as I look at my credit card's online statement, I see several days of Avis car rental c

An alternative to

[ricebowl (999467)]

The Storage@Home thing that was mentioned, albeit possibly in the comments, a while back. I'm not sure, at all, whether or not the Folding@Home data is meant to be public domain but, were it so, then it'd be a preferable solution in part to using a p2p style storage alternative.

Of course the three terabyte limit might cause problems there.

Big deal ... terabytes are tiny these days.

[Dr. Zowie (109983)]

Why, I made three terabytes in just 15 hours of solar observing last summer.

The Solar Dynamics Observatory, due to launch into geosynchronous orbit next summer, is a three petabyte mission.

Re:And in Redmond....

[tomhudson (43916)]

3 terrabytes isn't that much any more. You can get 750 GByte hard drives for $160 - 5 drives ($800) gives you your 3TB.

Or 4 x 1TB hard drives ($180 ea) gives you $720, so throw in $10 to boot the os off a usb key.

Cheap linux box? Well, you don't need to supply a monitor, keyboard, mouse, speakers, or even much ram - you do the math.

Re:And in Redmond....

[SnowZero (92219)]

IN SOVIET RUSSIA, quote messages YOU!

You fail at quoting.