Measuring Real Time Public Opinion With Twitter 54
Hugh Pickens writes "The NY Times reports that statisticians from the University of Vermont are hoping to harness the stream of messages flowing through Twitter to read public opinion and sentiment in real time. '"Twitter is a reflection of what people are interested in right now," says Peter Dodds, adding that the goal is to establish an index, akin to the Dow Jones industrial average, that can "give an overall sense of how a collective body of people are feeling at any given point in time.' Dodds says he and his colleagues are analyzing about 1,000 tweets each minute, or about a million a day, looking for trends in descriptive words and phrases that indicate moods and emotions. In addition, the two can monitor the public reaction to news or policy announcement and track it over time. The tool is still in its early stages, but eventually Dodds hopes that it could work similarly to Google Flu Trends, a Web tool that doubles as an early-warning system for flu outbreaks by detecting spikes in certain search terms. Since relationships and conversations are so intrinsic to how people communicate on Twitter, the researchers hope that observing how one user's mood is affected by another might shed some light on crowd behavior and emotional contagion. 'All of this data serves as a remote sensor of well-being,' Dodds says."
Won't work for long (Score:3, Insightful)
Wait until the astroturfers and lobyists discover this.
Re:Won't work for long (Score:4, Insightful)
Wait until the astroturfers and lobyists discover this
They already have. But it's irrelevent, Twitter has or is near peaking. As soon as "the next big thing" hits the scene, Twitter will fade, like ICQ and all the rest of the chat "communities".
"public" opinion? (Score:5, Insightful)
Re:"public" opinion? (Score:5, Insightful)
How can Twitter users be a representative sample of the public as a whole? And I don't even want to think about issues with geographical context...
Re: (Score:2)
Selection Bias (Score:2)
So that Selection Bias can equate to a target demographic.
I expect a pay per tweet model to be offered as an incentive, for instance as a rebate against cell phone charges within certain
Re: (Score:1)
Easily, provided that you are prepared to accept the basic premise that the public as a whole has the attention span of a flea.
Oh wait...
Re:"public" opinion? (Score:5, Informative)
I suspect it is nothing compared to the twaddle on twitter.
Depends on who you follow try SciAm's current recommendations: science writer carlzimmer, evolutionary biologist Jonathan Eisen phylogenomics, theoretical physicist seanmcarroll, science writer RebeccaSkloot, NASA astronaut Mike Massimino Astro_Mike, or astronomer Phil Plait BadAstronomer
Re: (Score:3, Interesting)
I suspect it is nothing compared to the twaddle on twitter.
Depends on who you follow try SciAm's current recommendations: science writer carlzimmer, evolutionary biologist Jonathan Eisen phylogenomics, theoretical physicist seanmcarroll, science writer RebeccaSkloot, NASA astronaut Mike Massimino Astro_Mike, or astronomer Phil Plait BadAstronomer
Actually, I visit Phil Plait's sites regularly, and really like his material (http://www.badastronomy.com/index.html and http://blogs.discovermagazine.com/badastronomy [discovermagazine.com]).
His tweets are a different matter entirely - twaddle, and inescapably so due to the limitations of tweeting (what a pathetic term). You can find his twaddle at http://twitter.com/BadAstronomer [twitter.com]. I encourage you to contemplate how poor a communication medium twitter really is, when it reduces someone with the aptitude and knowledge of Phil Pl
Re: (Score:2)
Or the collected opinions of twits, er twitterers, twats, or whatever.
I was just thinking perhaps a spinoff called Twatter could be created for mates to communicate with each other when using natural birth control or trying to get pregnant. Actually, it appears somebody may have already jumped on [twatter.com] this idea.
Re: (Score:1)
Re: (Score:2)
I just wrote on twitter (Score:3, Funny)
I just wrote on twitter about my opinion about harnessing the stream of messages flowing through twitter to read public opinion and sentiment in real time.
Re: (Score:2)
I just wrote on twitter about my opinion about harnessing the stream of messages flowing through twitter to read public opinion and sentiment in real time.
Yes, but did you then harness your tweet to measure public opinion? What do you think the guy meant by tweeting about measuring sentiment via twitter?
what up dawg (Score:2)
Re: (Score:2)
I just wrote on twitter about my opinion about harnessing the stream of messages flowing through twitter to read public opinion and sentim
There. Fixed it for you. If 140 characters is enough to express an idea on Twitter, it should be good enough for Slashdot.
Re: (Score:2)
Public Twitter opinion only 98% inane (Score:5, Funny)
Only 98% of Twitter updates are "pointless babble," says a new report [today.com] that studied 2,000 tweets over a period of two weeks.
The top category was "pointless babble" tweets, with nearly 98% of tweets being inanity no sane person could want to read, retweets of inanity, links to inanity, retweets of links to inanity and retweets of retweets of links to links to the reretweet itself. And camera phone pictures of bowel movements on Twitpic.
Almost 2% was Stephen Fry, Neil Gaiman or retweets thereof and the rest was Warren Ellis posting scatological abuse of his fans.
Botnet command messages were becoming more popular, many disguised as combinations of the syllables "lol" "wtf" "d00d" "RT" and "#fb" or scatological abuse of Warren Ellis's fans.
Twitter's demographics as of June 2009 were 55% female, 43% ages 18 to 34, 78% white, and 99.5% of such short attention spans that Facebook might as well be War and Peace. Botnet readership was considered likely to rise as soon nothing with organic intelligence would be able to cope.
Twitter recently redesigned its homepage, changing the tag "What are you doing now?" to "Post tomorrow's CNN headlines, particularly about #goatse."
Re: (Score:2)
Only 98% of Twitter updates are "pointless babble,"
I find this hard to believe. Pointless babble must exceed 100%, as many twitters manage to concentrate extreme stupidity into such short bursts. Stupidity so dense it collapses into a black hole of primordial stupidity - detectable but unintelligible.
Twitter's demographics as of June 2009 were ... 99.5% of such short attention spans that Facebook might as well be War and Peace.
Only 99.5%? Another gross underestimate. That "report" must have been written by shills exaggerating the intellectual side of twitter.
Re: (Score:2)
Stupidity so dense it collapses into a black hole of primordial stupidity - detectable but unintelligible.
Mini black holes. Then again, it's entropy maybe so high that we have to drop the prefix.
Re: (Score:2)
You might be on to something. Maybe he's measuring the amount of "stupid" on the internet, so if stupidity ever drops below 99.9% saturation, it might mean something's up.
Of course, anything that would catch the interest of most of the tweeters still has a 99.9% chance of being useless anyway.
Re: (Score:2)
Won't work when twitter goes down (Score:2)
Twitter goes down a lot now (or at least partially). For example, I cannot post at this moment. It's going to be hard to base serious programs on a service that is down so frequently.
Re: (Score:3, Funny)
> I cannot post at this moment.
We are deeply sorry about this, we have just launched a test run of our experimental software and we did not think it could affect Twitter's performance. We have now reduced the threshold of our requests so everything should be back to normal now.
Thanks,
Department of Statistics
University of Vermont
Re: (Score:2)
sample selection bias (Score:4, Insightful)
"Twitter is a reflection of what people are interested in right now"
=>
"Twitter is a reflection of what the twits are twatting in right now"
Can you see the problem?
Rigged sample (Score:3, Insightful)
Stupid (Score:1, Insightful)
People who use twitter and read tweets should be gathered in a room and be shot.
The similarity is uncanny (Score:1)
Not representative? (Score:5, Insightful)
Correction: Twitter is a reflection of what morons are interested in right now. Still, useful marketing information.
The Onion (Score:3, Interesting)
What more could go wrong? (Score:2)
The fact that we have endless Astroturfing here tells you that this is a very bad idea. We will soon have the cable news media reporting this crap and the sheeple will lap it up, AGAIN.
The DOJ would be better looking at this than writing amicus curia brief supporting the MPIA/RIAA.
Replying to remove improper mod. (Score:2)
Replying to remove an improper mod of this comment.
Open to Gaming (Score:3, Interesting)
Already happening. (Score:2)
http://www.mediaite.com/tv/the-daily-show-explains-how-fox-self-pollinates-outrage/ [slashdot.org]>the daily show is already outlining this happening on fox news.
? improper link copy? (Score:2)
slashdot seems to have improperly published the link?.. bug anyone?
http://www.mediaite.com/tv/the-daily-show-explains-how-fox-self-pollinates-outrage/ [mediaite.com]
Re: (Score:1, Interesting)
another example was the DOD response to the statue of liberty flyover. They were measuring the story in "tweets per minute" trying to gauge whether it was dying or not.
See the documents posted at
http://www.dod.mil/pubs/foi/newyorkcityflyover/
Re: (Score:1)
Watching Twitter to gauge public sentiment has a number of flaws, many of which have already been pointed out here. The largest of which is that it's too easy to "stuff the ballot" by simply launching a campaign to flood Twitter with positive comments about your candidate, issue, product or service.
It's really not that hard
only 1000 mins a day! (Score:2)
about 1,000 tweets each minute, or about a million a day
Either someone really sucks in maths, or there is only 1000 mins in a day....
Re: (Score:1)
ABC already did this (Score:3, Interesting)
The ABC (Australian Broadcast Commission) did this for a live state -vs- state football match we have here. It was quite good. Measuring sentiment of who would win based on the positiveness or negativeness of 'tweets' (or whatever the fuck they're called).
Here [abc.net.au]
Nooooo (Score:1)
Holy batman, therefore from now on we can expect politicians to become Twitter sock puppets, no longer poll slaves?
Truly a wonderful idea. (Score:1)
Really? PUBLIC opinion? (Score:1)
Feh. (Score:1)
For the most part twitter is a measure of what a vanishingly tiny and very niche chunk of the population incorrectly believes to be interesting.
Can you say... (Score:2)
...breach of privacy?
Twit Science, Twat Results (Score:2)
TFA is misleading, this time due to the researchers trying to make their science sexy when it's really just trying to ride a social networking wave. There is no "now" involved. They are going to scan across time looking for posts on a particular subject to see what peoples "reactions" are. People don't post these millions per day simultaneously, and they may think for an hour before they post or the may post immediately after a particular thing of interest occurs.
The 'self-selection' bias is true but isn't