Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror
×
The Internet

The Role of Experts In Wikipedia 266

Hugh Pickens writes "Episteme, a magazine about the social dimensions of knowledge, has a special issue on the epistemology of mass collaboration, with many of the articles focusing on Wikipedia. One of the most interesting articles is by Lawrence M. Sanger on the special role of experts in the age of Wikipedia. Sanger says the main reason that Wikipedia's articles are as good as they are is that they are edited by knowledgeable people to whom deference is paid, although voluntarily, but that some articles suffer precisely because there are so many aggressive people who 'guard' articles and drive off others (PDF), including people more expert than they are. 'Without granting experts any authority to overrule such people, there is no reason to think that Wikipedia'a articles are on a vector toward continual improvement,' writes Sanger. Wikipedia's success cannot be explained by its radical egalitarianism or its rejection of expert involvement, but instead by its freedom, openness, and bottom-up management and there is no doubt that many experts would, if left to their own devices, dismantle the openness that drives the success of Wikipedia. 'But the failure to take seriously the suggestion of any role of experts can only be considered a failure of imagination,' writes Sanger. 'One need only ask what an open, bottom-up system with a role for expert decision-making would be like.' The rest of the articles on the epistemology of mass collaboration are available online, free for now." Sanger was one of the founders of Wikipedia, and of its failed predecessor Nupedia, who left the fold because of differences over the question of the proper role of experts. Sanger forked Wikipedia to found Citizendium, which we have discussed on several occasions. After 2-1/2 years, Citizendium has a few tenths of a percent as many articles as Wikipedia.
This discussion has been archived. No new comments can be posted.

The Role of Experts In Wikipedia

Comments Filter:
  • by Protonk ( 599901 ) on Monday February 16, 2009 @12:21AM (#26868817) Homepage
    [Citation needed]
    You can say a lot of things about wikipedia, but if you say that the majority of articles are worse off now than in (say) 2002, you'll be full of shit. You can point to some good articles in the past that have degraded from random edits. Or articles which have been subject to turf wars. But on the whole, there is improvement.
  • by Beetle B. ( 516615 ) <[beetle_b] [at] [email.com]> on Monday February 16, 2009 @01:19AM (#26869125)

    One of the main problems of Wikipedia is it has firm guidelines on what it is and what it is not.

    Actually, I wish. It's simply not true. They may have a few core rules (e.g. the one you complain about) that are quite rigid, but overall there is virtually no rule in Wikipedia that is not subject to modification - including by certain senior people at Wikipedia - when circumstances dictate it.

    Don't take my word for it - I got it from the horse's mouth [ted.com]. He says it in so many words.

  • by DerekLyons ( 302214 ) <fairwater@@@gmail...com> on Monday February 16, 2009 @01:26AM (#26869159) Homepage

    Given this evidence I scanned the letter and posted it to let them know their date was off. Their response was that they couldn't use the letter as proof the date was wrong because they only used published sources of information. Unfortunately the only published sources they had were a handful of websites currently online that had the wrong date written down (no doubt copied from each other).

    Indeed, because I had a related problem. A series of related articles I wished to edit had considerable problems. I worked on the item described in one of the articles while I was in the Navy, I had the unclassified manuals at one elbow, at the other elbow I had a stack of expensive reference books... All were trumped because a handful of websites all referenced the same handful of coffee table books - and disagreed with me.
     
     

    At first I was taken aback by this as it was a bit odd that they would turn down physical evidence, but after thinking about it, it was obvious they didn't know me from Adam and can't just take people's word for things at face value, otherwise people could "prove" whatever they wanted. Those kinds of check and balances probably produce entries that aren't always perfect, but it's a lot better than the alternative in my mind.

    Except there aren't any checks and balances - there is only whether or not the guy you discussing the issue with has more time on his hands and whether or not he can quote an interpretation of policy that supports his position. Your story is one of how the checks and balances fail.

  • by Protonk ( 599901 ) on Monday February 16, 2009 @02:26AM (#26869495) Homepage
    WP:EPR [wikipedia.org]
    Wikipedia:Wikipedia in academic studies [wikipedia.org]

    Dig in. Or we could look at the increase in "Featured" articles [wikipedia.org] and "Good" article stats [wikipedia.org], though the latter is not a community process but an individual process.
  • by Suddenly_Dead ( 656421 ) on Monday February 16, 2009 @02:52AM (#26869635)

    Perhaps associated with its culture of 'experts', or perhaps simply its low population. One needs look no further than the Homeopathy article, which on Wikipedia is strongly rooted in reality, but on Citizendium is largely controlled by one Homeopath editor (who has been banned from Wikipedia for pushing his unsupportable POV), and leans towards promotion and advocacy.

  • by junglee_iitk ( 651040 ) on Monday February 16, 2009 @05:21AM (#26870267)

    I don't know if you have actually given 18 hours a day to Wikipedia. I have (expert enough :p), and I can tell you right now that Wikipedia already has karma [wikipedia.org] system [wikipedia.org].

    Now it is well established in Wikipedia "groupthink" that quality counts more than either. But the crux lies in the question: Who decides the quality?

  • by Anonymous Coward on Monday February 16, 2009 @05:59AM (#26870421)

    NSFW!!

  • Comment removed (Score:3, Informative)

    by account_deleted ( 4530225 ) on Monday February 16, 2009 @06:57AM (#26870667)
    Comment removed based on user account deletion
  • by Anonymous Coward on Monday February 16, 2009 @08:07AM (#26870945)

    The only good expert ... is one that can back up their claims with good references. That's the nature of a real expert -- not that you should automatically believe what they say, but that they've got the reasons and documentation at their fingertips. It's still your decision what to believe, and it's all about that documentation rather than the authority. In that respect anyone can become an "expert" if they put enough effort into it (I'm thinking of that guy that put together enough information to figure out the way that the first atomic bombs were really put together). In the scientific literature people don't say "Oh, that's so-and-so, an expert in the field. No more need be said." That's a recipe for disaster.

    "Citation needed" is all the expertise that wikipedia really needs, and its result (that list of citations) is the most valuable part of wikipedia because people can read the sources and make their own call.

    It's true that system and the people putting wikipedia together are fallible (just like in the scientific method), but wikipedia is emulating the best technique we've found so far to get rid of the unfounded fluff. Designating "experts" and giving them a special status is both unnecessary and potentially destructive for the reasons you list. "Show me, don't tell me" is supposed to be the way forward, not "Sit down and shut up because I'm an expert and you aren't."

  • by Anonymous Coward on Monday February 16, 2009 @09:00AM (#26871201)

    The average is usually below the best and above the worst. People "know" different truths. That wouldn't be much of a problem if only proven facts could be entered into Wikipedia, but Wikipedia actually uses a simple truth-by-discussion approach, weighed by the dedication which people are willing to put behind their point of view. This approach is cemented by the "no original research" rule. A citation is not proof, just a deference to an external evaluation mechanism. It is therefore no surprise that any one Wikipedia article isn't at the top of its field. Wikipedia's strength is the collection, not the individual factoid. It doesn't need the experts to achieve average results for the whole, as long as it can keep the other end away too.

  • by crossmr ( 957846 ) on Monday February 16, 2009 @09:08AM (#26871247) Journal

    Wikipedia, not being a living being, is utterly unable to believe anything.

    If you don't have the intellectual capacity to understand that I was talking about wikipedia as its community of editors then I can't wait for the rest of what you have to say..

    Some deletionist scum, on the other hand, can only get it up by exercising petty power by deciding what article stays and what goes. It's the closest the ever get to wielding power over life and death (I hope). This is why I no longer contribute to Wikipedia and resist the impulse to correct any mistakes I notice: the reward is having my work deleted or reverted by some antisocial cretin who got kicked out from the Neo-Nazi party due to his excessive authoritarianism and has no other outlets for his resulting frustrations.

    mmm insults against faceless people. We're really getting to it now. Obviously you had some pet page you created that was deleted for some reason. Things are not made better by endlessly adding to them. Do you think when a director shoots a movie that he includes every last take and scene he shot in the final product? No. In order to create a good body of written work things need to be taken out. This applies to articles and to the encyclopedia as a whole.

    Today's featured article is about Thomas Cranmer, a archbishop of Canterbury in the early 1500's. The average person is unlikely to find that information at all useful for any purpose.

    Nope, but the average person who might be interested in him (for whatever reason) will likely find only an adequate amount of information about him and not an endless list of everything he had for breakfast throughout his entire life.

    Someone who isn't a historian, which is something 99.998% of the population of the world, doesn't remotely care about who led a subset of English church half a millennium ago.

    Actually there may be a number of students in university classes who could care a great deal about him, christians may find themselves interested, etc. But that is besides the point. I was making a point about excessive detail in articles. You're trying to compare that to an article about a minor historical figure. Two very different things. An article on World of Warcraft is quite appropriate. It is a notable subject. Delving into minutia with raiding strategies, item guides, etc isn't.

  • by jc42 ( 318812 ) on Monday February 16, 2009 @09:36AM (#26871403) Homepage Journal

    [c]an you provide citations that Wikipedia's aggregate quality has improved?

    Certainly. I found several of them by just reading this discussion. And a quick scan of the messages below this one shows several more. And there have been many other /. discussions with similar citable claims. But don't use the /. search thingy; it ain't worth a damn. Use google. ;-)

  • by mdwh2 ( 535323 ) on Monday February 16, 2009 @10:34AM (#26871939) Journal

    That wouldn't be much of a problem if only proven facts could be entered into Wikipedia, but Wikipedia actually uses a simple truth-by-discussion approach, weighed by the dedication which people are willing to put behind their point of view.

    No, it's about verifiable sources. You shouldn't be discussing what's true, you should be discussing what's supported by references. That's a fundamental Wikipedia policy.

    This approach is cemented by the "no original research" rule.

    Allowing original research would give the problem you claim exists - as then you would have people claiming that what they say is true based on their "research", despite a lack of any sources.

    A citation is not proof, just a deference to an external evaluation mechanism.

    What would constitute a proof?

    It is therefore no surprise that any one Wikipedia article isn't at the top of its field.

    Well, if the worst that can be said of Wikipedia is that it's not the number 1 best reference, I don't think that's too bad for something that's free on the web.

  • by Anonymous Coward on Monday February 16, 2009 @10:43AM (#26872009)

    With cheap disk space, and cheap bandwidth, and volunteers doing the work... where is the money going?

    $130K - Board expenses, including D&O insurance

    $472K - Executive director expenses. Includes salaries for Executive Director and Deputy Director; some fundraising and travel expenses; consultants and contractors; staff and volunteer development

    $2.7M - Technology. Includes salaries for technical staff, servers, bandwidth and contractor expenses.

    $1.6M - Office & Admin. Includes salaries for finance/admin staff, audit fees, fundraising expenses, office rent, office supplies, bank fees, etc.

    $595K - Outreach programs. Includes salaries for program staff, public outreach expenses, communications expenses.

    $357K - Legal.

    $96K - Wikimania. Includes travel for board, advisory board and staff.

    Gee, that was hard. Took all of 2 minutes to find this info.

  • by Anonymous Coward on Monday February 16, 2009 @10:58AM (#26872183)

    What would constitute a proof?

    A proof is reasoning which anyone can follow and come to the stated conclusion, which is thereby proven. It can only rely on other proven facts and methods. Most notably, a proof does not require trust. "He said it and therefore I believe it" is not proof. An actual proof constitutes original research and, unless it is in itself noteworthy, will therefore not find its way into Wikipedia.

    At first sight, Wikipedia's approach looks like it's about verifiability, but a citation is not proof. It can reference a proof, but in the relatively few cases where a piece of information on Wikipedia is supported by a citation, it's usually a mere reference to external authority. In addition to the rules, the editing process discourages any other way. Leaving the barrier to entry low is what sets Wikipedia apart from other efforts to accumulate knowledge. Weighing expertise higher than dedication isn't necessarily better, because it's fundamentally the same principle. After all, who's an expert?

  • by Simetrical ( 1047518 ) <Simetrical+sd@gmail.com> on Monday February 16, 2009 @12:01PM (#26872997) Homepage

    Which is why they just completed a six million dollar fund raising campaign. With cheap disk space, and cheap bandwidth, and volunteers doing the work... where is the money going?

    You can just read the various financial statements on the Wikimedia Foundation's website [wikimediafoundation.org]. For instance, you can look at the page 2008-2009 Annual Plan Questions and Answers [wikimediafoundation.org]:

    What's the upshot here: how much bigger is this year's budget compared with last year's? Where are you spending more, and why?

    Planned spending totals $5.9 million, which is an increase of $3 million over the 07-08 projected actuals. The single biggest increase is hardware purchases deferred from 07-08, that total $965K.

    The second-largest increase is $510K for fundraising expenses: this includes three new positions (Head of Major Gifts, Head of Community Giving, and a Development Associate), as well as an allocation for fundraising expenses (technical help with the database, design support, usability and A/B testing money, fundraising related travel, an allocation for events, etc.).

    Other significant increases include increased hosting costs (+$200K), funding for five new technical staff and contractors (+$375K), strengthening our "program" (mission-related) work by hiring staff for public outreach and partnerships roles, plus a Chief Programs Officer (+$221K), an increase in travel costs (+210K), and a new allocation for staff and volunteer development (+$113K).

    I'm pretty sure there were links to explanations of why Wikimedia needed the money all throughout the fundraiser.

To the systems programmer, users and applications serve only to provide a test load.

Working...