Catch up on stories from the past week (and beyond) at the Slashdot story archive

 



Forgot your password?
typodupeerror
×
AI The Internet

Stack Overflow Moderators Stop Work in Protest of Lax AI-Generated Content Guidelines (gizmodo.com) 41

Moderators of Stack Overflow have announced a strike in protest of the company's ban on moderating AI-generated content, claiming that this policy allows incorrect information and plagiarism to proliferate on the platform. Gizmodo reports: Last week in a post -- which has been downvoted at least 283 times -- Stack Overflow announced its new moderation policy that will only remove AI-generated content in specific instances, claiming that over-moderation of posts made with artificial intelligence was turning away human contributors. The company also said in its post that a strict standard of evidence needed to be used moving forward in order to manage AI content, and that that standard of evidence hasn't applied to most suspensions issued by moderators thus far. This directive was also communicated to the platform's moderation team privately before being posted publicly. The moderators of the website are claiming that this directive will allow AI content, which can frequently be incorrect, to run rampant on the forum while expressing discontent with Stack Overflow for not communicating this new policy more effectively.

"Stack Overflow, Inc. has decreed a near-total prohibition on moderating AI-generated content in the wake of a flood of such content being posted to and subsequently removed from the Stack Exchange network, tacitly allowing the proliferation of incorrect information ("hallucinations") and unfettered plagiarism on the Stack Exchange network. This poses a major threat to the integrity and trustworthiness of the platform and its content," the mods write in their letter to Stack Overflow. "Stack Overflow, Inc. has decreed a near-total prohibition on moderating AI-generated content in the wake of a flood of such content being posted to and subsequently removed from the Stack Exchange network, tacitly allowing the proliferation of incorrect information ("hallucinations") and unfettered plagiarism on the Stack Exchange network. This poses a major threat to the integrity and trustworthiness of the platform and its content," the mods write in their letter to Stack Overflow.

Stack Overflow moderators, like those at Wikipedia, are volunteers tasked with maintaining the integrity of the platform. The moderators say that they tried to express their concerns with the company's new policy through proper channels, but their anxieties fell on deaf ears. The mods plan to strike indefinitely, and will cease all actions including closing posts, deleting posts, flagging answers, and other tasks that help with website upkeep until AI policy has been retracted.

This discussion has been archived. No new comments can be posted.

Stack Overflow Moderators Stop Work in Protest of Lax AI-Generated Content Guidelines

Comments Filter:
  • What if the site improves overall? At least some of the moderators on there seem more like self-important martinets than anything else - the middle managers of the Stack Overflow world. It's a reasonable question to consider whether the loss of those people's "service" will result in a net loss or gain in quality of the site.

    • by sjames ( 1099 )

      I was just thinking that for one thing people might be able to ask legitimate questions again.

    • More than one SE site has mods which actively suppress other answerers because they prefer to get the karma themselves - seen this a few times now.

    • Re: (Score:3, Informative)

      by Anonymous Coward
      The irony is that Stack Overflow was created to be a repository of reliable answers provided by humans that could be used to train AIs. Now it's being flooded with garbage AI responses supplied by humans (that should know better) it's becoming useless to everybody.
      • by nasch ( 598556 ) on Tuesday June 06, 2023 @08:42AM (#63580179)

        The purpose of stack overflow is to train AI? That doesn't sound right.

      • People giving unpaid content to a company that uses their answers to train AI and make money.

        Is this like a self-esteem crisis or something? Why are people working for free for commercial enterprises, and creating free produce for a company?

        SE must be flighty stinking rich. They do not pay for anything. What a brilliant business model! I just cannot believe that people do it.

    • by Jeremi ( 14640 ) on Monday June 05, 2023 @10:00PM (#63579211) Homepage

      If people wanted answers from ChatGPT, they'd go to chat.openai.com to get them. OTOH if they are at Stackoverflow.com, they expect the answers to be served up by people, because that is what the site is about.

      People who copy-and-paste ChatGPT's content onto StackOverflow just waste everybody's time.

  • Given the incredible arrogance and cynicism that Stack Overflow usually show.
  • Because they've been replaced. 8^)
  • I have three major issues with AI generated content:
    1. Citation needed!
    2. Accuracy rating.
    3. Not labelled appropriately

    Someones doing something, however I think it will be too little to late [slashdot.org]

  • by mrsam ( 12205 ) on Monday June 05, 2023 @07:53PM (#63578987) Homepage

    Perhaps it's just the tags that I'm subscribed to. But I haven't noticed a damn's worth of difference today. Stackoverflow is still the same dumpster fire it's been for the last couple of years.

    (just checked -- nope, it's still an endless stream of wandering, confused souls, who keep getting confused between stackoverflow.com, and pleasedomyhomeworkforme.com, writemycodeforme.net, or pleasesolvemycodingpuzzleforme.org)

  • As far as I can tell Stack Exchange's reasoning seems to be that they can't tell bad AI generated spam answers apart from answers where offshore outsourcers shotgun copy and paste seemingly related but wrong answers in an effort to get some upvotes for their resume.

    So since they can't tell the two type of obviously wrong answers apart they might as well allow them both because that means more hits for Stack Exchange.

    Obviously I can see why the moderators would be unhappy with that.

    • by sinij ( 911942 ) on Monday June 05, 2023 @08:04PM (#63579033)
      The issue is moderation bandwidth and the level of expertise to know where it is wrong. That is, AI can provide a high volume of hard to spot bad answers that would risk drastically lowering noise to signal ratio of SO.
      • Yes of course it is, but the question is: what is the reasoning behind limiting the moderation of those bad answers? The summary doesn't make any sense on the surface, it seems as though this change would only increase the signal to noise ratio and act to drive users away rather than retain them.

        The parent is making as guess about what the real reasoning could be. I don't know how plausible that is, I didn't know that internet points were something that you could put on your resume, but that was the mean
        • what is the reasoning behind limiting the moderation of those bad answers?

          -Too many knee-jerk moderations of "looks like AI generated text, you are banned" instead of properly reviewing the content posted. Applying a ban-hammer too heavily drives away members and costs the site revenue.

          -New rule: Stop banning posters, and moderate posts based on content. Site makes more money.

          • That seems plausible.
          • > too many knee-jerk moderations of "looks like AI generated text, you are banned"

            Yeah, that's a made-up problem. Here's actual statistics from the Physics Meta:

            https://physics.meta.stackexchange.com/questions/14438/physics-se-remains-a-site-by-humans-for-humans?cb=1

            As you can see, these "knee-jerk" mods have *messaged* a grand total of 16 people, 10 of which were accounts that were created, posted bogus answers all in one day, and then never returned.

            Yeah, totally "knee-jerk".

      • > that would risk drastically lowering noise to signal ratio of SO

        The lower the noise-to-signal ratio, the better. Ideally zero.

      • Well in the Physics sub it's not so hard to find the wrong answers.

        "how many neutrons are in a liter of water" - note, you have to use US spelling or it doesn't even parse it

        Bing: there are no neutrons in a liter of water
        CGTP3.5: 556
        CGTP4.: 2x the correct number

        One might be inclined to say "look, it's getting better!", but one will never be able to trust these things.

        That might be addressed if they simply put up their numbers on the weightings. Little pop-ups that say things like "I'm 85% confident in this

  • Wrong things on Stack Exchange?

    No! That could never happen!

  • by SoCalChris ( 573049 ) on Monday June 05, 2023 @08:03PM (#63579027) Journal

    claiming that over-moderation of posts made with artificial intelligence was turning away human contributors

    LMFAO, when has SO ever cared about over moderation? Their moderation policies have kept people who don't care about earning "reputation" on the site away for ages, and kept lots of people from asking good questions, and having tons of good and unique questions closed as duplicates.

    • by AmiMoJo ( 196126 )

      A moderator strike might actually improve SO a lot. The only sub-sites that actually work are the ones where nobody votes or moderates anything.

  • by thoriumbr ( 1152281 ) on Monday June 05, 2023 @08:21PM (#63579073) Homepage
    The strike isn't about moderation, is about SE (StackExchange) telling one thing to the mods and applying another thing site-wide without much notice. Mods have been fighting AI-generated content and suddenly SE says "no more bans on users posting AI content."
  • That is essentially what will happen if they continue to let the crap AI "writes" in.

  • by Malays2 bowman ( 6656916 ) on Tuesday June 06, 2023 @01:21AM (#63579417)

    The Earth is flat and everyone is a filthy dirty monster unworthy of living because they don't believe the same stuff as I. Also the Stackoverflow CEO eats cooked babies.

    -This post is AI generated so you are not allowed to moderate it.-

  • by Malays2 bowman ( 6656916 ) on Tuesday June 06, 2023 @01:33AM (#63579431)

    Now that crypto bored masteurbating apes yacht club NFT ABC XYZ whatever is sunsetting AI hype is taking place as the latest tulip mania. And this mania is starting to show it's nasty seedy side like what happened with cryptocurrency.

    So this means more hard work for people who are trying to seperate the reality from the bullshit

    Here we go again...

  • StackOverflow was incredible, when it started. But cruft accumulates - no one wants out-of-date answers to current problems. Then students started posting their homework questions.

    So now it's going to be filled with ChatGPT hallucinations. Why? Who is posting that? If I wanted ChatGPT's opinion, I would ask it directly.

  • "over-moderation of posts made with artificial intelligence was turning away human contributors."

    I expect the reality is exactly the opposite, because who wants to compete with bots.

  • And nothing of value was lost. As a long-term StackOverflow reader, I'd prefer AI answers to the human ones. Losing the mods and doing AI seems like a first step towards what I require for getting timely and halfway useful answers to my questions.
  • If these mods include the guys that mark almost every damn post as a dupe then I'll gladly support them going on strike indefinitely.
  • Is that there are people working for free, for a billion dollar company.

    Why would anyone work for fee, when others are making money from their work?

Beware of all enterprises that require new clothes, and not rather a new wearer of clothes. -- Henry David Thoreau

Working...