Follow Slashdot blog updates by subscribing to our blog RSS feed

 



Forgot your password?
typodupeerror
×
AI Social Networks

Reddit Will Now Use an AI Model To Fight Harassment (androidauthority.com) 75

An APK teardown performed by Android Authority has revealed that Reddit is now using a Large Language Model (LLM) to detect harassment on the platform. From the report: Reddit also updated its support page a week ago to mention the use of an AI model as part of its harassment filter. "The filter is powered by a Large Language Model (LLM) that's trained on moderator actions and content removed by Reddit's internal tools and enforcement teams," reads an excerpt from the page. The Register reports: The filter can be enabled in a Reddit community's mod tools, but individual moderators will need to have permissions to change subreddit settings to enable it. The harassment filter can be set to low ("filters the least content but with the most accurate results") and high ("filters the most content but may be less accurate"), and also includes an explicit allow list to force the AI to ignore certain keywords, up to 15 of which can be added. Once enabled, the filter creates a new tag in the moderation queue called "potential harassment," which moderators can review for accuracy. Reddit's help page says the feature is now available on desktop and the official Reddit apps, though it's not clear when the feature was added.
This discussion has been archived. No new comments can be posted.

Reddit Will Now Use an AI Model To Fight Harassment

Comments Filter:
  • by Narcocide ( 102829 ) on Thursday March 07, 2024 @09:33PM (#64298731) Homepage

    ... and the AI is tricked into becoming the harasser in 3... 2... 1...

  • Misleading title (Score:1, Insightful)

    by sinij ( 911942 )
    Correct title is: "Reddit will use woke AI model to censor non-woke posters".
    • Re: (Score:1, Insightful)

      by Anonymous Coward

      Maybe try not being an asshole?

      • Re: (Score:3, Insightful)

        by sinij ( 911942 )

        Maybe try not being an asshole?

        You are confusing my refusal to validate your narcissistic feelings with me being an asshole. I am not paid to be your kindergarten teacher, so I am not obligated to give out gold stars when you manage not to shit your pants for 5 minutes.

        • by AmiMoJo ( 196126 ) on Friday March 08, 2024 @05:08AM (#64299255) Homepage Journal

          No, that's being an arsehole. Every day you interact with people without telling them what you really think of them. That comb-over is a joke, they should lose several kilos, their choice of vehicle is questionable etc. You just don't feel the need to tell them because you aren't Larry David from Curb Your Enthusiasm, who gets into pointless arguments with random people he meets and inevitably ends up being the loser.

          Besides, you can't tell. You think you can, but you can't. Chances are, you have interacted with trans people without knowing it. Just as bad, some cis people are now being accused of being trans because they don't look sufficiently masculine/feminine for other people's tastes. Female cancer patients in particular get it, because the treatment affects how they look.

          Just use their pronouns, the same way you call them sir or mam even though you have zero respect for them. Or don't, and just accept that there is no freedom from the consequences of being a dick.

          • Re: (Score:2, Troll)

            by sinij ( 911942 )

            That comb-over is a joke, they should lose several kilos, their choice of vehicle is questionable etc.

            You picked examples to intentionally reframe what is really happening. To use your examples, it is people that insist everyone get a comb-over, that not being far is wrong, and that we can't drive non-EV cars.

            At the core it is insistence that their feelings should have power to dictate my behavior.

            • Re: (Score:3, Insightful)

              by AmiMoJo ( 196126 )

              Well non-EV cars are damaging the environment we all live in, and causing us all massive costs now and in the future. They are actively harming us. Of course giving up cars entirely is impractical, but EVs seem like a decent compromise, with exceptions for things that absolutely require an ICE. Of course, affordability is an issue too, but any woke social justice warrior will be well aware of that intersectionality.

              Seems like we are back to being an arsehole, insisting on harming other people because you ha

              • Re:Misleading title (Score:5, Informative)

                by sinij ( 911942 ) on Friday March 08, 2024 @08:57AM (#64299599)
                Ami exemplifies this harmful ideology of primacy of feelings. He feels that non-EV cars are damaging, therefore everyone should abide by his feelings and change how they live. No attempts at rational analysis, no attempts at cost-benefit analysis, no attempts to look at the data. These beliefs are religious-like, where dogmatic assumptions are not to be questioned.

                Meanwhile in the real world, the logical consequence of your push for EVs is somewhere between drastic collapse of the quality of life (best case) to supply chain collapse followed by famine (worst case). Meanwhile the benefits of US fully switching to EV cars and trucks would be a round-off error according to even the most optimistic projections.
                • Re: (Score:2, Redundant)

                  by AmiMoJo ( 196126 )

                  You are mistaking scientific facts for feelings. Feel free to argue that fossil cars are less environmental damaging, and do less damage to people's health. I note you didn't do that though, you made an emotional argument.

                  • by sinij ( 911942 )
                    I made cost vs. benefit analysis argument. Assuming a perfectly spherical cow in a vacuum is not how you tackle complicated socioeconomic issues.
                    • Re: (Score:2, Redundant)

                      by AmiMoJo ( 196126 )

                      The cost benefit argument has been done to death. What you mean is that it gives YOU the best cost/benefit ration, and sod everyone else.

                    • by Anonymous Coward

                      You argued that well-known facts were mere feelings. That disqualifies you for serious discussions.

                    • by sinij ( 911942 )
                      If I grant your premise that vehicle emissions are existential threat to humanity, only then these arguments would make sense. The feelings-based argument is the premise that vehicle emissions are the top problem, because it is observable and buying an EV can be used to virtue signal. Meanwhile all other aspects, from cost of transportation, to energy generation and so on are ignored. To put it bluntly - EVs charged by windmills and gas generators make no sense from economical, environmental, or prosperity
            • You used examples that are intentionally ignoring Stochastic Terrorism, which if you don't know is when acts of violence are encouraged indirectly so as to maintain plausible deniability. The most common example of Stochastic Terrorism is the "Dog Whistle" where you say something that is understood by one audience to be advocating violence against a minority which is not understood by other audiences as such.

              Thoughts turn into actions. If you're gonna be racist you have that right. But don't be surprise
        • if you're being noticed for this stuff it's because you commented on somebody's post

          You could have just as easily ignored the post, but instead you went out of your way and commented on it. Typically, if you're being flagged for this, with a snide or nasty comment.

          So no, you're not "refusing to validate" somebody. You're going out of your way to shit on them. That's being an asshole 101.
    • I can *easily* be woke and harass people at the same time.

      • Re: (Score:3, Insightful)

        by sinij ( 911942 )

        I can *easily* be woke and harass people at the same time.

        There is almost never policing of bad behavior toward outgroup by the woke people. It is universally accepted that you could harass people along woke lines and never have your behavior penalized. If anything, it is encouraged.

        • by Anonymous Coward
          if( victim.IsWhite == true ) noop;
          if( subject.IsWhite == true ) execute( subject );
        • There is almost never policing of bad behavior toward outgroup by the woke people.

          You're giving reddit way too much credit by pretending their moderation team has even enough firing neurons to understand what woke is, to say nothing of what constitutes harassment.

          e.g. that time I got a 2 week ban for "threatening violence" when I told someone he will burn his house down with what he was doing. Funny story, the same person posted a picture 6 months later of a fire in his bedroom. Luckily didn't burn the entire house down.

        • the left wing is *famous* for eating their own alive when they overstep.

          If you're going to be a bigot or a racist you don't get to be upset when we call you out for bigotry or racism. That's all "woke" means.

          We do sometimes get a little snide because we're tired of explaining the same things over and over and over and over again. Especially in regards to trans people and the scientific backing of their existence. We're also *really* tired of stupid gotcha questions from the right wing like "what is
          • by sinij ( 911942 )

            If you're going to be a bigot or a racist you don't get to be upset when we call you out for bigotry or racism. That's all "woke" means.

            Thank you for making me laugh today.

          • by sinij ( 911942 )

            We're also *really* tired of stupid gotcha questions from the right wing like "what is a women?"

            An adult female person? There is nothing gotcha about it.

          • If you're going to be a bigot or a racist you don't get to be upset when we call you out for bigotry or racism. That's all "woke" means.

            LOL, no it's not. Woke is to the left like alt-right is to the right. I've seen plenty of racism and bigotry spewed from wokes.

            I'm progressive, and I loathe wokes. They make the left look insane, petty, and cruel.

    • which included the phrase "In these days of political correctness..." talking about no longer making jokes that denigrated people for their culture or for the colour of their skin. And I thought, "That's not actually anything to do with 'political correctness'. That's just treating other people with respect."

      Which made me oddly happy. I started imagining a world in which we replaced the phrase "politically correct" wherever we could with "treating other people with respect", and it made me smile.

      You

    • Correct. Reddit were one of the first after The Verge to implement Orwellian cancel culture. Terrible destination that reminds me of Demolition Man.
    • by Anonymous Coward

      Correct title is: "Reddit will use woke AI model to censor non-woke posters".

      So what is the opposite of "woke"? Unconscious? Senseless? Republican?

      I guess it doesn't matter - they all mean the same thing.

      • by sinij ( 911942 )
        The opposite to Woke is Based, used to signify commitment to observable reality and known facts.
    • Re: (Score:2, Insightful)

      by tlhIngan ( 30335 )

      Correct title is: "Reddit will use woke AI model to censor non-woke posters".

      You're not wrong, but it has to happen because Reddit is now public. And public companies now have obligations that involve not scaring away investors.

      After all, you can see the fun Elon Musk is having with various groups pointing out to advertisers how their ads may be supporting less that savory activities. Though to Elon's benefit, at least his social media site is privately owned so he doesn't have shareholders to be accountabl

      • Re: (Score:2, Insightful)

        by sinij ( 911942 )
        Facts do not support your assertion that woke has wide consensus and support. Figures I have seen indicate that a minority off population dedicated to woke. For any business going woke is always means reducing target audience, which is contrary to shareholder interest. Now if you are already woke, going even more woke may not necessary be immediately harmful, but even the log term trend of this [reuters.com] is clearly [theguardian.com] established [theguardian.com].
        • Re: (Score:2, Insightful)

          by Local ID10T ( 790134 )

          Ahh... see, here is the problem:

          Most people are not "dedicated to woke". Neither are we dedicated to denigrating others. It is not an either/or situation.

          As a business owner, I can say that going out of your way to offend potential customers is bad for business -no matter what you are pushing.

          Live and let live. Tolerance is the middle ground between attacking and encouraging. It is where most people exist on almost all politically charged issues. It isn't a problem unless you make it one.

          There are issu

          • by sinij ( 911942 )
            Your outlook (that I happen to share) is how society used to work in 90s. Today this is as outdated as steam locomotives. Modern zeitgeist is to make emotion-driven decisions, avoid any mental discomfort at any costs, and viciously lash at anyone that disagrees with you. This is not contained to the university campuses or online spaces, it affects everyday life and drives bad policy. This rot is to the point that Western culture is wobbling and might collapse.
  • by liquidpele ( 6360126 ) on Thursday March 07, 2024 @09:51PM (#64298757)
    The amount of astroturfing on that site, now using AI itself, is ridiculous. I imagine just like twitter, they can't admit how much of the site is bots though or it'll upset the profits from advertisers.
  • by bimbo69 ( 9325765 ) on Thursday March 07, 2024 @10:06PM (#64298791)
    Reddit's harassment algorithm is dogshit. Whether they're using AI or exploiting third-world labor - they get it wrong most of the time and misinterpret simple comments.
  • Since they screwed over their Redditors, I stopped visiting the site. Too bad...it was a useful resource.

  • a post that starts a conversation? The BOT will never be bad to the OP.
  • Right?
  • by DrMrLordX ( 559371 ) on Friday March 08, 2024 @01:15AM (#64299035)

    Reddit needs an Ai to police moderator abuse. They've already cracked down on all manner of speech and thought.

    • Even the worst functioning LLM would be a better moderator than 99% of the existing "human" moderators. And I use quotes because, frankly, I'm not even sure they weren't some secret AI experiment all along. They certainly hallucinate all sorts of problems.

    • by AmiMoJo ( 196126 )

      Is Reddit there to provide a free speech platform where anything legal goes, or is it there to allow people to create their own communities, like they used to on forums and email mailing lists?

      I'd suggest it is the latter, in which case if you don't like the moderation you should set up your own community. Forcing people to accept your words for publication is a violation of their rights.

      • by sinij ( 911942 )

        is it there to allow people to create their own communities

        Yes, for example, The Donald subredit ... oh wait, they banned that.

        • by AmiMoJo ( 196126 )

          Right, but again... Why should Reddit, a private company, care about freedom of speech, and not its bottom line?

          Every free speech platform has either gone bust or is well on the way to it. Are people supposed to just throw away their money over and over again to buy a soapbox?

          • by sinij ( 911942 )
            Are you bothered by obvious inconsistency of your arguments?

            To summarize what you said: Reddit is not censoring, it is building interest-based communities. But not for these kinds of people. They are private company and don't have to provide service to anyone.
            • by AmiMoJo ( 196126 )

              They will provide service to whoever is most profitable. The Donald was losing them money, damaging their reputation, organizing attacks on users and other subreddits.

              Ask yourself this: If it really was Reddit just loving to censor, or giving mods too much power, who come other Trump communities haven't thrived in the wake of The Donald's banning? Why is TRUTH Social not taking over?

              For that matter, since Musk came along and removed most of the controls on hate speech and attacks on Twitter, why has it deva

              • by sinij ( 911942 )

                Ask yourself this: If it really was Reddit just loving to censor, or giving mods too much power, who come other Trump communities haven't thrived in the wake of The Donald's banning?

                They have. On Rumble. On various podcast like Timcast and Crowder. Wait, are you imagining that closing /r/The_Donald had these guys just disband and go home?

                Why is TRUTH Social not taking over?

                I am not certain. I think people were hopeful that Musk would deliver with Twitter promises of protecting free speech. However, now that misgendering bans are back, it is likely will get another look at.

                • by AmiMoJo ( 196126 )

                  Oh, so now we have moved from discussion forums to podcasts. Sorry, I'm not playing that game.

  • This is why I loathe installing apps.

    Deliberately mangling the mobile experience so they can install unsolicited bloatware on your handset? No thank you.

    A web forum shouldn't require an app.

  • Just check which moderator blocks the most users and you likely figured out who the biggest dictators on the platform are.
    Some Reddit groups are just one big chesspit that would make many cult leaders jealous.

  • Making AI the arbiter of human discorse, taken to the extreme, would not end well for humans.

  • by Somervillain ( 4719341 ) on Friday March 08, 2024 @09:57AM (#64299719)
    So a friend of mine and I are chatting in a private chat. I make a joke about myself using an old-timey ethnic slur...one of the ones they play on TV all the time because it's silly and he's the same ethnicity....think something Family Guy would say. 3 days later, my account is locked for "hate speech". Note, this is a European ethnicity (I'm part white)

    So yeah, slurs are slurs and my joke was a bit asshole-ish and could have hurt someone if I used mean words against them outside of jest....but FFS, it was a PRIVATE CHAT...with someone who was in on the joke and thought it was funny and not even mean spirited, just using crass terms.

    Key quotes:

    After reviewing, we found that you broke Rule 1 because you promoted identity-based hate or attacks. Reddit is a place for creating community and belonging, not for attacking marginalized or vulnerable groups of people. We don’t tolerate promoting hate based on identity or vulnerability, and any communities or people that encourage or incite violence or hate towards marginalized or vulnerable groups will be banned.

    White people whose ancestors are from wealthy European Nations are marginalized? Eh...I guess I learned something new today.

    Note: This content was flagged by Reddit's automated systems. This decision was made without the assistance of automation.

    That part creeped me out. They're using AI to scan my private chats and a moderator is reading them afterwards? Not cool. While I am not shocked it happens, I am also annoyed they interjected. The person laughed and kept talking...they didn't say "you're making me uncomfortable" and even added on to the joke...because while it wasn't a legendary joke or anything like that, it was well-timed, well-received, and a bit of levity and fun among friends with a common experience.

    To be clear, I was making a joke about my ethnicity that didn't involve violence or threats or even any mean-spiritedness, just self-deprecation. I would be comfortable saying it at lunch at work...but not in a formal setting...less because it might offend, but because it's just lame and an inside joke if you didn't grow up in the USA hearing jokes about Europeans all the time.

    Sure, I accept they want to be proactive and expel law enforcement concerns or hate groups...and if your joke implies harm, it could get misinterpreted, but my buddy and I are still confused to this day as to why the idiot banned my account. Also, I've never had any warnings about my account in the past.

    If the did this to me, I am sure they've done it to many others. I WANT Reddit to succeed. They seem eager to fail.

    • by sinij ( 911942 )
      There is no end to the purity purges, as actual racism is in short supply they will continue redefining terms to meet the demand.
      • There is no end to the purity purges, as actual racism is in short supply they will continue redefining terms to meet the demand.

        As a mixed-race person, I am skeptical it is short-supply. If that's the case, I seem to run into a whole bunch...but yeah..nothing like my dad, grandpa, etc experienced...the USA has progressed in leaps and bounds in my lifetime alone, let alone theirs

        However, what I suspect you may have wanted to convey is that it doesn't help anyone to misdiagnose it. Insensitivity is not racism and repeating dumb jokes you heard on the Simpsons (I remembered after writing I first heard the term on the Simpsons year

        • by sinij ( 911942 )
          One aspect is going out and looking to be offended by something, then claiming racism. I am not saying you do that, it just this is rather widespread in activist circles. Another aspect is categorizing any negative interaction as racism when other explanations exist. Yet another aspect is categorizing innocent things (like Simpson jokes you mention) and pretending they are a serous issue. Last but not least, there is a whole fiction of systemic and unconscious racism that used to justify all of the above.
    • by MobyDisk ( 75490 )

      We are going to replace stupidity with automated stupidity. All these bad moderations will go into the training set. But then people will blame the AI instead of looking in the mirror and going "Hmm..... we trained the AI on ourselves.... and it is acting like an ass... what could this mean?"

Truly simple systems... require infinite testing. -- Norman Augustine

Working...