Please create an account to participate in the Slashdot moderation system

 



Forgot your password?
typodupeerror
×
The Internet

France Planning To Allow Use of Algorithms To Detect Extremism Online (theguardian.com) 60

Hmmmmmm shares a report from The Guardian: The French government is planning to harden counter-terrorism laws, permitting the use of algorithms to detect online extremist activity, amid a growing political row over security in the run up to next year's presidential race. The interior minister, Gerald Darmanin, said attackers were now "isolated individuals, increasingly younger, unknown to intelligence services, and often without any links to established Islamist groups." This was a growing problem for France because they self-radicalized very quickly, within days or weeks. These attackers no longer used text messages or mobile phones to communicate but instead went online or used social media direct messaging, he said. Darmanin said algorithms would allow the state to potentially pick up if a person was repeatedly searching online for a topic such as beheadings. He argued that Google and other online commercial sites already used algorithms and the state should be able to as well, with independent oversight -- despite concern from some rights lawyers that there would not be enough transparency.

"The last nine attacks on French soil were committed by individuals who were unknown to the security services, who were not on a watchlist and were not suspected of being radicalised," Darmanin told France Inter radio. This meant new methods were needed, he said, adding that of 35 attacks prevented by the state since 2017, two were stopped by intelligence work online. Since 2017, French security agencies have been able to use algorithms to monitor messaging apps. The new bill would make that experimental use permanent and extend the use of algorithms to websites and web searches. The legislation makes permanent several temporary measures in use since France's state of emergency after the Islamist terrorist attacks in 2015. It would give security agencies more power to watch over and limit the movements of high-risk individuals after release from jail, for two years rather than one.

This discussion has been archived. No new comments can be posted.

France Planning To Allow Use of Algorithms To Detect Extremism Online

Comments Filter:
  • Bullshit (Score:3, Insightful)

    by stooo ( 2202012 ) on Friday April 30, 2021 @05:16AM (#61331322) Homepage

    This "automated illegal conten removal" is just not working, and will be abused anyway very soon.

    • Re: Bullshit (Score:3, Interesting)

      by JockTroll ( 996521 )
      It doesn't *need* to work, not as intended. It must be merely be *perceived* to work. Its main purpose will be to detect and remove content not deemed "appropriate" by those in power. No more pesky opposition! And yet people cheer those measures. As Europe creeps back into its evil, totalitarian past a new generation of brownshirts is ready to march. How many dead this time?
      • by MrNaz ( 730548 )

        In another universe, using algorithms to detect and prosecute whatever the government doesn't like IS extremism.
        But in this universe, we just call that "French".

        • by rtb61 ( 674572 )

          What they are doing is creating digital fishing algorithm, you know, the computer says so but in reality the algorithm are tilted for and against so they can run questionable warrant fishing expeditions into people's lives, especially all political activist, those who resist propaganda, claim all sorts of nonsense as pre-crimes and then attack them through the corporate cabal sans-prosecution, unless of course prosecution can be achieved and destroy them in prison instead.

          They will adjust the algorithms to

          • by MrNaz ( 730548 )

            I seem to remember another European regime using the technology to catalog and classify its citizens according to rigid rules.
            What was it called? Meh, I can't remember. I guess it's true what my friends say "Nazzy, you have a bad memory."

          • With any luck it will target anti vaxxers and anti lockdown protesters and eliminate them. Then we might have 3 deaths per million population from Covid like China instead of 1889 per million. In addition the accelerationist propaganda from left wing, right wing, religious and foreign fanatics will be deleted. Good.

      • Re: Bullshit (Score:5, Insightful)

        by Gravis Zero ( 934156 ) on Friday April 30, 2021 @09:18AM (#61331874)

        Its main purpose will be to detect and remove content not deemed "appropriate" by those in power.

        Note that you have made an unfounded claim based on limited information to come to a fully formed conclusion that lacks any evidence to support it. This is what is called a conspiracy theory.

        Could this be abused? Yes. Is there any evidence suggesting that it will be abused? Well, you didn't present anything even suggesting they may.

        • The problem France is facing nowadays is "lone wolves", people who become extremists on their own, in their own solitude, and one day spring into action. Nobody sees them coming. They fly under the radar because they actually don't talk about their ideas, and specially not online. Good luck catching someone who doesn't post anything online with an algorithm.

          The only way to catch them would be for the authorities to be informed of a change in behavior by the few friends/family they have. Usually, after the a

        • by Jerry ( 6400 )

          Its main purpose will be to detect and remove content not deemed "appropriate" by those in power.

          Note that you have made an unfounded claim based on limited information to come to a fully formed conclusion that lacks any evidence to support it. This is what is called a conspiracy theory.

          Could this be abused? Yes. Is there any evidence suggesting that it will be abused? Well, you didn't present anything even suggesting they may.

          Your post is your opinion, which is no more nor less than what the OP's is. So, you too are a conspiracy theorist. See how easy that is.

          • Your post is your opinion

            Literally nothing I wrote in that post was an opinion. Perhaps you need a remedial lesson in differentiating facts from opinions.

    • by mjwx ( 966435 )

      This "automated illegal conten removal" is just not working, and will be abused anyway very soon.

      Thats because the US government has allowed the DCMA to be used as a cudgel by private cartels against anyone they perceive as an enemy.

      That aside, automatic content removal isn't what is being proposed here, what is being proposed is using algorithms to spot potential extremists, basically automating a few basic tasks. System throws up an alert, forwards it to a human for investigations, at which point it ends up being "Zut Alors, zis person may be a terroreest, qui should keep an eye on zem" or "eet nothi

      • by Jerry ( 6400 )

        IOW, "Minority Report".

        Punishment before a crime is ever committed, determined by an "algorithm" which codifies the bias of its creators. In China it is called the "Social Credit Score". You can't even get toilet paper at a public restroom of the facial ID algorithm identifies you as a person with a low score. Imagine walking home with a dirty butt, unable to even ride a bus or hire a taxi. Those with low scores soon learn to carry their own roll of TP and a canteen of water.

    • I've had numerous comments removed or been suspended for a few days off of social media for the AI moderation taking something out of context such as me paraphrasing another individual or me commenting on a picture of a frog someone found and I said it was a "fat boi". The frog thing got me suspended for 1 day for "online bullying", but when I asked for a review of it being taken out of context. I immediately got a response said it had been reviewed and they were final in their decision and increasing my s
      • I note that my YouTube comments account has been terminated twice for calling morons - morons. Apparently it is hate speech to question the sanity of people. You never get a reason for being terminated either so I actually have no idea what I was terminated for. Screw them, new accounts are easy to create. I am also noticeably nastier after each ban with the things I say. Why hold back when you have no idea what you are being banned for.

    • by MrL0G1C ( 867445 )

      And if they drive the extremist talk underground then they won't be able to keep an eye on it.

      I expect gov't 3-letter type agencies to monitor the web for extremism and to watch closely any potential terrorists. Telling them they are listening in to conversations is a dumb idea.

  • by dbu ( 256902 ) on Friday April 30, 2021 @05:20AM (#61331324)

    This situation and the fight against it are increasingly reminiscent of the fifth column [wikipedia.org] rhetoric, which is all the more disturbing because the term was coined during a civil war and widely used in the wars that followed.

  • Look - slashdot 0 comments!

  • Efficiency (Score:5, Funny)

    by Dirk Becher ( 1061828 ) on Friday April 30, 2021 @05:35AM (#61331338)

    "Computer! Plese give me a list of all extremist pages on the web!"

    *Found 5.27 billion entries."

    "Hmm, guess I'll have to narrow it down a bit: Religious. Violent. Self-Righteous. Authoritarian. Obscurantist. Here we go!"

    *Found 5.27 billion entries."

    "Screw it, I'll just graze reddit."

  • It is inside someone's head until it becomes reality.

    • That and most people who see any of the so-called extremist websites or other content don't become mass-murderers or engage in other acts of terrorism. Frankly you could take just about anything and if enough people have seen it, eventually some crazy asshole will commit some kind of violence because they think that's what they're being asked to do. Do we add The Catcher in the Rye, Taxi Driver, or any other piece of media that some deranged person claimed to have influenced them in their crimes?

      Maybe we
      • by PPH ( 736903 )

        get them some help

        Puberty blockers?

      • I note that there are sophisticated propaganda outlets online which pump out hate speech day in and day out against their chosen enemies. Some are Islamic State, some enemy States and some are just political parties that rely on hatred of the opposition for votes. People seeking an identity are easily drawn into this mess and end up with terror cult mindsets. These outlets are not Catcher in the Rye, they are there to push the hate button daily - usually for political influence but easily the cause of mass

    • It is inside someone's head until it becomes reality.

      Exactly. School shooters for instance don't just appear overnight. It starts with a bunch of lonely people and a small percentage of those become depressed and a small percentage of those become suicidal and a small percentage of those decide to take other people with them. Or it might start with someone being bullied and a small percentage of those go down the rabbit hole too. But the rabbit hole is still a series of funnels with literally millions of people at the top. It's kindof like radiation ex

  • by xpiotr ( 521809 ) on Friday April 30, 2021 @05:51AM (#61331372) Homepage
    I'm split. It was debated on news the other day here, with the concerned ministers.
    Basically, the current algorithm detects if you call Syria on your phone.
    It did not detect if you use FB Messenger (etc.) to talk to suspect persons/locations.
    Currently it does NOT detect if you spend your day on the net looking at beheading videos from ISIS.
    The proposed algorithm would flag suspect things, then the police will have to contact a judge and a prosecutor and decide if the data should be de-anonymous.
    In my opinion, GAFA already has the data, so why not the anti terrorist organisation too?
    • by BAReFO0t ( 6240524 ) on Friday April 30, 2021 @07:04AM (#61331490)

      Oh kids. In the early 2000s, at least in Germany, watching shocker videos, including 3guys1hammer and beheadings, were a national coming of age ritual for young people, especially boys.

      Basically a test to how strong your mind was and what it could handle, to train you for being able to keeo yourself together in real life, even in the case shit goes down. (You know... exactly what the special snowflakes did not learn thanks to their safe spaces.)
      And it was a test exactly *because* one did not like it.

      It's not new though. In the decades before, watching splatter movies and generally all banned movies was the equivalent.

      Not to campare the teo, but just for the sake of an analogy, it's like the difference between the recluse perv who never leaves his basement and watches child porn, and the one who actually *makes* the child porn.
      The former requires immediate intense therapy, of course. But it's the latter who is at the top of the list of who one needs to catch.
      The former might not even want to have these feelings, let alone harm children. The latter does.

      • Oh kids. In the early 2000s, at least in Germany, watching shocker videos, including 3guys1hammer and beheadings, were a national coming of age ritual for young people, especially boys.

        So an entire generation intentionally suffered self-induced PTSD?

        That explains a few things about Germany...

  • Who is Darmanin (Score:4, Informative)

    by AncalagonTotof ( 1025748 ) on Friday April 30, 2021 @05:51AM (#61331374)
    In French [wikipedia.org]
    In English, but a lot less detailed [wikipedia.org]

    In short : a racist homophobic rapist who became Interior Minister (mostly cops minister)
    • So France's Schäuble. (Germany's Cheney.)

    • At least they didn't make theirs president.
  • ...of France is what I suspect if they press the treacherous AI.

    Remember the Bastille,
  • by puddingebola ( 2036796 ) on Friday April 30, 2021 @06:39AM (#61331440) Journal
    Isis Terrorist Attack Weapons Guns Bombs AK47 M16 AR-15 French Government terrorism bombing shooting explosions poison gas Ricin nerve gas mustard gas anthrax kill shoot maim wound smallpox virus biological attack
  • Bureaucratic one-rule-fits-all prejudice too.
    With no human to intervene in cases where common sense dictates exceptions or bugs happen.

    Because ...
    Spongebob_magic_rainbow_meme.gif
    *algorithms*!

    Last but not least:
    Picard: Computer! Define "extremism"!
    Computer: Everthing that the established dicators at the time deemed too far outside the goosestepping line. It was a convenient tool, to put everyone who does not obey in with terrorists and criminals, and give the citizens a convenient scapegoat for all problems,

  • ... that you are an extremist. Therefore no human can be blamed for the decisions that follow.
    Same with the anti-cheating software that universities used during the lock-down for exams taken from home: Computer says you cheated. You cannot sue the university, go ahead and sue the computer.

  • Now: EU proposes restrictions on AI* *Unless it's the government
  • What is extremism? (Score:5, Insightful)

    by scamper_22 ( 1073470 ) on Friday April 30, 2021 @09:09AM (#61331844)

    It's a genuine question I have and I think this is really what a lot of countries are going to have to seriously address.

    There are those who think extremism is merely the use of violence. You can hold whatever view you want, as long as you don't act violently. On some surface level, that sounds interesting. The problem comes when it actually hit human nature. People want to follow their beliefs. A vegan doesn't want to see animals slaughtered. You create a very tense and conflict prone society as people's core values are challenged. I only use vegans here as an example to hopefully avoid hotter groups. But who knows maybe Vegans are just as hot. If you get a group of vegans who genuinely belief animal slaughter is murder... do you not think they'd think themselves righteous if they took stronger, possible violent measures to achieve that goal.

    Now, I'll venture a bit more. Take abortion as it relates typically to religious group. The claim is often that abortion is murder. Interesting view. But ponder that for a second. If you really believed abortion is murder, would you not be righteous is trying to stop it? If the government was lining up 5 year olds in government schools and shooting them... who of us would not think we should possibly violently revolt against that?

    I speak from personal experience here. I grew up very religious (conservative Sunni Muslim). To put it lightly I genuinely felt strong moral and righteous motivations in certain ways. I do not joke when I say, a wrong turn here or there or the wrong associations here or there, and who knows what path my life would have led. As a teengager, I genuinely had vision of being a holy warrior and liberating Palestine. I've never been to Palestine. I only grew up in Africa and then in Canada. I genuinely thought the fiat monetary system of the West was evil and that only a return to the Islamic gold standard or something else could liberate us from the evil of big finance.

    That same drive that perhaps makes people call oil companies evil or big banks evil or donald trump evil or socialism evil or communism evil or homosexuality evil or the patriarchy is evil or feminism is evil... is what drives so many of us. Whatever cause we think is righteous. Someone might fight feminism as they see it as a threat to the righteousness of family and god life. Others might fight religion as they see it as a threat to their freedoms.

    The way I've come to see it is that violence is not what we need to worry about. Everyone and every group is willing to use violence to correct what they see as righting a wrong. How much would be blame the Uyghurs in China if they used violence to revolt against China? China would naturally use violence in return or state control violence to keep China together. The US civil war is another classic case. Also never forget the state is always in a state of violence against those who oppose it. Again from personal experience. You might think of Canada as this peaceful place, but again, back in the day I viewed the Canadian state (government, police, banks, military...) as oppressing We were living under Western subjugation preventing us from living a real Muslim life under Islamic rules. It's just incorrect to think that just because the state isn't actively committing genocide that it's not using force. The threat of force is just that... force.

    We often try to reduce beliefs to trivial things... until they matter. But they do matter. Whatever you feel so strongly about... chances are your worst enemy feels strongly and righteously about their beliefs.

    In my view, we either try and actually reduce beliefs in society so people don't care as much. Because any strong belief in and of itself is 'extremism'. Or you minimize the number of beliefs in your society. In a sense, you only allow one extremist thought in your society.

    You either say that no one can really have strong beliefs. You're only allowed to be a casual Muslim, Christian, Feminist, Environmentalist, Socialist... You can be Muslim. Follow

  • How does an algorithm determine context between someone ...

    * discussing/searching history,
    * using humor,
    * actual planning of violence, and
    * trolling?

    ... because even humans can't always do that.

    Any sort of "automated" system is always going to have false positives due to lack of context.

    The excuse is always "Think of the children" / safety but this is a dangerous slippery slope where it seem innocuous at first and slowly expands. Who keeps the system in check? Is the source code available so people can

  • These systems tend to get a bunch of press, a bunch of funding, and end up producing nothing but a bunch of powerpoints explaining why their project needs more time and funding. I would be very surprised if it gets deployed in any functional capacity outside running on real data and reports being written about it. This kind of sentiment analysis keeps getting hyped by every wave of new graduates making it up the chain, but they never deliver.
    • Yes but we spend our taxes on those systems, which is bad. I'd rather pay my taxes to hire more police, or (maybe more productive in the long term) better teachers.

  • "Extremism in defense of liberty is no vice." -- Barry Goldwater
    "Liberte, egalite, fraternite." -- French Revolution.
    "Vive France Libre" -- Charles DeGaulle.

    "Au revoir, la France." -- Macron.

  • Get the government out of the policing information!

    It's too expensive and they're terrible at it.
  • Cue up Black Sabbath - Paranoid.

"The vast majority of successful major crimes against property are perpetrated by individuals abusing positions of trust." -- Lawrence Dalzell

Working...