Become a fan of Slashdot on Facebook

 


Forgot your password?
Close
typodupeerror
×
AI Security Technology

To Protect AI From Attacks, Show It Fake Data (technologyreview.com) 34

Posted by msmash from the how-about-that dept.
AI systems can sometimes be tricked into seeing something that's not actually there -- remember when Google's software "saw" a 3-D-printed turtle as a rifle. At an event earlier this week, Google Brain researcher Ian Goodfellow explained how AI systems defend themselves. From a report: Goodfellow is best known as the creator of generative adversarial networks (GANs), a type of artificial intelligence that makes use of two networks trained on the same data. One of the networks, called the generator, creates synthetic data, usually images, while the other network, called the discriminator, uses the same data set to determine whether the input is real. Goodfellow went through nearly a dozen examples of how different researchers have used GANs in their work, but he focused on his current main research interest, defending machine-learning systems from being fooled in the first place.

[...] GANs are very good at creating realistic adversarial examples, which end up being a very good way to train AI systems to develop a robust defense. If systems are trained on adversarial examples that they have to spot, they get better at recognizing adversarial attacks. The better those adversarial examples, the stronger the defense.
This discussion has been archived. No new comments can be posted.

To Protect AI From Attacks, Show It Fake Data More

To Protect AI From Attacks, Show It Fake Data

Comments Filter:

  • That's a fancy way to say ... (Score:1)

    by Anonymous Coward

    ... don't submit your real information, name, phone, etc, all over the internet. I've been doing ot for ages. Facebook, feel free to datamine my 20+ throw-away accounts.

  • That's cool. (Score:1)

    by Anonymous Coward

    Right up until China uses it to make their "social score" unbeatable, the US government and the big tech companies join up to combine targeted adverts with "counter-terrorism" ubiqutous surveilance, the UK uses it to make sure all of the country remains sex-free, the EU uses it to prevent "racist populist islamophobic" protests, and so on, and so forth.

    The tech's cool, but the uses aren't, unless you're with the guys using it to increase their hold on power. So, are you with them, or against them?

  • not doing anything that couldn't be done without big enough array of pneumatics or gears....we'll never do what a biological brain can do, or improve on that, going down this path

    I suspect the real answer to AI will be in the realm of biology, to grow systems that don't have the pesky problems of animal neural nets like lifespan

  • This sounds hokey, but I'm serious. If we create something that can learn on it's own it would eventually, even if we prevented it, be able to rewrite at least some of it's own routines and safeguards, even though that we didn't, necessarily, want it to be able to overwrite. As humans we are limited by our hardware capacity but as code running in "the cloud" able to allocate more resources to the growth of it's "mind" or even just to rewrite it's own code to be more efficient than a human would have been ab

    • Re:How do we prevent the AI, itself, from attackin (Score:4, Interesting)

      by Mister Liberty ( 769145 ) on Sunday April 01, 2018 @03:37PM (#56363809)
      Nick Bostrom: "Superintelligence. Paths, Dangers, Strategies." https://global.oup.com/academi... [oup.com]
    • I'll tell you what: you write a simple program that can reprogram itself and I will listen to this drivel. We can barely even create functional software. You guys think if you connect a million computers together then you will have AI. But really what you have is the Internet. And that ain't intelligent.

      • Re: (Score:2)

        by rtb61 ( 674572 )

        If you do not see the Artificial Intelligence of the Earth's Internet, you just fail to see, how you are plugged into it and are a part of that over reaching Artificial Intelligence, a bio computing unit adding it's processing power to the collective whole, kinda sucks to be used like that but it is just the way it is. The Earth's Internet just used your inputs to further process and drive to a goal as it did mine and as it will feed into others who will generate more inputs, producing more outputs, don't

      • Seriously, binary guy, what is your beef?

        In every thread regarding any aspect of AI, you move the goal posts into a territory where they were not from the start (and nobody else attempts to place them), and then furiously start kicking. It about as meaningful - but not as entertaining to watch - as tab-vs-spaces debates.

        My guess (and I may be wrong) is that you are not really stupid, but may have decent insights that you are just too frustrated to be able to formulate clearly. For your own sake, and for our

        • His beef is the same one every programmer has:

          It isn't fucking "intelligence" -- it's Artificial Ignorance (A.I.) at best.

          e.g. AlphaGo has NO concept of what a board is, what a stone is, what a player is, etc. It just following an algorithm. Go ahead and add a custom house rule and watch it crash-and-burn.

          Here, I'll put it in simple terms you can understand:

          An algorithm using a glorified Table-Lookup is NOT fucking Artificial "Intelligence."

          People who use the bullshit term "A.I." term are the ones moving t

          • Only idiots argue over the "correct" way to indent.

            Or the term Artificial Intelligence.

            Yes, it is a misnormer in most cases. Get over it. It is just a badly selected term. Your suggestions are even worse since they are wrong or downright derisive, but I too would welcome better terminology. However, I think that if people are blinded by a name, they miss out on what is really behind it. I cringe a bit every time I say AI, but it is often the most understandable term I can find when discussing on a high level without going to technically specific. It is very

    • Re: (Score:2)

      by AHuxley ( 892839 )
      Dont use social media. Use a VPN. Use a CC online only for rare shopping services not in your community.
      Stop feeing the AI on the easy things.
      Make the AI have to use CCTV face tracking to collect on who pays in cash.
  • The rogue robocop, ED-209, with defective AI, "put the gun down..."
    https://www.youtube.com/watch?... [youtube.com]
    After the video of Uber's pedestrian rundown , this Robocop scene seems a little more worrisome...

    • It could be worse. The last thing you want to hear from an AI is "... let there be light."

      https://www.youtube.com/watch?v=WOZwyf9v4Z4

  • AI training vs. human education (Score:4, Interesting)

    by AtariEric ( 571910 ) on Sunday April 01, 2018 @05:44PM (#56364141)
    We are now programming AI to think critically more than we are teaching our children to do the same.

    I welcome our robotic AI overlords.

  • Gentlemen, I present to you our latest revolution in AI development: Punishment!

    Seriously, ask any parent or psychologist and they could tell you that a positive-reinforcement-only training regimen will lead to problems.

Slashdot Top Deals

"The whole problem with the world is that fools and fanatics are always so certain of themselves, but wiser people so full of doubts." -- Bertrand Russell

Close