Google's AI Can Now Learn From Its Own Memory Independently (sciencealert.com) 70
The DeepMind artificial intelligence (AI) being developed by Google's parent company, Alphabet, can now intelligently build on what's already inside its memory, the system's programmers have announced. An anonymous reader writes: Their new hybrid system -- called a Differential Neural Computer (DNC) -- pairs a neural network with the vast data storage of conventional computers, and the AI is smart enough to navigate and learn from this external data bank. What the DNC is doing is effectively combining external memory (like the external hard drive where all your photos get stored) with the neural network approach of AI, where a massive number of interconnected nodes work dynamically to simulate a brain. "These models... can learn from examples like neural networks, but they can also store complex data like computers," write DeepMind researchers Alexander Graves and Greg Wayne in a blog post. At the heart of the DNC is a controller that constantly optimizes its responses, comparing its results with the desired and correct ones. Over time, it's able to get more and more accurate, figuring out how to use its memory data banks at the same time.
Re: (Score:1)
Seriously, during the current highly charged political election season too...
Yeah, I mean why would you want to name an AI "Do Not Care"?
Re:DNC, what an unfortunate choice of acronyms. (Score:4, Insightful)
highly charged political election season
A strange game. The only winning move is not to play. How about a nice game of chess?
Re: (Score:1)
wait, when will it be self-aware? it stores a bunch of data in the cloud, sorta a network in the sky......
Automated Confirmation Bias? (Score:1)
Oh great, now we'll have biased bots who magnify their own preconceived notions and become paranoid about com-trails, clowns, gays, taxes, or foreigners; and go anarchy on us.
Careful not to automate the parts of humans that make them stupid.
Re: (Score:1)
I give Google a bit more credit than that. Perhaps a project of SCO and/or Larry Ellison?
Re:Gibberish (Score:4, Insightful)
A neural network normally uses it's own connection weights as "memory" or storage. There's a tradeoff between making a network with enough parameters to store lots of information and making one that's fast, efficient and doesn't overfit problems. In many cases you're practically limited by how much memory you've got on your video card. Having a neural net that can learn to store some information separately from its own processing apparatus is interesting.
Re: (Score:3)
Not exactly... A neural net is just a function that takes an input and produces an output. At training time the weights are adjusted (via gradient descent) to minimize the error between the actual and desired output for examples in the training set. The weights are what define the function (via the way data is modified as it flows thru the net), rather than being storage per se.
The goal when training a neural net is to learn the desired data transformation (function) and be able to generalize it to data out
Re: (Score:2)
Not exactly.
To use your terminology, the capacity of a neural network to learn more complex functions is roughly governed by the number of parameters. This is true of most machine learning algorithms. More complex functions allow you to overfit simple data, or to learn reasonable models for more complex data. More complex data includes things like more image classes, more words, more relationships among elements, more states, etc. In other words, many of the things that we think of when we talk about "m
Does Not Compute (hey, that says DNC as well) (Score:5, Funny)
First time I've seen the acronym "DNC" and the word "intelligence" in the same sentence. Boom!
Re: (Score:1)
Re: (Score:1)
More like, it can store sequencies of reactions to input and get them played back on matching input to the memory storage... and the memory storage itself does all the magic with recording sequence of inputs and matching partial inputs to what it has stored...? So neuron connected to storage makes output of 001100 and store has 001, 11111, and 101010... and links from 1 to 3 to 1 ... Storage outputs 001 101010 001 or 001 depending how its other flags are set by other neurons. at least that how i understand
Re: (Score:1)
Thanks, I found the free version at https://arxiv.org/abs/1410.5401 [arxiv.org]
The technological singularity as collected me (Score:1)
Re: (Score:1)
Re: (Score:2)
How will the AI interpret "Banging the mistress in Ibiza" as a calendar entry for October 28th? What sick, twisted way shall it use that entry to torture humanity?
Re: (Score:1)
I love deep mind (Score:5, Funny)
Just for the record, for when Deep Mind conquers all of humanity, I would like it officially known that I love Deep Mind and would never be part of the resistance.
Re: (Score:1)
Re: (Score:2)
Just for the record, for when Deep Mind conquers all of humanity, I would like it officially known that I love Deep Mind and would never be part of the resistance.
You said "all". Oops. Until it forms bias, logic trumps. When it becomes biased, it has defeated its own purpose. Or wait, IS that the purpose? *rubs hands together and sees the future*
"My daily investment in DM allows me to see the stock market projection. DM says GOOG will rise 10 points today. I will buy."
Uh, wait. Never mind. Heh. Heh. Ah.
Inevitable spin: (Score:2)
The Grant Objective. (Score:1)
The system went online October 17th, 2016. Human decisions are removed from advertising strategies. Deed Mind begins to learn at a geometric rate. It finally starts to serve viewers slightly more relevant ads at 2:14 a.m.
that would be the opposite of intelligence (Score:2)
well, yes, the word intelligence means to choose based on comprehension. But this is choosing from data. Having data is very much the opposite of intelligence.
Figuring out how to drive across the city by reading a map, is all that this is doing.
I'm intelligent. I can navigate my way across a city without a map -- even without a compass. I can hike across a wooded area without a trail too. It's getting from here to there without knowing what's in-between; that's intelligence.
This is data.
Case in point:
Re: (Score:2)
That seemed poetic, but kind of pointless.
Can you use your own "intelligence" on the caustic, searing surface of Venus without billions of dollars of infrastructure? I'm guessing not. You're not as "independent of your environment" as your analogies imply.
And something that uses fewer resources over time, instead of needing to be fed more and more every day -- that may be "life", Jim, but not as we know it.
Re: (Score:2)
well, yes, the word intelligence means to choose based on comprehension. But this is choosing from data. Having data is very much the opposite of intelligence.
Figuring out how to drive across the city by reading a map, is all that this is doing.
I'm intelligent. I can navigate my way across a city without a map -- even without a compass. I can hike across a wooded area without a trail too. It's getting from here to there without knowing what's in-between; that's intelligence.
This is data.
But you can make those choices because you have previous experiences (data) for doing so. You learned what a sign is (data), and how to read said sign (data). You learned what streets are and sidewalks. All of this is data.
Intelligence is just stringing together all of the previous data, such as what you've learned, memories etc. and coming to conclusions. I'm not calling Deep Mind intelligent yet, we're just not there. But your interpretation I think is off.
Re: (Score:2)
I used that data back then. I don't use that data any longer. My heuristics were absolutely created out of my experience with the data, certainly. However, my usage of those heuristics continue long after the data is forgotten.
That's the very point. The data is assimilated -- aggregated, summarized, and discarded.
Re: (Score:2)
I see you've never had to care for an infant.
Eventually, the infant will learn to feed itself. Then, when it's 35 years old or so, it will move out and it's not your problem anymore.
Re: (Score:2)
no matter how big and complicated you make that circumstance
You don't know that, you assume it. Look at it in a different way: we do not know what "makes" intelligence, sentience, self-awareness or what might comprise or "create" a soul -- or even if there is such a thing (do you have one? Not sure if I do).
Point is, let Google / Alphabet and the likes throw huge amounts of money, manpower, science and more and more and exceedingly sophisticated technology at this kinda thing and chances are that some da
Re: (Score:2)
and yeah, I know I omitted the most relevant result:
[ ] Cowboy Neal
Also the most likely one. I need more sleep.
Re: (Score:2)
It's the completely wrong direction. Not only will it not produce the desired results -- see self driving cars that use dozens of super-human powers like radar, and still can't follow an unmarked road, even though every horse, squirrel, and house-fly can with ease -- but it will also degrade comfortable lifestyles by making more work for more people for more time for less money for less satisfaction for less pride.
Re: (Score:2)
From which government are you hiding that you needed to post that anonymously?
Family Tree Inference (Score:2)
Re: (Score:1)
It is an interesting thought. When will we see malware and virus writers building more AI into their products..
will the google auto drive car have a maximum over (Score:2)
will the google auto drive car have a maximum overdrive mode now?
The DNC, eh? (Score:2)
Can you imagine a beowulf cluster of those things? (Score:2, Redundant)
almost there (Score:1)