Catch up on stories from the past week (and beyond) at the Slashdot story archive

 



Forgot your password?
typodupeerror
×
Google AI Businesses

Google Workers Urge CEO To Pull Out of Pentagon AI Project (nytimes.com) 283

Thousands of Google employees, including dozens of senior engineers, have signed a letter protesting the company's involvement in a Pentagon program that uses artificial intelligence to interpret video imagery and could be used to improve the targeting of drone strikes (Editor's note: the link may be paywalled; alternative source). From a report: The letter, which is circulating inside Google and has garnered more than 3,100 signatures, reflects a culture clash between Silicon Valley and the federal government that is likely to intensify as cutting-edge artificial intelligence is increasingly employed for military purposes. "We believe that Google should not be in the business of war," says the letter, addressed to Sundar Pichai, the company's chief executive. It asks that Google pull out of Project Maven, a Pentagon pilot program, and announce a policy that it will not "ever build warfare technology."

That kind of idealistic stance, while certainly not shared by all Google employees, comes naturally to a company whose motto is "Don't be evil," a phrase invoked in the protest letter. But it is distinctly foreign to Washington's massive defense industry and certainly to the Pentagon, where the defense secretary, Jim Mattis, has often said a central goal is to increase the "lethality" of the United States military.

This discussion has been archived. No new comments can be posted.

Google Workers Urge CEO To Pull Out of Pentagon AI Project

Comments Filter:
  • Business as usual (Score:3, Insightful)

    by Anonymous Coward on Wednesday April 04, 2018 @01:20PM (#56381819)

    Instead of helping them to make drone strikes more accurate, let's let the Pentagon continue to hit civilian bystanders too.

    • I'm kind of surprised the engineers, of all people, don't remember the lesson from history that an AI would hopefully learn that the only winning move is not to play.

    • by raymorris ( 2726007 ) on Wednesday April 04, 2018 @01:52PM (#56382051) Journal

      That's a good point, to be balanced against the initial gut-reaction of not wanting your technology to be used militarily. Until fairly recently, war was waged by destroying the enemy *country*. Now we target individuals and small groups. We can do that now because we have accurate targeting.

      In world war 2, only 20% of bombs hit within 1,000 feet of the target. Most hit within a mile radius, so the real target was something like "the west side of the city". By the gulf war, target radius was 10 meters, 30 feet. We could bomb a vehicle instead of a neighborhood.

      If you are against war, it is clearly better to destroy a given vehicle than an entire neighborhood. Therefore more accurate targeting is better, it reduces deaths and injuries.

      • by Anonymous Coward on Wednesday April 04, 2018 @04:07PM (#56383181)

        The problem is that we're not at war. Or, maybe more accurately, we've always been at war with Eurasia. Improved accuracy finally realizes the dream of the US government to kill individuals from the air--in the future maybe from orbit. The concept that this is about protecting civilians is pretty laughable though.

        In World War 2 if they had better targeting they would have killed more civilians, not less. The US and UK didn't firebomb Dresden and Tokyo by accident. At some level civilians were considered an acceptable target because they provided the continued means to wage war. Do you honestly think this is radically different today? Better facial recognition might improve accuracy on only killing the intended target, but are any of the intended targets not civilians? We're left with the words of US Intelligence to judge whether a person deserves execution.

        I find the power and convenience of drone strikes frightening. I don't think making them better in any way is actually a real improvement.

        PS - The real truth to me is the Military Industrial Complex wants the targeting because it costs money. As another poster pointed out, a small improvement in improving the targeting costs millions. Slightly better body armor costs millions more. It's all a game to drive up the cost of war because all the feigning of concern for life is good for business. At best that is secondary because clearly the goal is to kill people.

        • > The concept that this is about protecting civilians is pretty laughable though.
          >In World War 2 if they had better targeting they would have killed more civilians, not less.
          > Do you honestly think this is radically different today?

          Since the late 1950s we've had bombers that can carry 35 TIMES as much bomb payload as the largest bombers as WW2. A single B-52 sortie can level an area 1 mile by 2 miles. We stopped doing that the instant we got reliable precision guided bombs in the late 1970s. Why do

        • Bomber Command adopted the "dehousing" campaign because at that time they couldn't reliably hit anything smaller than a city at night. The intention remained to destroy housing, not kill people, although obviously a whole lot of people would die with a city-busting campaign. The USAAF tried precision bombing, but found it really didn't work under common European weather conditions, and did a lot more area bombing. In both cases, we see an attempt at precision bombing not work, and area bombing being ado

      • There is a lot to be said though for keeping war messy. If it becomes to sterile and clean then the disincentive to engage in it starts to wane. In the US we already have enough trouble reigning in war hawks that want to use military might to resolve every conflict. Being in their positions of power largely protects them and their families from the dangers of war while they get to engage in profiting from it. Personally I'd like to see every congress critter be required to serve on the front lines as a non-

        • by jwhyche ( 6192 )

          I figure after a few rounds of that they'd have little trouble finding peaceful resolutions to more conflicts.messy

          Damn Straight. We have to many leaders willing to lead from behind. Let a few congress critters or members of their immediate family spend some time getting shot at. I bet some minds will be changed pretty damn quick about somethings.

      • by ceoyoyo ( 59147 )

        That's a bit of an oversimplification. War probably started out as conflicts over hunting grounds or other territory. Hungry people whacking each other, up close and personal. Later it was refined to some noble wanting to distract his peasants from how hungry they were, so he marched a bunch of them up to some other noble's army and they stabbed or later shot each other at close range for a bit.

        WWI was the big test of the new hotness, mechanized killing. WWII added dropping bombs from airplanes in the g

    • by Sarten-X ( 1102295 ) on Wednesday April 04, 2018 @01:57PM (#56382087) Homepage

      Well, that's it. This discussion's pretty well covered, now.

      Seriously, this is exactly the dilemma. Back when I did defense work (connected distantly to attacks), nobody ever had intention of hitting civilians. It was bad intel, bad guidance, or just a plain and simple screwup. We just kept trying to be better, adding more confirmations, better cameras, better training... and slowly things got better.

      None of those improvements were cheap. A small improvement in image quality might mean a few hundred million dollars in expenses, mostly in paperwork to track exactly what work happened where and how, but if it provides the critical information to prevent a single bad mission, it's worth the price.

      It's not a popular opinion, but it seems to me that war is inevitable. People are always finding new means and reasons to kill each other, and they'll do it with or without my help. The best we can do as engineers is to make sure that the attacks are as precise and successful as possible, to minimize the innocent casualties.If an AI can tell the difference in 10 pixels between a firearm flash or the sun reflecting off a camera lens, I'm all in favor of it.

      • Re: (Score:3, Informative)

        by Thelasko ( 1196535 )

        People are always finding new means and reasons to kill each other, and they'll do it with or without my help. The best we can do as engineers is to make sure that the attacks are as precise and successful as possible, to minimize the innocent casualties.If an AI can tell the difference in 10 pixels between a firearm flash or the sun reflecting off a camera lens, I'm all in favor of it.

        100 years ago, the belief was that war could be ended if there were only more powerful weapons. Those weapons were created, and their creators [wikipedia.org] went on to regret [wikipedia.org] creating them. [wikipedia.org] Sure, people will continue to kill each other, but they can do it without my help.

        History has taught us, war is a zero sum game. The only way to win is not to play.

        I became an engineer to make the world better, not to tear it apart.

        • History has taught us, war is a zero sum game. The only way to win is not to play.

          That would make it a negative sum game.

        • by c6gunner ( 950153 ) on Wednesday April 04, 2018 @03:37PM (#56382967) Homepage

          History has taught us, war is a zero sum game. The only way to win is not to play.

          This is by far the stupidest comment I've read in recent history. A zero sum game is, by definition, one in which a win for one side is a proportional loss for the other. If I want to play and you don't, you lose by default.

          You have to be completely ignorant of human history to decide that "not playing" is a winning move.

        • by Solandri ( 704621 ) on Wednesday April 04, 2018 @03:50PM (#56383075)

          100 years ago, the belief was that war could be ended if there were only more powerful weapons. Those weapons were created, and their creators went on to regret creating them.

          Considering the U.S. and Soviet Union never went to direct war against each other, and that the eventual resolution to the Cold War was based on economics and politics, it seems to have worked. If you look at all the wars since Nagasaki was bombed, they've between two non-nuclear states, or between a nuclear state and a non-nuclear state. The nuclear states have steadfastly avoided direct war against each other. Even when one forcibly invades and annexes territory [wikipedia.org] which belongs to a non-nuclear state that other nuclear states have sworn to defend (ironically in exchange for giving up their nukes).

          History has taught us, war is a zero sum game. The only way to win is not to play.

          War is a zero sum game. But choosing not to play does not mean you're no longer a player - it does not raise an invincible shield around you. You simply get attacked and conquered by someone who plays, and the effect of your choice is nullified when you cease to exist. Your assets and resources get transferred to your conquerer. Choosing not to play doesn't mean you don't participate in the zero sum the game; it means you end up guaranteed to in the negative half of the zero sum game. It's like thermodynamics. Everyone likes to dream of all the things that are possible if you could simply quit the game. But the reality is that you're not allowed to quit. Even if every country and every person on Earth disarmed, all it would take is for one person to sharpen a stick and mug someone with it to start the process all over again.

          War exists because of a simple economic reality - it's often cheaper to simply take assets and resources from your neighbors rather than work to build them up yourself. If you abstain from preparing for war, you do nothing to change that fundamental economic incentive. The way to avoid war is to make it more expensive for someone to take your assets and resources from you, than they stand to gain by taking them.

          I became an engineer to make the world better, not to tear it apart.

          From an engineering perspective, you strive to make the world a better place, and to protect the better place you've made. If your government chooses to misuse the tools you've created to wage unjust wars, then the solution to that is a political modification of your government, not abstention. Abstention means someone who doesn't share your ideals invades and takes everything you've created for themselves.

          • by G00F ( 241765 )

            This is good stuff, and should be modded up for that.

            It clearly shows how pacifism while in theory works, but in practice fails. And why rather than quitting, you should try to make changes.

            • Pacifism is not an activity, it's a movement. It doesn't work until you achieve critical mass. You not going to war won't change anything, but if you can get half the population on your side then things are different.
          • There is one horrible flaw in you premise: Putin is no Gorbachev. His intelligence background deludes him into believing all protests are sponsored by foreign actors, and thus democracy is a farce. He also believes that if he looses control as a dictator, he will be killed, and as such there is no limit to what he will do to stay in power.

            Source: http://www.pbs.org/video/putin... [pbs.org]

          • which belongs to a non-nuclear state that other nuclear states have sworn to defend

            Are you talking about the Budapest Memorandum? No where in there does it say that any of the signatories are sworn to defend the Ukraine:

            1. Respect Belarusian, Kazakh and Ukrainian independence and sovereignty and the existing borders.

            2. Refrain from the threat or use of force against Belarus, Kazakhstan and Ukraine.

            3. Refrain from using economic pressure on Belarus, Kazakhstan and Ukraine in order to influence its politics.

            4. Seek immediate United Nations Security Council action to provide assistance t

    • by gweihir ( 88907 )

      They are hitting innocent bystanders because they do not care. That will continue. They just want to be sure to hit the actual target as well.

    • Instead of helping them to make drone strikes more accurate, let's let the Pentagon continue to hit civilian bystanders too.

      I suspect Jevons paradox may also apply to drones.

    • by rtb61 ( 674572 )

      It is a valid personal choice that you have zero right to contest in any way. Upon a life balance basis, contributing more to life than you consume from it. Contributing to engineering specifically designed to kill, to rapaciously consume life, just killing it to kill it and diminish your life's worth to induce a completely undesirable negative balance. Your engineering potentially killing millions and placing that negative burden upon your spirit, is a self destructive obscenity and any living being as a i

      • The googl E employees are 'good people's if and only if they actually resign their jobs if Google doesn't capitulate to their demands, otherwise they are toothless SJW who put the appearance of seeming virtuous ahead of actually being virtuous.

  • by FilmedInNoir ( 1392323 ) on Wednesday April 04, 2018 @01:24PM (#56381837)
    Google announces a massive layoff of more than 3100 employees after it was found they said something politically incorrect or something like that... whatever.
  • Yet... (Score:2, Insightful)

    by Anonymous Coward

    They apparently have no problem with their employer providing anonymized telephone service to illegal telemarketers.

  • comes naturally (Score:3, Insightful)

    by micahraleigh ( 2600457 ) on Wednesday April 04, 2018 @01:29PM (#56381881)
    "comes naturally to a company whose motto is "Don't be evil,""

    Naturally ... the military is evil.

    You don't have to really make that interpretation on your own.

    See we have these helpful smart people to tell us how to form opinions.

    In addition to figuring out how to search web pages what else would any engineer naturally learn really good?

    The military does evil things.

    Of course !!

    Please don't bother disagreeing with this. We are all very mentally exhausted from all the smart things we do all the time. Rubix cube pagaentry and all that takes its toll, so don't be an insensitive clod.
    • Killing is evil. (Score:2, Insightful)

      by Comboman ( 895500 )
      A targeting system for weapons is intended to kill people. Killing people is inherently evil, even if it may occasionally be necessary as "the lesser of two evils". This is not a partisan issue; it should be blindingly obvious to anyone with a moral compass.
      • by alvinrod ( 889928 ) on Wednesday April 04, 2018 @02:26PM (#56382321)
        Murder is inherently evil, but killing isn't. Otherwise you could extend the same logic to conclude the jailing people indefinitely is inherently evil as well. There are some terrible people in the world intent on terrible actions. Killing them (or imprisoning them for the remainder of their days) results in a net reduction in the amount of suffering and evil in the world.

        Right now the tools that we have at our disposal not only kill the intended target, but typically a few other people who may not need killing or are perhaps completely innocent such that no one could claim that they deserve any rebuke, let alone death. Unfortunately that collateral damage doesn't do enough to outweight the benefit from killing those who need to be killed. Improving our tools would allow us to spare those innocents from an unfortunate fate. One could just as well argue that refusing to make a better tool that would reduce collateral damage is morally evil.

        Perhaps in the future we'll have even better tools and it won't be necessary to kill anyone at all, but that does us little good in the here and now, and we're unlikely to make an immediate leap to that point without the same kind of gradual and incremental improvement that drives humanity forward.
        • by ceoyoyo ( 59147 )

          "Otherwise you could extend the same logic to conclude the jailing people indefinitely is inherently evil as well."

          It is. Sometimes it may be necessary as "the lesser of two evils" as the GP pointed out. It's something you might do if there's no other option.

          Even then, countries with modern justice systems have found that in the vast majority of cases it's better to rehabilitate prisoners.

  • by powerlord ( 28156 ) on Wednesday April 04, 2018 @01:32PM (#56381903) Journal

    https://www.reddit.com/r/Writi... [reddit.com]

    (worth a short read and funny as heck)

  • Here's an idea... (Score:3, Insightful)

    by bobbied ( 2522392 ) on Wednesday April 04, 2018 @01:36PM (#56381927)

    (Just sayin..) If you don't like what the company you work for does, it might be time to find a new place to work... Just tell HR on your way out the door why you are leaving. Trust me, it will have a bigger impact than this PR campaign to shame your employer into refusing business that you don't personally like, with the added bonus that it won't run the risk of getting you branded a troublemaker or having to get fired. It's never a good idea to bite the hand that feeds you.

    • Re: (Score:2, Informative)

      by Anonymous Coward

      Quitting would be a reasonable third step, but it's pretty stupid to quit as a first step. First complain, then petition, then quit. If an employee quits first, then they're not giving management a chance to respond/react and improve the situation.

      Also, if all the people opposed to the project quit, then no one at Google will be opposed to the project and it will continue. Quitting first just gives the company a clear path to keep doing what they are doing.

      When something like this comes up it is important t

    • If you don't like what the company you work for does, it might be time to find a new place to work...

      Are you kidding? That takes effort. I'd much rather just sign a piece of paper that someone else wrote.

      • If you don't like what the company you work for does, it might be time to find a new place to work...

        Are you kidding? That takes effort. I'd much rather just sign a piece of paper that someone else wrote.

        Sure, I would too... But I'm going to insist that this paper is a good check made out to me before I sign and cash it.

        I'm certainly NOT going to create a negative PR campaign with my current employer as its target... Mainly because those pay checks would likely stop (and I do like to feed my family). ALSO if you worked for my company and did this, you'd be escorted from the premises with your personal items and the promise that your last paycheck will be in the mail and a note in your file that says you wo

        • Yeah I know, I was just being facetious. The point is I'm willing to bet that the 3100 people don't actually give a damn. Or maybe 3099 of them don't, one of them actually bothered to write it, so they care.

    • Except they won't resign. The reason they signed the letter is to take the place of them actually resigning.

      They arrogantly simultaneously believe that Google can't function without them and that only Google can do the work requested by the military, therefore if they can prevent goog or from doing the work they can save the world from more accurate bombs AND keep their six-figure paychevks, win-win!

  • by DeplorableCodeMonkey ( 4828467 ) on Wednesday April 04, 2018 @01:37PM (#56381933)

    They gave up on the whole "don't be evil" schtick a long time ago...

  • uses artificial intelligence to interpret video imagery and could be used to improve the targeting of drone strikes

    Isn't improved targeting a good thing? Like, kill the bad guys not civilians?

  • by RightwingNutjob ( 1302813 ) on Wednesday April 04, 2018 @02:12PM (#56382199)
    Don't forget why it is that you're able to have the cushy jobs and the confidence to stick your necks out like that, snowflakes. That security comes from the barrel of a gun pointed at your country's enemies. That's why we have governments and why we have militaries: to defend your rights and freedoms against people who might want to take them from you. Living in a Potemkin techno-utopia you might forget that, but it's still true even if you don't realize it. This sort of thing isn't a good look. Makes you all look like children.
    • Comment removed based on user account deletion
    • Makes you all look like children.

      You make some valid points. However, calling people "snowflakes" makes you look pretty childish yourself. Otherwise, thank you for your comments.

  • I mean really have any of the brass hats seen any of those movies/series??

    besides its never a good idea to build your replacement before you have an Exit Plan

  • If google were to stop working on all these projects for the feds, they'd be less subject to the equal employment opportunity record-keeping spotlight they are currently under.

    <tinfoil>By giving up some small federal contract, they get to keep discriminating? Genius!</tinfoil>

  • by argStyopa ( 232550 ) on Wednesday April 04, 2018 @02:26PM (#56382323) Journal

    As a conservative, I have to admit I pretty much poo-pooh'd the Left's paranoia being victimized by big data and government; TBTH I assumed it would probably end up being my side that was going to be doing any of the oppressive stuff so I was probably ok.

    But how the tables have turned: now the Leftists at Google have made me actually start to get nervous about how they're going to use my data - my searches, my friends, the things I think are important - against me "for my own good" of course.

    I watch Demolition Ranch and occasionally watch gun reviews on Youtube. Has google accumulated a "crazy ass gun fanatic" file on me, and thus decided to single me out for special watching, filtering what I'm going to get from searches or even Cambridge Analytica-style aggressive, 'therapeutic' propaganda to "correct" my clearly aberrant leanings?

    Thanks google, for making me think like the paranoid nutballs I generally mock.

  • "We believe that Google should not be in the business of war,"

    Because we have no enemies — only friends, whose grievances we've failed to address so far. Let's elect another Obama to make the entire world love us once again.

    uses artificial intelligence to interpret video imagery and could be used to improve the targeting of drone strikes

    Precise weapon is a human weapon.

  • Which nation would these fine Googlers prefer have the most advanced AI, if not the US?

  • by sTERNKERN ( 1290626 ) on Wednesday April 04, 2018 @03:46PM (#56383043)
    It used to be "Don't do evil". Now it says "Do the right thing.". People should have seen this coming from miles away.
  • I know that Russia or China getting weapons grade AI would be a disaster, and they're *not* going to be constrained by moral hand-wringing.

  • by MNNorske ( 2651341 ) on Wednesday April 04, 2018 @04:05PM (#56383165)
    I seriously feel like I'm constantly living through the adage of "those who fail to learn from history are doomed to repeat it." Most of these people who don't want the military fail to remember what happened the last time we decided we didn't need a big military and we shouldn't get entangled in other people's fights. That fight came home to us here via an attack at Pearl Harbor which we were ill prepared to defend against because we stopped preparing to fight effectively.

    My father is a US Marine, retired. One thing he told me that was instilled into him by the corps that has always stuck in my mind is "never start a fight, but if you find yourself in one be damned sure you finish it." I want the men and women who serve our country and our allies to be able to come home and the end of the day and hug their spouses and children. And, if that means that we give them the tools to do their job then I will be happy to help them get those tools.

    I would be incredibly happy if we never again had to send men and women off to fight a war. And, I really would like to see the day when no one goes off to war. But, as long as there are bad people in this world who try to hurt people, dictators, despots, petty warlords, etc... then we need a military that can protect us and sometimes goes abroad to stop the bad people over there before they can come here and hurt people.

    As for why we keep getting embroiled in wars much of it stems from a post WWII mentality developed by the US and the UK. If you've never read Churchill's writings I encourage you to. He may be a bit full of himself, but he laid out a lot of WWII and the immediate aftermath quite well and you will learn a lot of at least what he thought during the war years. But, he calls out that the US and UK looked at the war and never wanted something like it to happen again. They saw a rising threat in the old Soviet Union especially after the Soviets didn't retreat from the European countries they "liberated" during the war. And, those leaders decided the best defense was a strong offense.

    So we keep seeking out conflicts while they hopefully remain "smaller" and before they can grow into something the likes of WWII. We keep trying to contain threats and neutralize them before they can become another Pearl Harbor or a Poland. Yes, that means we fight. Yes, that means some people die. But, better fewer people while a conflict can remain relatively small than after it has grown beyond hopes of containment and impacts too many people.

    "We learn karate so that we don't have to use karate." Those are some of the first words my sensei in college ever said to my class in college. I think it's a very apt statement. We learn to fight, so that hopefully we never have to fight. Because if the other guy knows that we can and will fight back he might just not want to fight us at all. I know very few men and women in the military who want to get shot at or die. I know quite a few who want to go home to their spouses and their children and be proud of what they do and not be haunted by nightmares or suffer PTSD. Let's make sure they have the tools to do their jobs so that they can come home, and that they don't have to fight, or at least if they have to that they can limit who gets hurt.
    • by ceoyoyo ( 59147 ) on Wednesday April 04, 2018 @07:37PM (#56384289)

      Problem is, with the possible exception of Afghanistan, US foreign policy since the resolution of that Pearl Harbour thing has basically been about starting an almost continuous string of fights.

      • by thrich81 ( 1357561 ) on Wednesday April 04, 2018 @10:50PM (#56384869)

        Though the US has definitely been too cavalier about throwing its military around since WWII, I can think of two counterexamples to your statement. The Korean War in the 50's was started by an invasion of the South by N. Korea, which was a USSR client at the time.
        The 'first' Gulf War in the 90's was started by an invasion of Kuwait by Iraq.
        You can argue whether the US should have intervened in either, but the US didn't start either one and especially in the case of Korea didn't want that fight at the time given how quickly the S. Korea/US/UN forces were so quickly overwhelmed at the beginning.

      • by Uberbah ( 647458 )

        Problem is, with the possible exception of Afghanistan

        Not even Afghanistan. [theguardian.com] Taliban offered to hand over Bin Laddin if the USG presented some evidence that he was guilty of what they were accusing him of doing. But, like the successful weapons inspections going on in Iraq, this was ignored in favor an an illegal invasion.

    • That's a nice sentiment but it runs in the face of actual US actions. The US does start wars. They used 9/11 as a pretense to invade two countries. They sabotaged and deposed democratically elected governments. This last point especially makes the pearl clutching over supposed foreign interference in the last American election impossibly naive, and is a form of American myth making that both political wings refuse to deviate from.

      The reference to Pearl Harbor in particular is very illustrative. It was exact

      • Japan was already willing to make peace, as their cities had already been reduced to rubble by conventional bombing.

        The U.S. Demanded something more than "make peace", we sought, and secured, unconditional surrender of Japan - Japan wanted a time-out to re-arm.

        At the end of WW2, before their unconditional surrender, Japan resorted to arming grandmothers with pitchforks, and using pilots in suicide missions, and soldiers in the field were blowing themselves up to avoid surrendering to US forces. The Japanese were not willing to surrender, they were willing to stop being killed.

        Where was the Japanese offer of unconditional

  • So as an alternative to using our best and brightest to improve image recognition using AI, we should... what?
    Go back to 'dumb bombs' that are targeted on where we think the Bad Guys -might- be?
    Adopt the indiscriminate attacks on civilians that are so common to our "less restrained" opposition?

    If wars must be fought, and thousands of years of history say they will be, then let them be fought as cleanly and effectively as possible. It is indeed the mission of any military to kill people and break things
  • If the prospect of working for a company engaged in some activity that they find offensive, then they can leave that employer.

One man's constant is another man's variable. -- A.J. Perlis

Working...