Autonomous Drone Attacked Soldiers in Libya All on Its Own, UN Report Says (cnet.com) 177
A UN report says that a drone attacked (and possibly killed) soldiers all on its own. CNET: It's thought to be the first recorded case of an autonomous drone attack. The incident occurred in March 2020 in Libya, a country that was in the midst of a civil war. Turkey, a key combatant in the war, deployed the STM Kargu-2 drone, according to the UN Security Council's Panel of Experts on Libya report. The drone, which the report refers to as a "lethal autonomous weapon," then found and attacked Libya's Haftar Armed Forces. Logistics convoys and retreating forces were "hunted down and remotely engaged by lethal autonomous weapons systems such as the STM Kargu-2," the report reads. "The lethal autonomous weapons systems were programmed to attack targets without requiring data connectivity between the operator and the munition: in effect, a true 'fire, forget and find' capability."
Crimes against humanity (Score:3, Interesting)
Re: Crimes against humanity (Score:5, Insightful)
The UN can only do what itâ(TM)s member nations (and particularly the members of the Security Council) vote to have it do, and frankly there isnâ(TM)t a lot of good faith present amongst the voters there. Blaming the UN for inaction is like blaming your car for inaction when nobody has put gas in the tank.
Re: (Score:3)
Does getting rid of the Security Council require a vote of the Security Council?
Re: (Score:3)
The problem is always the veto power that some countries have that block the other people proposals
Also, how to impose any resolution? how many UN resolution Israel failed to comply? should UN start wars to impose resolutions?
Re: Crimes against humanity (Score:4, Insightful)
Frankly, I think reform is long overdue. IMHO, short of major changes to process and structure, there to be more members of the Security Council (both permanent and rotating) with the power of veto, and there needs to be a requirement that something in the region of 20-30% of members with a veto must use it in order to prevent a given resolution becoming binding on all parties - assuming it gets a sufficient majority to pass in the first place - to negate the usual East vs. West partisanship. You also need a way of dealing with proven non-compliance, which pretty much means some form of sanctions on arms sales/support, both for the original infringer and any countries that then don't enforce those sanctions, etc. But, of course, my first point applies - any proposed change to the status quo, clearly dysfunctional as it is, is going to get vetoed clear out of the room by pretty much all the usual suspects.
Re: Crimes against humanity (Score:3, Insightful)
"Only democracy in the middle east."
Please. Apartheid South Africa was a democracy. All the bells and whistles of a "modern" and democratic government were present. Just like Israel. You can put lipstick on that pig, but it's behaviour is still an affront to humanity.
Re: (Score:3)
Don't be stupid here. Remember the Weimar Republic was also a democracy and yet they ended up with the N@zis in charge. Democracies can indeed creates authoritarian governments, abusive governments, warmongering governments, etc. Especially if the democracy is weak or does not respect the rule of law or does not extend its rights to all citizens and residents.
Demonizing one side does not automatically make the other side into angels.
Begun, (Score:2)
this drone war has.
Re: Crimes against humanity (Score:4, Interesting)
UN was designed to be *weak* on purpose, and it might be a good thing.
They err on doing nothing, avoiding doing the wrong thing. And only act when there is global collective will to do something. If major powers disagree, nothing gets done.
Again this is by design.
Take EU for example. Regardless of how one feels about it, petty squabbles caused major rift between them and UK, and now Switzerland. Having UN *actual power* would have done the same. Countries that do not like a particular rule will just defect. In fact many opted out of "International Criminal Court" system sister of United Nations.
(Look at the "red" and "orange" on the map: https://en.wikipedia.org/wiki/... [wikipedia.org] . If you have a tyrant at the helm, you don't want to be held accountable)
Re: (Score:3)
Non-US keyboards, moron. SlashDot for some reason doesn't support Unicode.
Re: (Score:3)
Some will argue that we shouldn't be over there, but there are humanitarian and security circumstances that on occasion warrant military intervention, unfortunately (see WW2, Gulf War 1).
People often bring up World War 2 as an example of a "just war". Gulf War 1... not so much. I don't think the judgement of history has been kind.
You'll recall that the tipping point, when it came to our decision to intervene in that conflict, was testimony by a "Kuwaiti nurse" who stated that she saw Iraqi soldiers "ripping babies out of incubators". You may also recall that the so-called Kuwaiti nurse was actually 1) a member of the Kuwaiti royal family, 2) working at the behest of a PR firm hired by th
Re: (Score:2)
The rationale for war was 1) an ally was invaded, 2) the invading country was one we did not like, 3) it was _expected_ to be quick and easy and contained with no broader repercussions. Any propaganda along the way is just there to ease people's minds. This was very similar to sending troops to Grenada.
The calculus really is about when do we protect allies from invasions without getting involved in every damn war out there? If we never intervene, Kuwait would have been an Iraqi state and Grenada would hav
Re: (Score:2)
The rationale for war was 1) an ally was invaded, 2) the invading country was one we did not like, 3) it was _expected_ to be quick and easy and contained with no broader repercussions. Any propaganda along the way is just there to ease people's minds. This was very similar to sending troops to Grenada.
Your post suggests that intervention was a foregone conclusion, and that the propaganda was simply window dressing designed to "ease people's minds". I don't think that was the case at all. The decision to intervene was hotly contested in all of the coalition governments-- a majority of Democratic representatives voted against it. Six Congressman specifically stated that the testimony of the fake "Kuwaiti nurse" was pivotal in helping them vote for intervention. This was an egregious example, long befor
Re: (Score:2)
Remotely piloted drones already keep the pilot out of harm's way but still have a human decision-maker in the loop.
Pilot safety is not the issue here.
Re: Crimes against humanity (Score:4, Interesting)
No, keeping a pilot out of harms way so you can go murder someone isnt acceptable, it lowers the bar for if its worth killing someone.
if you want to go murder other people, you should damn well have to risk your people to do it.
I don't totally disagree with you, but there was an interesting perspective put from, if I remember correctly, the first US female fighter pilot. She said that the mistakes happen because of fear and time pressure. Drone pilots aren't as afraid to die so they take time to make sure that they aren't about to kill civilians. If that's true then putting people in harms way as you suggest would be counterproductive.
Re: (Score:2)
I found the article [theregister.com] for you. "One of" the first Navy fighter pilots - sorry to disappoint. Knowing that landing on carriers is an ongoing never ending psychological challenge, let alone the difficulty of the actual task, I'm guessing she's pretty tough anyway.
Re: (Score:3)
Any worse a "crime against humanity" than land mines and other unexploded munitions years after the war's over?
Re: (Score:3)
Re: (Score:3)
Both are bad options, but eventually drones run out of power, and if they can't find a base station to reload ammo and recharge, they will either land or self-destruct. Land mines can remain active pretty much indefinitely, until people bring out the rats on strings and de-mine areas, centimeter by centimeter.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
I don't think it's that clear. I don't deny the problem with landmines at all. Obviously, decades of injury and death, especially after a conflict is over, is immoral. But just because the duration is shorter, that doesn't mean there is a moral distinction. How many people can that "flying landmine" maim or kill in the time it's active? I'm assuming it could probably attack more than a couple of people? If one drone can attack 20 people at a time, does the number of people offset how immoral it is? I don't
Re: (Score:2)
Can we just agree they are both pretty bad?
Also landmines are banned.
Re: (Score:2)
oh sorry, high failure rate clusterbombs then.
Re: (Score:2)
There has been an attempt to ban land mines, mostly due to unexploded munitions left over when a conflict is over. Unluckily the big 3 haven't signed on.
https://en.wikipedia.org/wiki/... [wikipedia.org]
Re: (Score:2)
Any worse a "crime against humanity" than land mines and other unexploded munitions years after the war's over?
Yeah, probably worse. Landmines are bad, I don't mean to defend their use, but at least they're generally in a known location. You can look up what the people who have to live with drones above their heads think about them - they're always there, and you can see or hear them, and they can blow you up at any point, whether you're at your home or at a wedding.
Re: (Score:2)
There's plenty of ways to recognize military targets. Per the Geneva convention, they should be recognizable with insignia, training an AI to recognize foreign insignia is relatively straightforward these days.
Re: (Score:3)
There's plenty of ways to recognize military targets. Per the Geneva convention, they should be recognizable with insignia, training an AI to recognize foreign insignia is relatively straightforward these days.
No it isn't. Dust, mud, wear& tear, will all make the recognising of insignia by your fully autonomous drone highly unreliable. It also assumes that the enemy is too dumb to get out a rag and a bottle of solvent and remove the insignia. You could try to have the AI in your fully autonomous drone recognise the vehicles (which is what human combatants do hint he vast majority of cases) but that comes with the problem of conflicts where one side uses Russian T-55s and the other uses Chinese Type 59s or som
Re: (Score:2)
Beware of those who treat anyone who looks like a resident of the country being invaded as an enemy. Ie, anybody who moves in Syria is an enemy to someone. When you have civil wars these days there are no insignia, people don't form up into regiments and march up to well established lines of battle anymore.
Re: (Score:2)
This is a war crime according to the Geneva convention.
The US wiped its ass with the Geneva Conventions a long time ago, and nothing happened. Hell, the Nuremberg Commission executed people for far less than Shrub and his cronies did.
yes I am aware terrorists do this
So does the Israeli IDF, who also uses the Geneva Conventions as toilet paper. Of course many people do consider them terrorists . . .
Re: (Score:2)
You would have to point to specific instances where Israeli and US troops masquerade themselves as civilians. The Israeli army is one of the most humanitarian armies around, they use knock bombs and call ahead to make sure civilians are evacuating the outposts Hamas intentionally uses, in response they refuse to evacuate because it will bring them good PR.
When one side uses children and hospitals as human shields it's hard to condemn the other side for civilian casualties.
Re: (Score:3, Interesting)
Oh, jeeze, this foolishness again. The IDF has been filmed, repeatedly, using Palestinian children as shields, they bomb the hospitals, don't allow importation of lifesaving medicines, and the potable water plants and water desalination plant are taken out again every single time the Palestinians have managed to smuggle enough equipment in to fix them (since the IDF doesn't allow the equipment to be imported.) If the IDF is humanitarian then the Taliban is a social welfare group.
Re: (Score:2, Interesting)
I personally think every CIA agent in the field should be an automatic target, and all the non-uniformed Special Farces personnel. Add every weapons dealer on the planet for good measure.
Re: (Score:3)
The UN in 2018 attempted to begin working on a treaty that would ban autonomous weapons, but the move was blocked by both the US and Russia
From link in OP story.
How long before ... (Score:5, Interesting)
these things become cheap enough to be bought by $terroristOrganisation and $rogueCountry who then deploy them over $myTown ?
Definitions of who are $terroristOrganisation and $rogueCountry to be set according to personal taste.
Re: (Score:2)
Looks like that was about -5 years ago.
Re: (Score:2)
Do you mean "5 years ago"? Because "-5 years ago" seems to mean 5 years in the future...
Re:How long before ... (Score:4, Funny)
Found the bloody Perl developer! He can be the first up!
No need (Score:2)
Why would a terrorist group need to buy them? Just use their hackers to take over someone else's drones and reprogram the targets.
Re: (Score:2)
Why would a terrorist group need to buy them? Just use their hackers to take over someone else's drones and reprogram the targets.
Because being able to make your own munitions is always better than relying on buying or stealing them from somebody else.
Re:How long before ... (Score:5, Interesting)
Imagine a delivery box truck full of Boston Dynamics robot dogs that can get within a few blocks of the US Capitol and deploy them during a televised joint session. Indiscriminate killing would be horrifying while facial-recognition killing of just one party's members would be world-changing.
There's effectively no defense against something like this, and the technology clock is ticking. It's feasible today and will probably be 'easy' by 2030. I'd like to say nobody wants to see such madness but there are mad people out there.
That's not a long time to act to outlaw AI GoF, before it's too late. One would hope that politicians could at least get their shit together to save their own asses.
Re: (Score:3)
Re: (Score:2)
Why stop there? Once the super-rich have perfected the technology enough, the next step will be to get rid of the "rabble" (you, me, everyone who isn't super-rich) and then create a world similar to one of Clarke's books where the planet is inhabited by a small group of "nobles" where all the rest of the work is done by robots.
That sounds like Asimov's "The Naked Sun". An excellent book.
Re: (Score:2)
Re: (Score:2)
People complain about being exploited, soon instead they will be unprofitable. And it looks like military drones are going to be perfected before [your job] drones.
Re: (Score:2)
There's a short film about that premise: https://www.youtube.com/watch?... [youtube.com]
It's pretty disturbing how plausible a situation it is
Re: (Score:2)
Metalhead [youtube.com] is even closer [wikipedia.org] (spoilers on that second link).
Re: (Score:3)
Oh, no, it's far too late for that. Outlaw it and you'll see R&D move to the hinterlands of Paraguay or Zimbabwe. Just like human gene manipulation the tech is out there, the quality of work is rising exponentially, automation is doing an accelerating percentage of the work, and the price is in free fall. The future is coming, whether we like it or not.
Re: (Score:3)
How do the robots get inside the building? Do they bring Trump supporters with them to break in?
Re: (Score:3)
No, they hire Antifa or BLM.
https://www.reuters.com/world/... [reuters.com]
Re: (Score:2)
Re: (Score:3, Interesting)
Much like thieves, they don't become terrorists because they're smart or hard working. They become terrorists because they're lazy and stupid. More likely is that you'll see cracker groups taking them over and then providing DAAS (drone as a service) to the highest bidder. That takes a certain level of evilness on the part of the cracker groups and an even higher level of confidence that they can't be hunted down, which hasn't been reached yet.
Kill Decision (Score:2)
You want soldiers that always follow orders (Score:2)
Re: (Score:2)
So how come WE don't have a "kill switch" since it's such a great idea that no one thought of?
Re: (Score:2)
Having soldiers refuse to follow orders is a good thing. And yet military leaders often worry about that "problem".
Re: (Score:2)
Truly a great book. I don't know why they haven't made it in to a movie yet. Daniel Suarez's other books Daemon and Freedom are also quite good techno thrillers.
Hidden soldiers. (Score:3)
Autonomous Drone Attacked Soldiers in Libya All on Its Own, UN Report Says
Welcome to a future when programmers are "enemy combatants".
Re: (Score:2)
Autonomous Drone Attacked Soldiers in Libya All on Its Own, UN Report Says
Welcome to a future when programmers are "enemy combatants".
Welcome to a future where the most lethal weapon in any army's arsenal is poisoned Mars bars and Diet Coke.
Decoupling weapons control from humans (Score:4, Insightful)
And no, they don't need us to buy their stuff. Did the King need peasants to buy his stuff?
We're either going to make some fundamental changes to how power is distributed in human civilization or we're going to end up in a horrifying dystopia. Trouble is a lot of folks really, really like hierarchies. And this makes them resistant to any changes in power structures, let alone an attempt to flatten them.
Re: (Score:2)
Huh? How? (Score:2)
Re: (Score:2)
Usually three things happen to highly hierarchal societies:
1: They run out of resources, the people on the top can't get their toys, start beating those around them, and the civilization collapses. This collapse can be relatively quick, or it can take centuries, like Rome.
2: A war with another society leaves them weak enough that they implode from within, or just get overrun by a more powerful nation.
3: Something like the Black Death happens which means too few backs for the nobility to hit with the las
Re: (Score:2)
Re: (Score:2)
"And force, my friends, is violence. The supreme authority from which all other authorities are derived." -- Starship Troopers.
Yes, when some megacorp actually buys up or builds a fully automated army, they become their own authority, and can then decide the degree to which they will respect the laws imposed upon them by governments.
But, this doesn't actually change any dynamics very much. For the most part, the politicians that operate governments are all beholden to the will of the wealthy elites anyway.
Re: (Score:2)
Skin in the game (Score:2)
Autonomous drones don't have any. Whether it is a wonderful tool or a horrific weapon of oppression depends on which side of the battle you're on.
Almost inevitable, unfortunately (Score:2)
This is some scary shit.
Western democracies can be all ethical about drone warfare and AI. In the end it won't matter, because countries like Turkey, China and Russia will develop this sort of technology regardless. Unless by some miracle the world comes together and starts to seriously regulate this stuff with severe sanctions for transgressions.
Once we have the armed autonomous drones, it's not much of a stretch to have an AI system coordinating them. A few more steps in that direction and Skynet isn't a
Re: (Score:2)
Truth. It is interesting how this started, not by First World countries, but by ones that are looking to win at any cost. Ethics can be talked about, but there are countries with leadership who find ethics at best... stifling, and who will use any advantage out there, be it nuclear, biological, chemical, etc. It is actually surprising that NBC weapons have not been used in the Middle East or North Africa yet.
In theory, a country can put all its resources into armed autonomous drones, and that is the only
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Western Democracies are the only countries to have actually used WMDs in war so call me a little skeptical.
True, but it was against a batshit crazy regime with a brainwashed population who would have fought until the last man, woman and child. Some of the war crimes and atrocities committed by that regime were worse than the Nazis.
Re: (Score:2)
Re: (Score:2)
Iran/Iraq were not considered 'western democracies' by anyone, but used gas against each other. South Africa was sort of a democracy, kind of, but not 'western', when it used biological weapons against a couple of its neighbors, nor was Japan when it used bioweapons in China. For that matter the Turkish ships that catapulted dead plague victims into (Venice? Naples? I forget now) were certainly not 'western democracies' in any form.
Re: (Score:2)
Western Democracies are the only countries to have actually used WMDs in war so call me a little skeptical.
No, I'm gonna call you an ignorant moron, probably with nasi sympathies who trots around claiming that Hitler was elected.
Re: (Score:2)
Re: (Score:2)
Mechanical kamikazes (Score:2)
Inevitable (Score:2)
Maybe after a while the larger powers will start to realize that it's in their interest to ban these weapons, since smaller nations will use these to offset the military might of a larger nation. The same applied to chemical and biological weapons. We outlawed them because we knew they're almost as effective as nukes, yet much easier to attain.
Re: (Score:2)
Countries? Blackwater (whatever its name is this week) demonstrated an autonomous tracked vehicle with a chain-fed machine gun, auto-aimed by camera with human-recognition capabilities several years ago (IIRC about 2012). I think the things are already deployed for perimeter patrol at petroleum refineries in Nigeria. It still requires an operator to press the 'Fire' button, but that's a simple software edit to remove.
Turkish drones (Score:2)
These drones were reported to be Turkish. The Turkish government is an Islamist government. Expect these drones to show up on the hands of other Islamists and Islamic extremists, such as Hezbollah and Hamas.
Re: (Score:2)
Wow, the ignorance displayed on SlashDot now is truly a wonder to behold. Do you often make declarations about things which you know nothing about? Huh, just checked your posting history, it looks like you do.
Like, arrest the guy if he leaves his country, too (Score:2)
The world needs megasanctions on any nation that does this, without a human in the loop to give a final ok on targets.
War crime level.
No different than a terminal guided missle (Score:5, Interesting)
The device only has 30minutes of time. It has a listed range of 5km, that makes this pretty close to any slow moving fire and forget cruise missile. Even if all of the numbers are 4x higher, it is acting more similar to a terminal guided munition/time delayed land mine/area denial weapon. You launch it it the direction of the targets and it finds a target and eliminates. And there is just as much of a human in the loop of any of those older devices (usually none). The only real difference compared with the prior terminal guided munitions is that they generally have a lower loiter time (seconds to minutes), where as this might be in the lower hours range.
Put a tag of autonomous drone on it and everyone seems to act like it is something completely new and different than all prior weapons. It is only an increase on loiter time over the prior fire and forget terminal guided munitions.
Ladies and gentlemen - Fred Saberhagen called it (Score:2)
This thing is a Beserker [wikipedia.org].
Re: (Score:2)
This thing is a Beserker.
Not yet. It can't make more of itself.
Personally I've always thought the Berserker series depicted a vastly more frightening enemy than the Terminator franchise ever did. Berserker anime movies would be amazing. Too bad they would get confused with Berserk.
Outlawing "combined tech" won't work (Score:2)
The component capabilities are too useful not to employ separately in legal ways and the combination too militarily vital to leave on the shelf.
Law does not trump force for law requires the ability to inflict violence to compel submission.
Hackers? (Score:3)
But if hackers can take them over and reprogram the targets, that's the ultimate in asymmetric warfare. One "teenager in his basement" can take on an entire army.
Re: (Score:2)
We have gone long since past those days. I wouldn't be surprised is that the drones have no way to update firmware, and communication is limited to a one time pad, where the base station and drone keep as a shared secret and commands like "arm, disarm, back to base, patrol this area" used. Add to that physical tamper resistance, and yanking out a MacBook and causing all the enemies to self-destruct is at best Hollywood fiction. Even if communications were disrupted, the drone would keep flying until it r
Re: (Score:3)
You overestimate the ability of programmers to get things right the first time. NASA was sending firmware updates to the mars probe before it even reached mars.
Re: (Score:2)
Re: (Score:2)
Spot would be easy as well. More accurate, and never sleeps, plus better sensors.
Re: (Score:3)
Re: Perhaps the end of asymmetric warfare? (Score:2)
âoeTech 49, stand down âoe
âoeI SAID TECH 49 , STAND DOWN!!â
Re: (Score:2)
Re: (Score:2)
What is that Chinese curse? "May you live in interesting times?"
Re: (Score:2)
No, that curse was coined by Joseph Chamberlain, some English guy.
Re: (Score:2)
The next arms race is going to be drone/drone, drone/stationary target, drone/troops, and drone/artillery, as well as drone/ship.
It just might be the future of warfare is sending drones against each other, letting the drone AIs duke it out.
Re: (Score:2)
Re: (Score:3)
Not for a long time. Clinton sent some cruise missiles (fairly stupid drones) to attack al Qaeda in Afghanistan, two of them crashed in Pakistan, one of them didn't self-destruct. After copying the tech as best as they could the Pakistani ISI sold the hardware to China and the plans to an unknown number of other countries. Today at least two dozen countries can build devices equivalent to a Reaper (they were introduced in 2001, they're not considered 'high tech' any more), and easily three times that man