Elon Musk Says Tesla New Autopilot Features Would Have Prevented Recent Death (fortune.com) 160
An anonymous reader writes:Tesla Motors Chief Executive Elon Musk said on Sunday the automaker was updating its semi-autonomous driving system Autopilot with new limits on hands-off driving and other improvements that likely would have prevented a fatality in May. Musk said the update, which will be available within a week or two through an "over-the-air" software update, would rely foremost on radar to give Tesla's electric luxury cars a better sense of what is around them and when to brake. New restrictions of Autopilot 8.0 are a nod to widespread concerns that the system lulled users into a false sense of security through its "hands-off" driving capability. The updated system now will temporarily prevent drivers from using the system if they do not respond to audible warnings to take back control of the car. Musk said it was "very likely" the improved Autopilot would have prevented the death of Brown, whose car sped into the trailer of a truck crossing a highway, but he cautioned that the update "doesn't mean perfect safety."
So what was the prior feature? (Score:2, Insightful)
So he admits from his own mouth that the previous technology is a killer?
Re: (Score:1, Insightful)
Re:So what was the prior feature? (Score:5, Funny)
Re:So what was the prior feature? (Score:5, Interesting)
This is less like something like adding airbags and more like when airbags explode with shrapnel.
The former is an improvement that's seen as natural evolution of things. The second is a safety problem where a functionality is likely to do more harm than good and comes with liability issues.
Here, Tesla may be found to have been irresponsible by calling the feature 'autopilot' with a bunch of connotations in the minds of the users causing them to watch DVDs instead of driving. Additionally, 'beta testing' highly dangerous functionality is not something car companies generally get to do. When it comes to anything resembling autonomous vehicle operation, you can point at *any* other company and how extremely careful and conservative they are being. Even with similar 'lane assist' technologies that are in production vehicles, they *already* were being far more strict about monitoring driver attention than Tesla was.
So here we have Tesla being more aggressive about how 'automatic' things are, taking less measures for safety than the rest of the market offering equivalent feature today, and not being as conservative as the efforts that are what Tesla purports this technology to be.
I know there is a desire to bow down and really kiss up to Tesla, but they need to be held to the same standards as their competitors. They are not holy saviors of our society. They aren't even the only electric car company. They are certainly not the most accessible/affordable things. They have done nothing to earn having a blind eye turned to their mistakes.
Re: (Score:2)
Re: (Score:2)
This may be true, but competitors all were more strict about lane assist and more reluctant to use the term 'auto' in any way associated with the technologies. Google has avoided anything other than trained professional testers to use their system, and has publicly stated their opinion that a system that's 90% there is more dangerous than one not there at all, because user expectations are problematic.
Again, people always say how people who know anything about piloting aircraft know that autopilot is far m
Re: (Score:2)
Re: (Score:2)
You are comparing apple and oranges here.
There have been other fatal Tesla accidents that was not caused ty autopilot. And plenty of the fatal accidents in average car were not caused by bad driving (i.e., you cannot assume that autopilot would have prevented them).
Re: (Score:2)
Also, the 'all inclusive' number includes all ages and variety of vehicles. Tall SUVs, 15 year old cars with fewer safety features. Cars with much older pieces and different levels of maintenance.
It would be interesting to compare Tesla autopilot specifically to good-condition highway miles driven of 2014+ model year vehicles with forward collision alert type systems. That would be a more fair comparison.
Re: (Score:2)
Re: (Score:2)
Current cars allow you to take your hands off the wheels for way longer than a minute. You may not live that long depending on the road you're driving but it's an option.
I fail to see how it's somehow required that an assist feature also make you do something a car without the assist feature doesn't make you do.
Re: (Score:2)
How long till someone comes up with a fake 'hand' that tricks the system into believing you maintain control of the car?
Re: (Score:2)
A soda can worked for some mercedes S class. However that is a lot more blatantly obvious that a user is doing unreasonable stuff to bypass safety mechanisms, so vendor can reasonably be considered less responsible if the user is having to get so 'imaginitive' to be jackasses.
Re: (Score:2)
Re: (Score:2)
Simple. In the unaided case, it's unbelievably obvious what will happen immediately. There's no perception that the car will save you. Driver's ed required pretty well covers what will happen if you aren't paying attention.
The problem is the assist technologies can let you get away with it for extended periods of time, the majority of the time. So car has to nag the user to remind them that it is *not* safe to remove human attention as well. It's mitigating risk and doing a deceptively good job at it w
Re: (Score:2)
And for the most part (that part where the car seems to be doing okay) maybe it doesn't matter if a
Re: (Score:2)
Such as the sky-high moral standards of GM https://en.wikipedia.org/wiki/General_Motors_ignition_switch_recalls/ [wikipedia.org]?
Re: (Score:3)
GM was crucified in the media for that. No one took GM's side on that. That is how reaction *should* be.
With Tesla, tons of folks are white knighting for a luxury car brand. It's insane.
Re: (Score:2)
The most irresponsible thing was ignoring the vast amount of research into human attention spans. People simply can't concentrate on doing nothing for hours on end, ready to take over control of the vehicle at a moment's notice.
People will get complacent, take a nap, watch a DVD or just zone out. It's human nature. NASA even warned them about it.
Re: (Score:2)
It is the average user understanding that must be kept in mind when doing branding/naming exercises like calling something 'autopilot', unless you have a very thorough licensing process that explicitly covers what autopilot is or is not.
Here it's a marketing gimmick to sound cool. There are repurcussions.
Also, Musk was still saying 'hey it's still safer than driving yourself', which again reinforces the common imagined image of autopilot.
Re: (Score:2)
The users are required to confirm that they read about it before they can use it, apparently. It explains precisely what it is and isn't, in no uncertain terms. It doesn't stop people misusing it, but blaming the tool seems a bit bizarre.
Re: (Score:2)
A click through EULA. I'm sure that was thoroughly reviewed and taken seriously.
The wider industry has several exmaples of being more careful. Tesla is *now* being more careful, like their competition, which is a good thing. I don't know what it buys to continue to defend their previous behavior, which they themselves have realized was wrong.
Re: (Score:2)
but it won't stop you from plowing into another plane or a mountain.
Actually, yes it will. automatic collision avoidance systems (both ground and airborne) lare quite common in aircraft these days.
No, it is quite rare, as it is on one model of airplane. Also, it is a backup, the pilot is supposed to do the navigation/altitude changes, but it will do the changes when the pilot doesn't respond.
Re: (Score:1)
Re: (Score:1)
Re: (Score:3)
Re: (Score:2)
Re: (Score:1)
Re: (Score:2)
Re: (Score:1)
Re: (Score:2)
OK, let's use boats as an example. For non commercial use, any old idiot can drive a boat. And many do. Boats have autopilots. They're quite common these days and actually have more routing options than a Tesla AP. I can program my boat to autonomously steer its way until the tanks run dry. Of course, that is a remarkably stupid thing to do but it happens.
And AP equipped boats crash all of the time. So far there hasn't been a giant wave of insurance companies insisting that we ditch the things (nice
Re: (Score:2)
I used to sail on rented sloops about 36' long fairly frequently, around Wisconsin's Apostle Islands. On one trip, we had a blind guy take the helm for a while, and also a seriously developmentally disabled woman with sensory problems. Neither of them were ever going to be able to drive a car.
Just emphasizing your "any old idiot".
Re: (Score:2)
so with an auto drive car what happens when the (Score:2, Offtopic)
so with an auto drive car what happens when the software is at fault with the payouts?
Re: (Score:2, Informative)
No, all he said is that he expects that the new software will keep a few more Darwin award candidates in the gene pool. There still is such a thing as personal responsibility. Even in the USA.
Re: (Score:1)
They most definitely do not. Just ask any vegetable or the cattle!
Re: (Score:2)
Sure. That doesn't mean we should do everything possible to extend every single life. People who do dumb things in potentially dangerous situations are going to die at a higher rate than people who don't, and there's really nothing we can do about that.
Re: (Score:2)
Re: (Score:2)
Autonomy has not ended any lives. The auto-feature didn't make someone take their hands and eyes off the wheel and road. I can take my hands and eyes off the road right now in my car (without any lane assist) and it'd be nobody's fault but mine.
Re: (Score:2)
Re: (Score:2)
You fail at history. Civilization has always had a few gladiator sports.
Re:So what was the prior feature? (Score:5, Insightful)
So he admits from his own mouth that the previous technology is a killer?
That's faulty logic. If a hospital upgrades to some just-released equipment and is able to save more people as a result, that doesn't mean that they killed the people who could have been saved by that equipment, had it been available earlier. The state of the art is constantly getting better. Admitting that the newer stuff is more safe than the older stuff doesn't mean that the older stuff was killing people. Quite the contrary, since in many cases that older stuff saved a number of lives that would have been lost had people relied on the alternatives that were otherwise available at the time. Saying that the newer stuff is even more safe just means that we have something even better now.
Of course, I say all of this to point out the fault in your logic, not to suggest that I think Autopilot is ready for primetime already. Because it's not.
Re: (Score:2)
It's easy enough if is an improvement across the board like our new vaccine is more effective with no new side effects. Statistically though, often your new way will end up killing different people which makes it hard to swallow at an individual level. For example, say you have an injury with 5% chance of dying without surgery but you're in a dirty field hospital with a 2% chance that infections and there's very little correlation between one and the other. Are your relatives going to happy that you got a t
Re: (Score:3)
Your statement is not backed up by data. Fatal Tesla crashes make the news far more readily than any other vehicle which leads you to falsely conclude that they are less safe than other vehicles, a fact not born out by data. Nearly 100 people die every day driving on US roads.
Further, multiple drivers have falsely claimed that they had Autopilot engaged during a crash. But due to our rapid news cycle people are far more likely to read the first article that says Autopilot caused a crash and skip over the
Re: (Score:2)
You don't need Tesla Autopilot to live (drive the car) compared to an dialysis machine.
If you are going to die unless technology intervenes, then, yes, the technology is needed for your survival. Period. It makes no difference when or even if you recognize your need. The need exists, regardless of your perception. A Tesla driver suffering from Imminent Fatal Crash Syndrome who could have been saved by Autopilot needs Autopilot in exactly the same way that a patient suffering from kidney failure who could have been saved by dialysis treatment needs dialysis treatment.
The reason your statement
Upgrades! (Score:1)
...better than educating generation after generation of human driver and relying on them to have their faculties intact every time they're behind the wheel.
"the system will temporarily shut off" (Score:5, Insightful)
What does that mean? Will the vehicle quickly slow to a stop? Will it veer off a cliff or into a building or "let go of the wheel" and start swerving to scare the driver into grabbing hold? The statement doesn't make much sense.
Re: (Score:2)
Re: (Score:2)
Well, the thing should at least scream over the speakers, *Hey dumbass! You're all gonna die if you don't grab the wheel and hit the brakes!* to get the guy's attention. A little flashing light and chime won't cut it. More than one airliner has crashed because the pilot didn't know the autopilot disengaged [wikipedia.org].
Re: (Score:1)
And not just in English, but in Mandarin too!
Re: (Score:2)
Then you get people sueing because the alarm was to disruptive and scared them into a wreck....
The only way to win this battle is to literally sign a waiver for some new class of driver's license. Basically stating you understand and are aware of all the risks and best handling practices when owning/operating a car with an autopilot system.
Re: (Score:2)
To prevent that, you first broadcast a 'trigger word' warning.
(over the car speakers, in a very calm voice) "Hey, bro...I'm about to yell at you quite loudly, because there is a very scary moment coming up, and I don't know how to handle it. We'll need you to go ahead and take the wh..." (crunch)
Re: (Score:1)
Not too comforting to the station wagon full of nuns in the next lane over. The problem with things like this, it has to be all or nothing. Either it works or it doesn't. On the other hand auto parking isn't such a bad idea. At least that could get you within walking distance to the curb without playing bumper cars.
Re: (Score:2)
Not any better than a drivers license either though, anyone can steal a pair of keys and just drive a car today without any knowledge of how to drive. The point was the driver would be liable and not the auto-pilot, or at least the norm would be assume driver error should they actually be using the feature during a wreck.
I guess to me this isn't any different from someone trying to use cruise control, you should still be ready to use the pedal at all times no matter what.
Re: (Score:1)
I prefer the computer should say "Take the wheel or I swear I'll drive this car into a tree!" And or "Don't make me pull this car over!" and "Don't make me come back there!"
Add in an occasional dad joke (like any time some one says "I'm Hungry" replying with "Hi Hun Gry, can I just call you Hun?" and provide answers to the question of "are we there yet?" such as "we'll get there when we get there and not a minute sooner!" and you've got the perfect auto pilot we all recall from childhood family road trips.
Re: (Score:2)
"Terrain, Terrain, Terrain. Pull Up. Terrain. Terrain. Terrain. Pull Up."
That's what planes do.
No sense getting personal.
Re: (Score:1)
What does that mean? [...] The statement doesn't make much sense.
It makes sense to anyone who actually cares about this issue, as defined by "has been following it closely enough to know about it." To someone like you, who is only here to talk shit and doesn't know any of the particulars of the issue, it might not make sense. But to everyone else, who knows that the system already shuts itself off (with a warning) if drivers have their hands off the wheel for too long, this is not a shocking or confusing piece of news.
Maybe you should go back to the beginning, and read u
Re: (Score:1)
Well! Happy Monday to you too! Why are you being such a dick? Haven't had your coffee or beat the wife and kid yet? Where's your priorities? First things first, man!
Re: (Score:2)
Is it a safety briefing or a EULA?
Re: (Score:2)
I'm guessing it gives the warning, and if you don't take heed, it won't work the next time you try to engage it (but will continue to work until you do retake control this time).
So you'll just need to find a convenient roundabout so you can dive out and leave the car running until you're ready to hop back in again the next day.
Re: (Score:2)
"I'm sorry Dave, I can't do that."
That would be so cool.
My Dad's Subaru (Score:2)
has an almost-self-driving capability when the lane departure assist is activated. But when driving on the freeway in heavy snow last winter, as soon as the optical system couldn't see the road because of the snow building up, all the automation shut down. Wth lots of visual and auditory warnings to let me know it was shutting down.
I imagine this is the same sort of thing. Auditory and visual warnings to let the driver know the system is switching to fully manual operation.
Re: (Score:2)
What does that mean?
Same thing it means now. Slowly bring the car to a stop. This facility already is in place.
Elon Musk (Score:1)
I was getting worried there for awhile when I hadn't seen an Elon Musk story for like 9 hours. I was beginning to fear the worst, but I think I'm OK now.
Phew!
Sigh. (Score:1)
According to the BBC article:
http://www.bbc.co.uk/news/tech... [bbc.co.uk]
"Overhead signs or bridges can also be misinterpreted if the road dips. To combat this, Tesla cars are going to be used to âoelearnâ about the road. Initially, the vehicle fleet will take no action except to note the position of road signs, bridges and other stationary objects, mapping the world according to radar,â Mr Musk wrote.
"The car computer will then silently compare when it would have braked to the driver action and upload
Re: (Score:1)
They're not whitelisting any/all objects in a particular location.
They are whitelisting a specific radar signature in a specific location.
Re: (Score:2)
So now you can have gps accuracy issues and DB update issues that can lead to a big mess.
Re: (Score:2)
I'd suggest not flying, taking a modern boat or even a bus if you're worried about stuff like this.
Just walk along side of the freeway - you'll be fine.
SubjectsInCommentsAreStupidCauseTheSubjectIsTFA (Score:2)
Elon Shrugged (Score:2)
What would the world do without him? Now he's claiming his rocket blew the fuck up because it was hit by a UFO.
I assume the release notes (Score:1)
Frank, but ambulance chasers will rejoice! (Score:2)
Doesn't sound very safe to me (Score:2)
So yeah, maybe the new software makes the car better at not crashing into trucks. It sure as hell isn't better than if the car AND the driver were both attentive to the road. Humans are excell
Re: (Score:2)
Re: (Score:2)
Where do you find a car weighing 1000 kg nowadays? A Mini was 600-700 kg in 1960. A VW bug was under 1000 kg. Today a Mini is 1200-1400 kg, a VW Golf is 1300-1400 kg, a Prius is 1400 kg, a Tesla S is 2000-2200 kg, a Ford Explorer is 2000-2200 kg, a Fiat 500 is 1100 kg, and a Yaris is 1100 kg
Cars nowadays, even tiny ones, are bricks.
Re: (Score:2)
Goofy (Score:3)
Re: (Score:2)
Re: (Score:2)
However that doesn't fly in other fields. You can't just say "shit well they died so lets try again with version 2.1 beta and see if it kills fewer people." Well actually I guess you CAN say that.
That's exactly how it goes, and there's no other option. You could do nothing, and guess what the death rate wouldn't change. Or you could do something which directly addresses the root cause of the problem, and see if the death rate decreases. In all the cases I know of - checklists for pilots, drug dosage level changes, etc. -- by the time the new protocol is released for use on humans it's pretty much guaranteed not to make things worse.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
In that case, you have never tested enough. Nobody will ever think of all the possible things to test in any real-world scenario. If you listed all the possible situations with a trailer, there's a good chance I could look through it and find something you'd missed.
Revenge of the Developer (Score:2)
Next week: "If only they'd stayed on HEAD, we wouldn't be having these problems. Also, your kernel is old and you're not running the latest version of systemd. Why don't you just hook into our Jenkins server at http://carautopilot.github.io/ [github.io] so you can get the latest nightly before you head out on the road each morning?"
I won't trust a Telsa autopilot for a long time. (Score:3)
Re: (Score:2)
You would think that the FIRST thing you do with an autopilot program is to make sure it can see properly in front of the vehicle.
Define see. You're assuming that the human would have made a better decision. Given how many accidents happen on a daily basis with humans in control I don't think this is a conclusion you can make. But there's one amazing thing here: Iteration.
A human has an accident you can't prevent it from happening again. If you run a red light and t-bone someone else the entire world can't learn from it. Yet here we have a case where in the future this accident won't likely happen. I will happily tolerate many deaths
Re: (Score:2)
You're assuming that the human would have made a better decision.
I think most humans would have NOT kept driving at full speed into a giant tractor trailer. But that's just a guess.
Now, don't think that I am against self driving cars. My post specifically mentioned Tesla's autopilot. In the long term, I think self driving cars will prevent many, many more deaths than they might cause. My issue is that the very first thing any self driving car should be able to do is know if something is blocking it's path. Literally the first thing it should 'learn' to do. Given t
Re: (Score:2)
I think most humans would have NOT kept driving at full speed into a giant tractor trailer. But that's just a guess.
And yet it happens on a daily basis without something as stupid as the trailer being the same colour as the sky.
Really? Why would you think that?
Re-read my post.
If my computer calculates 1+1=5 and I figure out why and correct it to 1+1=2 then the problem is resolved. That doesn't mean 2+2 won't =5 in the future, but the 1+1 situation has been corrected.
Now compare that to a human. It's hard enough teaching one person something, it's not possible to correct it for everyone.
Thanks for offering to Beta Test the Tesla autopilot system
If I had a Tesla you bet your arse I would be using the autopilot sy
Re: (Score:2)
Re:Let's talk about the name! (Score:4, Informative)
Re: (Score:2)
That's a mighty big assumption.
That and you're not factoring in that Tesla's system in an opt-in beta feature with a big disclaimer you must agree to. Changing one word in the description of the feature isn't going to negate all those hurdles to just get it turned on...
Re: (Score:3)
with a big disclaimer you must agree to.
You're a moron if you think people read those.
Re: (Score:2)
Note that people treat 'assist' as 'auto' as well. However no doubt Tesla exacerbates the issue by calling it that.
A bigger thing is that in addition to calling it 'lane assist', competitors *also* more aggressively monitored user attention.
For example, Mercedes drivers taped a can to trick the sensor:
http://www.roadandtrack.com/ca... [roadandtrack.com]
Though in that case, I think anyone can argue that a person getting killed doing that was *really* going out of their way to act against the designer's intent for the vehicle.
Re: (Score:2)
I'm saying that, in the Mercedes article, people are still going to be jackasses and tape soda cans to the steering wheel. It's still going to happen.
However, in the Mercedes case they call it assisst and require folks to fool the sensors to be unsafe, so that's a bit excusable.
Mercedes even had to pull an ad that indirectly implied that maybe, possibly the lane assist feature was in the same ballpark of an autonomous car.
So Tesla bad: using autopilot and not being strict about user attentiveness, Mercedes
Re: (Score:2)
*NOTE: Hands-Free Driving System requires hands to be holding the steering wheel at all times.
Re: (Score:2)
Obviously just a typo... they clearly meant "Otto Pilot". [youtube.com]
Re: (Score:2)
"Cue the endless discussion on the "Autopilot" name, rather than any discussions of the technical merits of the system or its implementation."
The user interface, the presentation to the user, including how it is described by its name, is a big part of the implementation.
Re: (Score:2)
- Kid running out into road 20' in front of car
- Kid running out into road 10' in front of car
- Kid running out into road 5' in front of car
- Person dropping rock off bridge at same increments
- Sandbag in road on bend
- Sandbag in road on straightaway
- Large obstacle overhanging left six feet of road (on straightaway / on bend)
- Large obstacle overhanging left ten feet of road (on straightaway / on bend)
- Sh
Re: (Score:2)
If engineers were able to think of all this stuff then they would design the car to handle it in the first place.
We've got you covered [wikipedia.org].
Re: (Score:2)