Forgot your password?
typodupeerror
Transportation

Waymo CEO Explains Why Camera-Only Self-Driving Falls Short (electrek.co) 215

Longtime Slashdot reader AmiMoJo shares a report from Electrek: Waymo co-CEO Dmitri Dolgov laid out the clearest technical case yet for why cameras alone can't take a self-driving system to full autonomy, arguing that "weak sensing" hits a safety ceiling long before it reaches superhuman performance. [...] Dolgov made the comments in a talk at Y Combinator's Startup School, walking through the lessons Waymo has learned building its driver over close to two decades. He put the sensor question on the table plainly: "there's been a long-standing debate about what kind of sensors do you actually need for autonomous driving."

His answer draws the line that camera-only advocates tend to skip right past. "Humans of course can drive with just eyes, so there's that proof of existence," he said. "If the goal were to just approximately match human performance or to build an assist product, that's a very reasonable way to go." Then the catch. If you're targeting full autonomy and strongly superhuman performance, he said, "you find that weak sensing just leads to a safety curve that flattens out way too early."
Dolgov said that cameras, lidar, and radar are complementary rather than redundant: "These different sensing modalities, they're not backups to each other," and combining them produces a view "vastly superior to what you get with any one sensor." He said multiple sensor types also protect against physical failures, such as a leaf or branch blocking a camera, while helping Waymo climb the "exponential ladder of nines" required for fully driverless safety.

Dolgov warned that camera-only systems may improve quickly before plateauing "way before the performance that is required by your product." He also pushed back on the cost argument against lidar, calling it "a number that has a fairly short shelf life" as hardware costs continue to fall.

Waymo CEO Explains Why Camera-Only Self-Driving Falls Short

Comments Filter:
  • "Dolgov warned that camera-only systems may improve quickly before plateauing "way before the performance that is required by your product." It's almost as if he's been studying the history of your self driving claims.
  • by memory_register ( 6248354 ) on Wednesday August 05, 2026 @07:10PM (#66274578)

    Snow, rain, fog, changes in roads, construction, flooding. There are hundreds of novel situations Waymo fails at. It is easy to trash your competitors but far harder to deliver true driverless cars.

      And before the Waymo gooners show up to defend them, lets just get this out of the way: Waymo has millions of short trips, but all of their miles combined are just rounding error on the number of trips that happen in a single day in the United States. The plain fact is that they are largely unproven from a statistical perspective, especially on highway and novel situation driving

    • by geekmux ( 1040042 ) on Wednesday August 05, 2026 @07:24PM (#66274598)

      Snow, rain, fog, changes in roads, construction, flooding. There are hundreds of novel situations Waymo fails at. It is easy to trash your competitors but far harder to deliver true driverless cars.

      And before the Waymo gooners show up to defend them, lets just get this out of the way: Waymo has millions of short trips, but all of their miles combined are just rounding error on the number of trips that happen in a single day in the United States. The plain fact is that they are largely unproven from a statistical perspective, especially on highway and novel situation driving

      You're concerned about if it's actually capable of delivering meatsacks safely to a destination.

      You should be FAR more concerned with the finger-pointing corruption that will ensure anyone killed by a murderous autonomous car, will NEVER be able to face the actual entity responsible. Because 37 legal entities exist between the gas pedal and the steering wheel.

      By Fuck-You design.

    • Re: (Score:2, Insightful)

      by Anonymous Coward

      Snow, rain, fog, changes in roads, construction, flooding. There are hundreds of novel situations Waymo fails at.

      You're addressing a claim that wasn't made just so you can ignore the claim that was made.

    • by abulafia ( 7826 )
      I completely agree. Waymo has a lot of work to do.

      And it isn't just passenger safety - those things are a menace during civil emergencies. There needs to be both a lot of work put in to contextually proper response to exceptional circumstances - from what should be easy stuff like "don't block fire trucks or drive over fire hoses [sfstandard.com]" on through figuring out how to safely get out of the way when power goes out [sfstandard.com]. For reference, right now we're at the point where they still confuse themselves [ktvu.com].

      Of course if you

      • The DARPA demonstrations made too many people too sure that multiple cameras and AI would make self-drivers cars simple to pull off. Then they followed up with tests where it's warm and dry and the weather doesn't get weird. They wanted to get investment in before things started getting interesting. What they've got now is a technology that has slowed down and needs to learn more about what to do when there's a road crew digging holes in front of them. It's going to be much more of an adventure then the opt

    • by gweihir ( 88907 )

      So? Lidar plus camera fails a lot less than camera alone. I have no idea why you event try to do FUD here.

    • Snow, rain, fog, changes in roads, construction, flooding. There are hundreds of novel situations Waymo fails at. It is easy to trash your competitors but far harder to deliver true driverless cars.

      Holy poster missing the point batman! Capabilities of a company's current product have zero to do with discussion of the capabilities of the underlying platform. What Waymo currently does or doesn't do it irrelevant. The fact of the matter is LiDAR + Camera is better than Camera alone. We're talking about a regulatory control system not a USA presidential election. The quality and quantity of information matters. And it is very much possible to trash your competitors for choosing a fundamentally less capabl

    • by AmiMoJo ( 196126 )

      Those are not limitations of lidar. For example, snow and heavy rain are just extra noise, and we are pretty good at filtering noise.

      Where they have issues is not knowing how to deal with or recognize certain obstacles, but even there lidar and radar have proven how valuable they are. As TFA notes, lidar can see solid objects with certainty, and radar can measure their speed. Tesla has a well known problem where it will drive straight into stationary objects at full speed (disengaging a few milliseconds bef

    • by brunes69 ( 86786 )

      Two problems with your statements

      First problem: Waymos have been driving on highways for a long time.

      Second, is you are looking at the data totally wrong. To be better than human drivers, all any *individual* Waymo driver has to have is more miles than *the average individual driver* - and that number is already passed by tens-of-thousands.

      The "number of trips that happen in a single day" is not relevant whatsoever as a safety metric.

  • by memory_register ( 6248354 ) on Wednesday August 05, 2026 @07:13PM (#66274582)

    AI is proving to be a useful augment to skilled humans, but not a replacement. We were promised a robot and instead have invented a robotic arm. I think LiDAR based driving is headed in the same direction.
     
    The systems they have invented are a great augment to human judgment, but not a replacement for it. I would love to buy a car equipped with Waymoâs lane and collision detection, but I would certainly not trust a Waymo in most cases and especially in serious weather.

    • by thegarbz ( 1787294 ) on Thursday August 06, 2026 @03:26AM (#66274838)

      but I would certainly not trust a Waymo in most cases and especially in serious weather.

      Give me a system that stops driving in bad conditions over a human judgement that thinks the increased risk is acceptable any day. If getting to your destination despite everything is your concern, Waymo's system isn't for you. If your own safety is your concern, you'd take Waymo's system even in serious weather. Your risk of dying in bad weather increases by around 35% depending on which study you look at. Waymo's record is currently 0 deaths.

    • And that's the thing --- if it's just augmenting a human driver, it means that now, instead of driving, you're supervising. And that's a much more difficult thing to devote continuous, full, unwavering attention to (still required) than it is to devote that attention to something you're actually doing yourself.

      I have yet to feel safer in a car that argues with me than I do in a car that just lets me drive. And until it can take over *fully* from me (which it may never), I would rather it not express opini

  • by deepthought90 ( 937992 ) on Wednesday August 05, 2026 @09:00PM (#66274682)
    First, humans use other senses like hearing. Second, humans use reasoning. Humans are better at making inferences to fill in missing information. Humans also use world models to help make decisions. Not a whole lot of AI approaches do this. However, the machines will ultimately win. Human performance sucks. It isn't hard to beat it. We already see this in aviation where the standards and expectations for machines are much higher for political reasons even though the autopilot is the better pilot in the cockpit
    • Humans have already lost. Both Waymo and Tesla FSD have better "accident per mile" numbers than humans. By a lot, it's not margin of error it's not driving locales. They have mimicked human reasoning for nearly all relevant situations aside from highly contrived scenarios you may dream up but never see in real life. It even understands construction worker gestures and signs.

      https://www.youtube.com/shorts... [youtube.com]

    • First, humans use other senses like hearing.

      Hearing is a sense that is rarely used while driving. It's also the most commonly obscured sense (with cars putting serious effort into obscuring external noise, and drivers almost universally playing music or conversations while on the road).

      There are places where this doesn't apply. Drive in India some time and you'll find there hearing plays an important role, but it's also a place where a horn is used more often than an indicator precisely because people there use hearing when driving. That doesn't appl

  • by crow ( 16139 ) on Wednesday August 05, 2026 @09:19PM (#66274688) Homepage Journal

    I think the Rivian approach is the best. They're basically copying the Tesla model of having their fleet send the sensor recordings back and then using them as training data. While they're far behind right now, they'll catch up quickly, as they can copy a lot of the basic technology that's now established instead of having to invent everything from scratch and make wrong decisions along the way. The difference is Rivian is including lidar, so they just include the matched video and lidar recordings as a larger training data set. I'm convinced that if the price of lidar was more like it is today back when Tesla started selling FSD in 2016, then that's exactly what Tesla would have done, but Tesla is now stuck with their solution with ten million cars already on the road.

    But in clear weather conditions, I don't think lidar really helps that much. Most human accidents would be avoided if drivers had better situational awareness and didn't have gaps in paying attention, and the cameras solve that.

  • ...years ago
    I strongly agreed that lidar and radar would be necessary in addition to cameras. The projects I worked on used them.
    My concerns with cameras were dirty lenses and limited dynamic range.
    It's interesting that Tesla seems to be making a camera only approach work well.
    I continue to follow developments, but will admit that I was wrong is the evidence shows it.

  • by rsilvergun ( 571051 ) on Wednesday August 05, 2026 @09:47PM (#66274708)
    Again he already admitted to Congress that when they need the vehicles to do anything more complicated than basic Lane assist driving it's a call center in the Philippines doing the actual driving. I think there is also a center in United States but they weren't clear on when or if it's gets used.

    You can look it up on google. It's amazing how different their tune gets when they are under oath to Congress...

    This isn't the future this is just more outsourcing and you're going to be on the road with remote control cars pilot it from another country so that they can pay taxi cab drivers even less than they pay them now. And over time it will become increasingly unsafe because they will start using layers of contractors and they won't follow driving laws the way the current batch does because they won't be sitting on limitless amounts of investor cash hoping to reduce wages even more than what Uber pays which is already sub minimum wage

    In the dystopian cyberpunk books they never really get this deep into all the nasty little pieces of dystopia that affect daily life it's usually the big cool stuff of course. I'm not enjoying learning about the banal aspects of a techno-feudal corporatocracy
    • Again he already admitted to Congress that when they need the vehicles to do anything more complicated than basic Lane assist driving it's a call center in the Philippines doing the actual driving.

      And he repeats his lie again. No they didn't say this to congress. They specifically mentioned what the Philippine's centre does and doesn't do, but you are paid to ignore that.

      You must be paid.

      You've been corrected on this post so many times that even the dumbest amoeba at this point would have seen the error they made. The only remaining conclusion is that someone is paying you to spread bullshit. Despicable human you are.

    • by AmiMoJo ( 196126 )

      Are you talking about Waymo? That's not true at all. Their cars do drive themselves most of the time. They have the ability to call a human when they get into a situation they don't know how to handle, but even then the human doesn't do the driving, it only tells the computer if its plan is acceptable or if it should do something else.

      In particular, all the safety stuff is done on the car.

  • I think debating which is better is moot.

    Just build your car your way, Tesla will build theirs their way. And the results will show in the end. Clearly Tesla's option will be cheaper that could turn out to be an advantage, and Waymo's can "see" in more wavelengths which in theory could be an advantage, but the proof is in the putting. Maybe sensing isn't the defining factor in safety, maybe it is.

    We'll see. Good that several companies have several approaches.

    • But the results don't show in the end. They are trying to game the system by only having their cars drive when it is safe and comparing it to a human driver all the time. You can do a billion miles on roads that are paved and dry and be safe, but that means nothing if it snows.
  • Waymo’s case against camera-only autonomy is a polished, self-serving argument that overstates sensing limits while underplaying the real bottlenecks in full self-driving. Any human being with two eyes and a brain can understand this.
  • His guided cars have hit more things and screwed up traffic more than any other. What we need is a set of national Car2Car standards so these megalomaniac douche bags CEOs don't get to decide what is good enough. If done right, the only thing getting hit is the Darwin winners who J-walk.

  • ...project ARGO [unipr.it] in 1998 was about a self driving car equipped with just two camera and a 200 MHz MMX PC. Too bad that the project was left unfunded after its remarkable achievments.

  • I have a very old car, but I recently drove a new rental. Radar has two huge benefits for me. First, I'm bad at checking my blind spots. On a self driving car it could fill in for camera glitches. Second, radar can detect when the car I'm following slows down faster than I can see that the car's getting closer. Especially if it's doppler radar. A self driving system deserves the same info.

  • It's not that people necessarily want self driving cars to be better than a human. It would be fine if they messed up like a human because we are all used to driving with all human drivers. The problem is that they don't mess up like a human so they are difficult to anticipate and that alone makes it worse even if the accident rate is the same. Also if one car is doing it then they will all do it, so now you have that unpredictable nature multiplied by the number of cars on the road. Whereas one drunk o
  • Most if not all accidents are due to not adhering to the rules of the road. Running stop signs, Running red lights, Failing to yield right of way, Changing lanes into other vehicles, Excessive speed for conditions snow rain, Falling asleep, Slow reaction times due to drugs or alcohol. Its not that humans cannot gage distance and speed accurately enough which is the only real benefit of LIDAR. Relying on super detailed maps is a limitation not a superpower because the world changes. Having multiple cameras
  • by daninaustin ( 985354 ) on Thursday August 06, 2026 @04:10PM (#66276344)
    Waymo is about to be cooked by Tesla due to the massive differences in cost to provide the service, and Waymo does not have a path to reduce their costs enough to be competitive. Tesla has 13 billion miles of fsd, and is adding another billion/month. The only hope that Waymo had was that Tesla FSD driving would fail, but that does not appear to be the case (recent events make it apparent that Waymo isn't improving very fast, if at all.) FSD isn't' perfect, but it's better than most humans and improving. Waymo has a year or so before Google throws in the towel, like they have done for so many other projects.

If you push the "extra ice" button on the soft drink vending machine, you won't get any ice. If you push the "no ice" button, you'll get ice, but no cup.

Working...