Waymo Unveils New Model to Benchmark Robotaxis vs. Humans

Cover image from theverge.com, which was analyzed for this article
Waymo released new performance metrics comparing its autonomous vehicles to human drivers. The effort aims to build public trust in self-driving technology.
PoliticalOS
Wednesday, June 10, 2026 — Tech
Waymo has released code for a new human-driving benchmark intended to strengthen safety comparisons, yet the precise publication venue cited by both outlets could not be confirmed. Readers should treat the model's readiness for regulatory use as an open question pending independent testing.
What outlets missed
Neither outlet examined whether the active inference parameters were calibrated against real-world near-miss datasets beyond Waymo's own fleet. The open-source license terms, which restrict commercial use, received little scrutiny regarding who can actually audit or extend the model. The Santa Monica investigation status was mentioned but not connected to how the new benchmark might alter the company's prior human-driver comparison in that specific case.
Waymo Rolls Out New Virtual Benchmark to Rate Its Robotaxis
Waymo announced this week a fresh computer model it says will serve as a better yardstick for judging how its driverless cars stack up against ordinary human drivers. The Alphabet subsidiary worked with researchers at TU Delft in the Netherlands to build what it calls a Reference Driver, or ReD, based on the theory that people constantly imagine possible futures and pick the safest path forward. The company published details in Nature Communications and described the work as an evolution of the old crash dummy concept, now turned into a behavioral standard for avoiding collisions.
The timing stands out. Waymo has been expanding its robotaxi service into new cities while regulators and city officials face mounting complaints about erratic maneuvers, blocked traffic, and at least one incident in January when one of its vehicles struck a child near a school in Santa Monica. Rather than wait for outside reviewers to settle safety arguments, Waymo built its own reference point inside the company and now presents it as the measure the rest of the industry should adopt.
The model uses something called active inference, a framework that tries to mimic how a careful driver weighs risk in real time. Waymo claims this produces more realistic expectations than earlier statistical approaches. Company safety chief Mauricio Peña said the goal is a shared, scientifically grounded way to evaluate how well autonomous systems dodge trouble. Yet the benchmark remains internal, created by the same firm that operates the vehicles and stands to gain from regulatory approval to scale.
Skeptics note that Alphabet has long used academic papers and partnerships to shape the conversation around its products. Publishing in a respected journal gives the appearance of neutral inquiry, but the underlying data and assumptions still flow from Waymo’s own fleet logs and simulation environments. That setup lets the company define what counts as competent human behavior before comparing its software against it. If the model tilts toward smoother, more predictable responses, it could make Waymo’s cars look better on paper even when riders and other drivers report near misses on actual streets.
The larger issue is whether any simulated driver can capture the messy judgment calls people make every day behind the wheel. Human drivers adjust for local habits, weather quirks, and sudden distractions in ways that no single mathematical framework has fully reproduced. Waymo’s approach may improve its internal testing, but it does little to address the practical friction of placing fleets of unmarked vehicles on roads shared with delivery trucks, school buses, and pedestrians who do not behave like tidy probability calculations.
Lawmakers and transportation departments now have another glossy study to cite when debates arise over permits and insurance rules. Whether that study reflects ground-level reality or simply advances the interests of one of the world’s largest technology companies remains the question that matters most to the communities being asked to host these experiments.
You just read America First's take. Want to read what actually happened?
More in Technology

New York Pauses Large Data Centers in First Statewide Moratorium
Gov. Hochul approved a pause on new data centers due to energy and infrastructure concerns. The move is the first of its kind in the US.

Hassabis Urges US-Led AI Watchdog to Screen Frontier Models
Google DeepMind's Demis Hassabis called for a US-led international AI regulatory body. Discussions intersect with chip export controls and safety concerns.

SK Hynix ADRs Jump 13% on Nasdaq Debut While Seoul Shares Drop 9%
The South Korean memory chipmaker's US shares surged as much as 13% on debut while broader semiconductor stocks fell on Middle East tensions and supply concerns.

OpenAI Executive Departs Amid AI Data Use Debates
OpenAI launched new model iterations while its No. 2 executive stepped down due to health issues. Tech coverage examined implications for AI development and accountability.
The Compass
You just read five takes on one story.
What's your take? Find your political shape in a few minutes.
Take the test