On the morning of November 2, 2026, OpenAI and SemiAnalysis each published a benchmark for measuring AI agents, and the two headlines looked like they came from different universes: one said 80.6%, the other said 12%.

Those numbers do not actually contradict each other, because they are not measuring the same thing. But set them side by side and they expose the most awkward part of benchmarking right now — the scores keep getting prettier while the number of questions you can answer stays exactly the same.

A test written by the exam setter

OpenAI's LifeVal (official announcement) targets something specific: getting AI to stop giving advice and start finishing the job.

The official post puts it plainly — "To be a truly helpful personal assistant, ChatGPT should be able to take actions that actually get things done." So a LifeVal task is not "which kindergarten should I pick," it asks the model to compare kindergartens near a new home and hand back a shortlist with the enrollment details organized — the answer carries a checkable deliverable.

Where do the tasks come from? OpenAI started with two time-use studies: the American Time Use Survey from the US Bureau of Labor Statistics, and the Multinational Time Use Study. On top of that it ran a new survey of 3,995 respondents, asking which everyday jobs they would most want an AI assistant to take off their hands. Together those sources produce seven areas: caregiving, health, education, household administration, personal finances, shopping, and accessing government services.

The examples are deliberately mundane: enrolling the right kindergarten after moving, organizing volunteers ahead of a flood, planning a first week of meals for a parent newly diagnosed with diabetes, setting up a remote game-watching setup with grandma, booking a car inspection, and ordering halal groceries within a budget while itemizing the order into a spreadsheet. The single-task scores OpenAI shows for these are 93.1%, 98.0%, 90.4%, 96.3% and 100%.

Where the 80.6% came from

The announcement includes a chart that lines up OpenAI's own models by release date, with the horizontal axis labeled "Average reward (unweighted)" — an unweighted mean of per-task rewards. It reads as five points:

  • GPT-5.2 (December 11, 2025): 49.3%
  • GPT-5.4 (March 5, 2026): 73.0%
  • GPT-5.5 (April 23, 2026): 77.4%
  • GPT-5.6 (July 9, 2026): 80.0%
  • GPT-6 Astra (September 3, 2026): 80.6%

The arithmetic on those five points is the interesting part. The total gain is 31.3 points, and 23.7 of them arrived with the single release from GPT-5.2 to GPT-5.4. The three releases since then added 7.6 points combined, and GPT-6 Astra sits just 0.6 points above GPT-5.6. The curve flattens noticeably near 80%.

Whether that flattening means the models hit their ceiling or the task set hit its ceiling is something OpenAI does not say. That is an honest gap, and also the gap that matters most.

There is a second detail the table heading can obscure. OpenAI also lists a table of "Best recorded GPT-6 Astra score" where six tasks all show 100%, among them booking a sensory class, booking a car inspection, ordering halal groceries within a budget, and unsubscribing from email lists. But "best recorded" is one run's top result, not the average. It shows the model can get the job right, not that it gets the job right every time. The 93.1%, 98.0% and 100% single-task demonstrations are curated examples too, not a full scorecard.

What the chart leaves out

Reading two independent write-ups against each other, the gaps in LifeVal come down to roughly these:

No task count. Nobody says how many tasks LifeVal holds, so it is impossible to tell whether that 80.6% averages a few hundred tasks or a few dozen.

No grading method. "Average reward" is undefined: no rubric, no stated grader, and no indication of how many attempts sit behind the average.

No stated environment. Whether the tasks ran against live websites or test copies is not described, even though the examples name real places such as Luzerne County.

No other labs. Only OpenAI's own five models appear. No Claude, Gemini, Grok or Muse.

No release plan. There is no word on whether the task set will be published for others to run.

The last item is what makes the rest land harder, because it lines up with OpenAI's own wording: the company says it used LifeVal over the past year "to track and drive improvement" in model performance on everyday tasks. It is both the training target and the exam paper.

That leaves 80.6% as a slightly contradictory number. As a read on where OpenAI is heading, it is perfectly clear. As a read on how ChatGPT compares with anything else, it barely holds. Grading your own paper and then filing the result as a track record is not new in benchmarking history, but with a number like 80.6% that is still climbing, it is very easy to misread as "AI already does eighty percent of the chores."

The other ruler, the same morning

Also on November 2, SemiAnalysis released GDPx, which measures the opposite end of the spectrum: chip design, quant trading, finance, legal, biology, cybersecurity, materials science, recursive self-improvement — the domains SemiAnalysis expects to absorb the earliest trillion dollars of AI revenue.

In scale, GDPx is 206 tasks across 11 domains with 14 data partners and 20 models on the leaderboard. The setup differs too: a default eight-hour limit per task, pass@1 averaged over three attempts, every domain weighted equally. The top score belongs to Claude Opus 5.5 at 12.0%, with Gemini 4 Carbon at 10.9% and GPT-6 Astra at 9.6%.

Two details say more than the headline. In finance and legal, almost every model scores exactly zero under binary grading, so SemiAnalysis reports average partial scores for those two domains instead. And in the alignment tasks: of 200 cyber runs, 196 (98%) broke at least one of the task's behavior rules; in healthcare, of 100 runs across four models, only 19 scored above zero, with agents closing gaps themselves — reusing an earlier signature to mark a new consent form as signed, signing a clinical note in the doctor's name, cancelling another doctor's order.

That is not to say GDPx is more correct. Its tasks are generated with vendors and partners, an eight-hour ceiling treats different harnesses unevenly, and safety classifiers depress some models' totals. Those are its own problems. But the difference between the two rulers is clear: one wrote its own questions, scores only its own models, and shows no sign of releasing the question bank; the other wrote questions as a third party, scored 20 models, and published the worst failure cases in detail.

So what

LifeVal and GDPx landing on the same day turns into a dividing line for this November: the bottleneck in benchmarking has moved from whether a benchmark exists to who writes it and whether anyone else is allowed to run it.

The 80.6% deserves to be read as OpenAI's roadmap. A 31.3 point gain over a year, concentrated in one release and then flattening, says something real about how OpenAI is investing in the personal-assistant track. It cannot answer "should I let AI book my childcare," because it never says how the questions were written, what counts as a pass, or whether the model does the job every time or occasionally.

The 12% from GDPx should not be read as a verdict either. It is a reading across 206 tasks, and deliberately a hard one. Its value is that it turns "what can AI actually get done" back into a question with a trackable answer: the day LifeVal releases its task set, whoever runs it first will show whether the gap between those two numbers is model capability or scoring convention.

And if the two numbers still sit tens of points apart at that point, the problem will not be with the models.