dotsfeed
← News

GPT-6 Astra solved 49 of 50 physics research problems at $2.40 each in the new TheoPhysEval benchmark

Verified· Oct 17, 2026Published Oct 17, 2026

Astra solved 49 of 50 fresh theoretical-physics problems in the new TheoPhysEval benchmark at about $2.40 apiece, outscoring Anthropic's Opus 5.5 (92%) and Gemini 3.8 Flash (68%).

What happened

A team of 35 researchers — including contributors from ICTS, Harvard, KU Leuven and Google DeepMind — built TheoPhysEval, a new benchmark of 50 fresh theoretical-physics research problems with verifiable answers across 11 subfields. Commercial AI agents were set loose on the problems with no human hints.

GPT-6 Astra, running inside OpenAI's Codex coding environment, solved 49 of 50 problems (98%) at a cost of under $3 per problem — about $116 for the entire benchmark, roughly $2.40 per problem.

The runners-up: Anthropic's Opus 5.5 (via Claude Code) at 92%, Google's Gemini 3.8 Flash at 68%, DeepSeek-V4.1-Flash at 54% and GLM 5.3 at 42%.

Where the agent appeared to fail, some of the experts' own reference solutions turned out to contain errors; once corrected, Astra's answers checked out.

Why it matters

The authors say leading models may already surpass the best human researchers on concrete physics calculations — a major milestone. Yet physics has not produced breakthroughs like math's Navier-Stokes result, because agents still lack "taste": the ability to ask the right research questions. The researchers expect autonomous top-level AI research sooner than most people assume.

Verified 2026-10-17

Sources

Get updates like this every morning

  1. ① Email
  2. ② Card on Stripe
  3. ③ 7 days free

Then $2/month · cancel anytime in one click