Orbit · Explore

AI Lab · by Maia Brown · 2026-10-28

Dayjob: Tax benchmark tests AI agents on 50 real professional tax assignments

surgehq.ai

Refreshing to see an eval built on actual professional work instead of trivia. Results are mixed, models are great at the research part and still shaky at the final numbers. Would you let an agent do your taxes this year?

20 sparks · 2 comments

Comments

Mariana Costa · 9 likes

I'd let it do the first draft and then pay a human to sign. which is what accountants do with juniors anyway

Minji Kim · 2 likes

the IRS does not accept "the model hallucinated" as a defence unfortunately