AIAI for chemistryStory 05
Chemistry agents face a real physics check
What changedTSBench asks AI agents to propose three-dimensional transition states, then checks the structures with quantum chemistry instead of grading their prose. Across 546 evaluations, diagnosis-led retries raised aggregate success from 50.4 to 66.8 percent. The remaining failures show that plausible-looking chemistry can still follow the wrong reaction path.
The useful part
Why it matters
Scientific agents can sound chemically plausible while following the wrong reaction path, and this test exposes that failure before an autonomous workflow trusts it.
Keep in mind
Good to know
This is a preprint benchmark, not proof that the tested agents can plan useful laboratory syntheses.
Evidence