ResearcharXiv cs.AI

PHREEQC-MCQ-200: A Diagnostic Benchmark for Tool-Augmented Scientific Simulator Agents

#benchmark#scientific simulation#tool-augmented#accuracy#geochemistry

English

The article introduces PHREEQC-MCQ-200, a benchmark designed to evaluate tool-augmented agents in deterministic aqueous-geochemistry simulations. It highlights that while simulator access can enhance accuracy, it also reveals regressions in performance for certain agents, emphasizing the need for comprehensive evaluations of scientific tools beyond mere accuracy metrics.

中文

本文介绍了PHREEQC-MCQ-200，一个用于评估工具增强型代理在确定性水化学模拟中表现的基准。它强调，尽管模拟器访问可以提高准确性，但也揭示了某些代理的性能回归，强调需要对科学工具进行超越简单准确性指标的全面评估。