Beyond Benchmark Accuracy: A Diagnostic Test for LLM Chemical Prediction
LLMs have achieved strong performance on chemical prediction benchmarks. However, existing evaluation methods typically provide target entity identity information directly, making it difficult to determine whether model predictions arise from transferable structure-property reasoning capabilities or rely on target-rela...