BioEVAL: A global, multi-institutional benchmark of large language and multimodal models for bioengineering
Diverse cloud-scale foundation/multimodal models and locally deployable models suitable for inference on consumer-grade GPUs are evaluated, achieving the highest accuracy of up to 90% on MCQs, similarity score of 0.72 on literature synthesis, and accuracy of 80% on a small sample of multimodal reasoning questions, with...
Shun Ye, V. C. Suja, Chen-Long Li et al.
· 0 citations