Keisuke Mizutani

Automatic prompt engineering using multimodal large language models for the analysis of biological research images.

Two types of approaches are introduced: the Batch APE method, an efficient method for optimizing prompts for powerful black-box models, and a fine-tuning method with supervised fine-tuning (SFT) and direct preference optimization (DPO) on a local vision-language model (VLM).