Shuguo Jiang

DIVE: A Training-free Hallucination Mitigation Mechanism for Complex Scenes

Results on the object hallucination evaluation benchmark POPE show that the proposed Dual-branch Inference for Visual-prior Elimination reduces the model’s hallucination rate when objects are dense or complex occlusions exist, and brings a slight improvement in the question-answering accuracy of the model on the MSCOCO and VG datasets.