DPU: Dynamic Prototype Updating for Multimodal Out-of-Distribution Detection
Shawn Li, Huixian Gong, Hao Dong, Tiankai Yang, Zhengzhong Tu, Yue Zhao·November 12, 2024
Summary
The Dynamic Prototype Updating (DPU) framework addresses intra-class variations in multimodal Out-of-Distribution (OOD) detection, enhancing model robustness and generalization. It dynamically adjusts prediction discrepancies, improving OOD detection performance, especially in Far-OOD scenarios, with up to 80% improvements. The method is accessible, with code available on GitHub, and excels in both Near- and Far-OOD detection tasks across various datasets and models. DPU's effectiveness is demonstrated through its superior performance in metrics like FPR95, AUROC, and ID accuracy, making it a significant advancement in robust OOD detection.
Advanced features