‘Synthetic Anomalies’

VANE-Bench is a benchmark designed to assess Video-LMMs’ ability to detect and localize anomalies in videos, revealing their limitations in subtle anomaly detection through a visual question-answering challenge.