Process then Retrieve: Investigating the Origins of the Modality Gap in Vision-Language Models (s'ouvre sur arXiv — Machine Learning (cs.LG), nouvel onglet)
arXiv:2611.09897v1 Announce Type: new Abstract: Understanding the origins of the modality gap in vision language models remains a significant challenge. This work investigates whether differences in information density between modality specific tokens at the embedding layer contr…