Mixture of Probes: Learning from Privileged Modalities in Multimodal LLMs Through Probing
arXiv:2607.08839v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) are typically designed under the assumption that all modalities available during training will also be accessible at inference. However, many real-world settings violate this assumption, requiring models to operate under a privileged modality setting, where auxiliary modalities are available only during training. While these modalities contain valuable information, existing MLLMs largely fail to leverage the