This is the official PyTorch implementation of our paper "Can One Modality Model Synergize Training of Other Modality Models?"
Can One Modality Model Synergize Training of Other Modality Models?
Jae-Jun Lee, Sung Whan Yoon
Accepted at ICLR 2025
Install the required dependencies by running:
pip install torch==2.0.1 torchvision==0.15.2 torchaudio==2.0.2 --index-url https://download.pytorch.org/whl/cu118
pip install timm transformers huggingface-hubInstall any additional dependencies as needed for your specific setup.
For detailed instructions on running experiments, please refer to the README files in the following directories:
vision-language-models/multimodal/
If you find this work useful in your research, please consider citing:
@inproceedings{lee2025can,
title={Can One Modality Model Synergize Training of Other Modality Models?},
author={Jae-Jun Lee and Sung Whan Yoon},
booktitle={The Thirteenth International Conference on Learning Representations},
year={2025},
url={https://openreview.net/forum?id=5BXWhVbHAK}
}