Merging Without Forgetting: Continual Fusion of Task-Specific Models via Optimal Transport

setup environment

# you can replace the name `OTMF` with any name you like
conda create --name OTMF python=3.11
conda activate OTMF
pip install -r requirements.txt # x86-64 Linux

Acknowledgements

Some of the code in this repository is based on the following repositories:

• https://github.com/tanganke/subspace_fusion
• https://github.com/EnnengYang/AdaMerging
• https://github.com/mlfoundations/task_vectors
• https://github.com/prateeky2806/ties-merging