hugging face 돌다가 mergetkit 이 상단에 있어서, 살펴보았습니다.
https://huggingface.co/spaces/arcee-ai/mergekit-gui
모델간 merging을 해주네요.
유툽보단 밑에 논문글 보는게 좋습니다.
발췌
By utilizing the broad spectrum of open-sourced LLMs, model merging enables the creation of versatile and robust models capable of excelling at multiple tasks simultaneously or adapting to new domains without the need for training from scratch.