LLM2CLIP
Enabling existing pretrained models to become stronger with minimal fine-tuning
Downloads
Loading…
LLM2CLIP
August 2024
LLM2CLIP is a novel approach that embraces the power of LLMs to unlock CLIP’s potential. By fine-tuning the LLM in the caption space with contrastive learning, we extract its textual capabilities into the output embeddings, significantly improving the output layer’s…