动手训练一个简单的CLIP模型,加深对CLIP的理解。
准备环境:
-
下载 https://github.com/wkcn/TinyCLIP-model-zoo/releases/download/checkpoints/TinyCLIP-ViT-40M-32-Text-19M-LAION400M.pt 到model_hub/wkcn/下
-
数据下载到data下并解压:链接: https://pan.baidu.com/s/1DISLgni8cRY6ZY5hp3QV7Q?pwd=uaa3 提取码: uaa3
-
安装依赖:
pip install -r requirements.txt
其余训练和测试参考微信文章:https://mp.weixin.qq.com/s/J9FOcJUXCP4pHdwksBAFug