Code Monkey home page Code Monkey logo

clip-pytorch's Introduction

Hi,很高兴遇见你 👋

clip-pytorch's People

Contributors

bubbliiiing avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

clip-pytorch's Issues

您好!训练至少需要多少张图片和一些补充问题

我是医疗数据集,目前有440张,并且每个img只对应一条caption。请问
1,这种数据集情况下,是不是会影响效果?
2,如果是因为数据集导致的效果不好,医疗方向病例并不会很多,有什么改进办法吗?
3,有什么在医疗影像上微调的CLIP预训练权重推荐吗?

万分感谢!!

请教损失函数差异

  1. 你的代码,损失函数就是logits_per_image和转置加起来
logits_per_image, _                 = model_train(images, texts)
logits_per_text                     = logits_per_image.t()
labels                              = torch.arange(len(logits_per_image)).long().to(images.device)

loss_logits_per_image               = nn.CrossEntropyLoss()(logits_per_image, labels)
loss_logits_per_text                = nn.CrossEntropyLoss()(logits_per_text, labels)
loss                                = loss_logits_per_image + loss_logits_per_text

loss.backward()
optimizer.step()

想知道这个原理

运行eval.py被杀死

训练一切ok,并且保存了权重。
在评估的时候,

(vlmo_chb) xxxxxxx/clip-pytorch$ python eval.py
bert_type == "openai"
logs/best_epoch_weights.pth model loaded.
74it [09:19, 7.56s/it]
0%| | 0/811 [00:00<?, ?it/s]/xxxxxxx/python3.8/site-packages/torch/nn/functional.py:1794: UserWarning: nn.functional.tanh is deprecated. Use torch.tanh instead.
warnings.warn("nn.functional.tanh is deprecated. Use torch.tanh instead.")
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 811/811 [02:08<00:00, 6.33it/s]
已杀死

请问是哪里出了问题吗?或者可能是什么原因?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.