Comments (2)
rwightman
commented on July 29, 2024
@haideraltahan I don't think there is a problem here, looks more likely to be an issue with how model is being used/wrapped in whatever this use case is.
Can do model(torch.randn(2,3,224,224), torch.randint(0, 49408, (2, 76))) without issue, call text directly ,etc.
from open_clip.
Srividhya-Sainath
commented on July 29, 2024
Adding context_length=76 should help. Something like this:
text_tokens = tokenizer.tokenize(text_descriptions, context_length=76)
from open_clip.
Related Issues (20)
- [1,512] Data conversion
- Handling Negative Pairs in Fine-Tuning of CLIP Models HOT 1
- [1,512] data HOT 1
- How to inference trained checkpoint on my own dataset?
- 1111
- Conceptual help on SigLIP + pre-trained CLIP
- Best practice with distributed training? HOT 1
- Coca Image-to-Text, RuntimeError: Boolean value of Tensor with more than one value is ambiguous HOT 4
- Help With Training Bottleneck HOT 1
- fastpath inference is not supported HOT 2
- How do you profile the CLIP models HOT 1
- Huge performance drop in zero-shot image classification for all SigLIP models
- RuntimeError: The shape of the 2D attn_mask is torch.Size([77, 77]), but should be (128, 128). HOT 4
- Text Similarity not equal to 1 for identical inputs HOT 1
- Hello, where can I find the 'vision.cfg' and 'text.cfg' files？ HOT 1
- [bug] loading saved weights of an open_clip model does give back the same results HOT 2
- RuntimeError: expected scalar type Float but found BFloat16 HOT 2
- Duplicate Class Names in IMAGENET_CLASSNAMES HOT 1
- Error loading state_dict using pre-trained checkpoint with CustomTextCLIP model HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from open_clip.