Comments (2)
Hi Simon, for task-specific finetuning of SAM, you can allow more model parameters to be trainable based on hq-sam's current training setup, such as adding some lora layers into the mask decoder or image encoder, or just unfreeze the whole mask decoder or more blocks in the image encoder. Also, I would suggest to set hq_token_only = True during the inference after successfully finetuning the model.
from sam-hq.
Thanks for your answer !
I also have another question : in my task, each image is endowed with various masks ; think about items like people on a picture. Each picture can contain between 1 and 10 people. So currently, for each image (image.jpg
) I have a binary mask (image.png
) gathering all the different masks ; would you recommend splitting this mask into many different masks ?
from sam-hq.
Related Issues (20)
- RuntimeError: Unexpected error from cudaGetDeviceCount(). Did you run some cuda functions before calling NumCudaDevices() that might have already set an error? Error 804: forward compatibility was attempted on non supported HW
- Can we add support for transformers? HOT 3
- RuntimeError: Sizes of tensors must match except in dimension 1. Expected size 1 but got size 13 for tensor number 1 in the list. HOT 1
- Training problem: During the training of sam-hq, the iou output of the val set is very high, 0.98; but in eval mode, the iou of the val set is only 0.48
- Segment Anything CPP Wrapper for macOS
- Can sam-hq perform breakpoint training: continue training on the already trained sam-hq, or continue training on the official sam-hq weights HOT 2
- Alternative implementation in Refiners
- About interm_embeddings
- Runtime error in Colab HOT 1
- How to train vit_tiny (Light HQ-SAM for real-time need): ViT-Tiny HQ-SAM model?
- Why can't we achieve the demonstration effect? There are three tennis rackets in the incoming image, and only one mask is returned
- Visualization of Figure 6
- can't we get candidates as original sam?
- About the issue of positive and negative sample pairs HOT 1
- Does SAM_HQ support batch input?
- Positive negative point inputs for SAM-hq
- no such pth file
- RuntimeError
- Evaluation for instance segmentation
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sam-hq.