seoungwugoh / rgmp Goto Github PK
View Code? Open in Web Editor NEWFast Video Object Segmentation by Reference-Guided Mask Propagation
Fast Video Object Segmentation by Reference-Guided Mask Propagation
Hello! I am a newcomer to learning video segmentation. Do you implement three measures:region similarity,contour accuracy and temporal instability? Thank you !
It's only a trivial problem.
Maybe, we should calculate FPS by using
num_frames /(time.time()-tt)
Thank you for your researches. ^_^
in 71 line: msv_E2[sc] = F.softmax(e2[0], dim=1)[:,1].data.cpu()
in 116 line: all_E[:,:,f+1] = F.softmax(Variable(all_E[:,:,f+1]), dim=1).data
Why should we use "softmax" twice?
I want to test it in mobile system to see if the speed is good enough.
Thanks for releasing the demo code! I'm wondering if you are planning to release training and the code to generate simulated data?
Hi ,How do you handle the multiple instances tag for Davis 2017 dataset? Is it converted into two categories? How do you visualize Davis 2017 data sets?Because Davis is not a different category with different colors. For example, the label color of bear is the same as that of bicycle.Thank you!
In your RGMP paper Sec 3.3, you write the soft logit function. But in your code logit, I am a little confused about it.
Questions:
Thanks in advance!
Sorry for my mistake.
Hi,
In the paper, input size is stated to be 256x512. However, in the code patch input size is 512x864. Please correct me what I am missing in the code.
Thanks
Thank you for the implementation.
Can you provide any idea how I can test this on real time video ?
Hello.
I tried the RGMP code to understand it.
And i use the code made by xanderchf.
but there is missing argument in the middle of code.
How can i solve it.
Error was occurred in here
for f in range(0, num_bptt - 1):
output, ms = Propagate_MS(ms, all_F[:,:,f+1], all_E[:,0,f])
TypeError: Propagate_MS() missing 1 required positional argument: 'P2'
Thanks you in advance.
Sorry to bother you.Have you tried the youtube-vos dataset. Can it work? I have tried the youtube-vos dataset. But I failed to make it work.
Hi, I would like to ask about the ablation study without pre-training(-PT).
How many epoch did you train and how to set the learning rate for the fine-tuning part to get the accuracy in Table 5? (J mean is 68.6 and F mean is 68.9)
Thanks for your attention and hope to hear your reply soon.
why do not you use bptt_hsm in train.py? what is the meaning of ntokens in line 134 of train.py? looking forward your replay!Thank you very much
line 66: msv_E2[sc] = upsample(F.softmax(e2[0], dim=1)[:,1].data.cpu(), (h,w))
line 71: msv_E2[sc] = F.softmax(e2[0], dim=1)[:,1].data.cpu()
If you run these lines for each object (Propagate_MS is inside the loop for o in range(num_objects)
) , why use softmax instead of sigmoid?
Hi, I note that all your models are trained by using two-stage training strategy, which trains models on a larger additional dataset for the first stage. However, in Table 1 from your paper, models you compared with are trained just on DAVIS-2016. THis is not fair for other models, so I wonder how about J mean and F mean of your models trained just on DAVIS-2016?
Hello.
I tried the RGMP code to understand it.
And i use the code made by xanderchf.
but there is missing argument in the middle of code.
How can i solve it.
Error was occurred in here
for f in range(0, num_bptt - 1):
output, ms = Propagate_MS(ms, all_F[:,:,f+1], all_E[:,0,f])
TypeError: Propagate_MS() missing 1 required positional argument: 'P2'
Thanks you in advance.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.