runnanchen / clip2scene Goto Github PK
View Code? Open in Web Editor NEWLicense: Other
License: Other
Thank you for your impressive work and for publishing the code!
How much GPU memory is needed for “Annotation-free” and “Fine-tuning” ?
Thanks for the great work!
I have three questions about Semantic-guided Spatial-temporal Consistency Regularization.
Thank you for the great work. Have you tested this method on the 3D object detection task? If not, do you think this method can benefit the 3D object detection task? Thanks.
Can you provide the pre-trained model.pt? Thanks!
if phase == "train":
with open('./list_keyframes_train.json', 'r') as f:
self.list_keyframes = json.load(f)
f1 = open('./save_dict_train.json', 'r')
content = f1.read()
self.frames_corrs_info = json.loads(content)
f1.close()
if phase == "val":
with open('./list_keyframes_val.json', 'r') as f:
self.list_keyframes = json.load(f)
f1 = open('./save_dict_val.json', 'r')
content = f1.read()
self.frames_corrs_info = json.loads(content)
f1.close()
if phase == "test":
with open('./list_keyframes_test.json', 'r') as f:
self.list_keyframes = json.load(f)
f1 = open('./save_dict_test.json', 'r')
content = f1.read()
self.frames_corrs_info = json.loads(content)
f1.close()
if phase == "parametrizing":
with open('./list_keyframes_parametrizing.json', 'r') as f:
self.list_keyframes = json.load(f)
f1 = open('./save_dict_parametrizing.json', 'r')
content = f1.read()
self.frames_corrs_info = json.loads(content)
f1.close()
elif phase == "verifying":
with open('./list_keyframes_verifying.json', 'r') as f:
self.list_keyframes = json.load(f)
f1 = open('./save_dict_verifying.json', 'r')
content = f1.read()
self.frames_corrs_info = json.loads(content)
f1.close()
Can you help me obtain the list_keyframes_train.json file? Thanks!
Hi, thanks for your great work.
m_pred = tuple(pairing_images.T.long())
image_global_allpoints = image_global.permute(0, 2, 3, 1)[m_pred]
image_pred = image_pred[m_pred]
However, I have some confusion about the above calculation process (L213-L215 in lightning_trainer.py).
What is the specific meaning of m_pred?
Why the shape of image_global/image_pred and the shape of m_pred are not the same can be done this way? This part of the operation feels puzzling.
If you can provide an answer, thank you very much!
Hi, thanks for the amazing work and sharing the code base. I really appreciate the effort. Can you please let me which model_points network to use between minkunet and voxelnet for the pre-traininng of nuscenes dataset?
Here in the config, its selected as minkunet:
However, getting assertion error due to mismatch in sparsetensor type from here:
CLIP2Scene/pretrain/lightning_trainer.py
Line 108 in f37dae7
Can you please help? Thank you.
Thank you for this excellent work, but when will you please public the code?
Thanks for your interesting work!
May I know how to obtain the /nvme/konglingdong/youquan/nuscenes_infos_10sweeps_train.pkl file?
Why is the result of Table 1 comparison in the paper inconsistent with the original SLidR paper?
Thanks for your great work! I have some questions about the Semantic-guided Spatial-temporal Consistency Regularization.
If we want to make loss_ssr smaller, we need to make D (P, fn) larger in each grid. According to Formula 3 in your paper, if we want D (p, fn) larger, we need to make b much larger than a. According to Formula 4, That b is much greater than a means that D (p, t) is much greater than D (x, t). I want to know if I understand this correctly, and why it has a constraint effect.
Thank you for this excellent work.
When I pre-training python pretrain.py --cfg_file config/clip2scene_nuscenes_pretrain.yaml
, the following error is reported.
FileNotFoundError: [Errno 2] No such file or directory: '/nvme/konglingdong/runnan/CLIP2Scene/ViT16_clip_weights.pth'
How can I obtain the file ViT16_clip_weights.pth'
?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.