Comments (3)
Hi @wuwangzhuanwan , thanks for your feedback.
We fix the bug for loading data by disk. It should work fine now.
Specifically, I find that mmcv.imread
is not equal to the original code Image.open
from BEVDet. This may probably be the reason for the low accuracy.
from hop.
(1) I used mmcv.imread to read the data, because directly using mmcv.load as in your code would result in an error, indicating unsupported
color
. (2) Using the configuration hop_bevdet4d-r50-depth.py and reading the data with mmcv.imread shouldn't cause any issues. However, the replicated accuracy is only around 0.36+ mAP.Can you please provide more details about your configuration and setup? It's possible that there might be some misconfigurations or parameters that need adjustment. Additionally, double-checking the dataset, model settings, and any preprocessing steps could help identify any potential sources of the lower accuracy.
Have you tried python tools/test.py
? My training log is 0.36+ mAP but 0.39+ mAP in testing, which is almost same as the author released. It doesn't need to change configs or anything, just run python tools/test.py $config $ checkpoint
. I guess there may be some TTA diff between val and test.
NDS=0.5066/0.5099,mAP=0.3979/0.3990
![image](https://private-user-images.githubusercontent.com/50237122/269282348-62e7a967-98ee-4d2e-a669-7c1237a8fc61.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjUzNDY4MDUsIm5iZiI6MTcyNTM0NjUwNSwicGF0aCI6Ii81MDIzNzEyMi8yNjkyODIzNDgtNjJlN2E5NjctOThlZS00ZDJlLWE2NjktN2MxMjM3YThmYzYxLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MDMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTAzVDA2NTUwNVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWVkMTAxYjQ0MTM0MDI0ZjI1YjM1MmQ3YTIxMTUzMDQ1OTk3ZGU2YmQ4ZDlhYjVmYzE5ZjY2NjM5NDE5NjRjNTgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.hfxN4_lb67YhA8yJRtDRpfgcWqvG-CXz0lP570GKFbw)
from hop.
Hi, the performance in the log file is based on epoch_24.pth. However, we test the model with epoch_24_ema.pth. The ema checkpoint is empirically better than the original model. This should account for the difference of mAP.
from hop.
Related Issues (17)
- Temporal BEV feature align HOT 2
- Pretrained weights for NuScenes detection HOT 1
- How to get the ground truth of history frames? HOT 2
- Ablation study of the bev feature at timestamp t-k HOT 3
- Does it work for 2 camera views?
- Why does the channel reduction can prune the height info ?
- Can Hop used in PETR model? HOT 1
- Will open sota config on nuscenes benchmark ?
- When will release code for HoP on BEVFormer? HOT 1
- typeError: Unsupported format:color HOT 3
- 训练中得到0map HOT 5
- KeyError: 'ann_info'
- Segmentation Fault while inference over R50 Models HOT 1
- When will the SOTA model for nuScenes detection task be posted in model_zoo?
- Why is HoP useful even thought it is not used in inferring?
- Bevformer+HoP config,please HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hop.