In 4.1, you guys say you use the improved training annotationsfrom [22] and test annotations from [25]. so the results you obtained is evaluated on the improved test annotations , but in Table 3, methods above MSDS-RCNN like IATDNN+IAMSS with 26.37MR are reported on the original test annotations and it has a 14.95MR performance on the improved test annotations as you used, but methods like MSDS-RCNN and your results are reported on the improved test annotations,
this also happens in other comparison experiments like single-modality detectors in table 2, which is quite unfair and confusing
[22]Li, C., Song, D., Tong, R., Tang, M.: Multispectral pedestrian detection via simul-taneous detection and segmentation. In: Proc. of British Machine Vision Confer-ence (BMVC) (2018)
[25]Liu, J., Zhang, S., Wang, S., Metaxas, D.N.: Multispectral deep neural networksfor pedestrian detection. arXiv preprint arXiv:1611.02644 (2016)