kemo-huang / jmodt Goto Github PK

When i try to visualize the jmodt.avi video by running the viewer.py file, i faced this small sized images in the jmodt folder. Same is the case in the video as well. Please see the attached file.

when i start training,why the rcnn_loss is zero?

@Kemo-Huang

sorry to bother you.
In the paper, it shows that The training sequences are split into a training set and a validation set with roughly equal number of frames. Specifically, the training set has 10 sequences and 3975 frames, and the validation set contains 11 sequences and 3945 frames.
But the code split the dataset into a training set with 10 sequences that contain 3995 frames， and the validation set with 10 sequences that have 3864 frames.
If the seventeenth sequence were added to the validation set, it would contain 4009 frames.

So may I have the sequences that were used in your Paper， please？
If you delete some frames when you train or validate please tell me，Thanks a lot.

I check each sequence in the Kitti dataset. Got the number of each Sequence like this.

Traceback (most recent call last):
File "tools/train.py", line 164, in
main()
File "tools/train.py", line 157, in main
val_loader
File "/home/my_com/virtualenv/JMODT/jmodt/utils/train_utils.py", line 198, in train
prev_val_loss = val_loss_epoch

How can i solve it?

Hello, when I used multiple GPUs for training, it reported the following error, how should I solve it?

I am trying to Build and install the required CUDA modules via PyTorch and the CUDA toolkit: sudo python3 setup.py develop , but encountering the following errors: Installed /home/adeel/JMODT
Processing dependencies for jmodt==1.0.0+82f36cd
error: protobuf 3.19.6 is installed but protobuf>=4.21.5 is required by {'ortools'}

Thanks for your work, recently, I wanted to train the tracking model, so I downloaded the dataset, I can't find the TRACK_OBJECT folder, maybe you could teach me where is the folder I could download. Thank you in advance.

could you please tell me how to visuallize the feat(.npy), I have try to save as png, but I can not see anything...

Hello, the link to the paper no longer exists, can you provide it again?

By modifying kitti_converter.py, I can only generate the three files in the picture below. Excuse me, test.txt, sample2frame.txt and seq2sample.txt, how to generate these three files? thank you very much！！

I think the optimizer.pth of model jomdt.pth is needed to finetune it.

@Kemo-Huang @P16101150
Excuse me, sir， sorry to bother you. I have several problems with the code with JMODT.
1st.
In the paper the affinity computation part：
Equation(7) the refined affinity X^aff = αA^app + βA^diou

α+β=1； I can not found that the value of α and β. But In the Experiment Results part, you set β=10α for affinity computation， I am confused that which parameter means α or β.
2nd.
In the Experiment Results part:
w^aff = 22, that I can not find which parameter is w^aff, and in data_association I did not find too.

3rd.
In algorithm 1:
where is the X^aff ← αA^app + βA^diou in the program？

I checked data_association.py, does " link_matrix = link_score * w_app + iou_matrix * w_iou + dis_matrix * w_dis" is X^aff ? If it is yes，which is α and which is β，and α+β ≠1.
The last:
if " link_matrix = link_score * w_app + iou_matrix * w_iou + dis_matrix * w_dis" is X^aff, does the X^aff is only used in evaluation step？ Or does it means that X^aff is not used in the train setp， that the training step only used the correlation feature, or only used the A^app？

Thanks, a lot.

I want to train this code for dataset, following as

$ python tools/train.py --data_root /home/my_com/dataset/KITTI/ --batch_size 4

when first epoch is done, I got error

Traceback (most recent call last):
File "tools/train.py", line 164, in
main()
File "tools/train.py", line 157, in main
val_loader
File "/home/my_com/virtualenv/JMODT/jmodt/utils/train_utils.py", line 198, in train
prev_val_loss = val_loss_epoch

Can I get some solution from this problem?

Thanks.