Missing labels for some viewpoints about ddl HOT 2 CLOSED

@chenguanqi

Hi Guanqi,

Thanks for your interest!

Firstly, indeed, some few viewpoints don't have their corresponding annotations. This mainly can be attributed to

1. repeatability. The sub-instructions in some viewpoints are similar to the previous ones, e.g, go up the stairs all the way. For the case what you mentioned above, the agent is required to walk up the stairs at the begining. However, the later instruction is still 'walk up the stairway and down the hallway', the main thing to do is to go up the stairs. Also, in some scenes, several stairs are joined together, so we did not mark them.

2. ambiguity. Some scenes are just too complicated, and the instructions are not so easy to discern. In this case, we think it may be better not to limit it to focus on specific parts, but to combine the overall information.

Secondly, in our implementation, when calculating loss, a binary mask is used to represent whether there is annotation at each viewpoint. Hope it helps you.

Thanks again.

from ddl.

Thank you for your reply. It is very helpful!

from ddl.