task id is known during test? about eli HOT 5 CLOSED

Task id is not required, but we need to know whether the test instance belongs to the last-learned task or not (note that this is a much weaker requirement when compared to task aware methods). We have explained this in Sec 3.2.2. We can side-step this by learning a simple binary classifier to do the discrimination.

from eli.

thank you! and could you tell me the position of the code for it?
btw, did the binary classifier not suffer from the class imbalance problem (rehearsal data vs. new data) in experiments?

from eli.

Hi, I think you got me wrongly. ELI doesn't have the binary classifier, but that can be one way to get around the weak requirement that we have. We will explore this in a future work.

from eli.

the current results are obtained with information (belongs to the last-learned task or not) of test data?

from eli.

Yes.

from eli.