FInal token index when training a model about clip_prefix_caption HOT 4 CLOSED

when I follow you change logits to be "logits = outputs.logits[:, dataset.prefix_length :]",the loss become very slow quickly and the inference caption become "\n\n\n\n.......", do you have this situation？or that should be "logits = outputs.logits[:, dataset.prefix_length - 1: -1]"thank you.

from clip_prefix_caption.

the gpt2 acts the ''next token predixtion', so the token in time step t is predicted by the token in time step t-1. the final token does not need to predict for the next token. so it is right to use logits = outputs.logits[:, dataset.prefix_length -1 : -1]

from clip_prefix_caption.

you can see the source

from clip_prefix_caption.

True, makes sense thanks!

from clip_prefix_caption.