Moving MNIST 3 digits about predrnn-pytorch HOT 2 CLOSED

Hi, thanks for your good question.
(1) You can get the dataset with 3 digits from predefined generation rules.
(2) It is a good question: is the model pretrained from 2-digits-dataset also useful for 3-digits-dataset? I think this is an important and interesting question. You can follow these two papers from Yao and Wang for more details:

• ModeRNN: Harnessing Spatiotemporal Mode Collapse in Unsupervised Predictive Learning (https://arxiv.org/abs/2110.03882)
• Unsupervised Transfer Learning for Spatiotemporal Predictive Networks (https://arxiv.org/abs/2009.11763)

from predrnn-pytorch.

Hi @wuhaixu2016,
May I know how I can get the dataset with 3 digits? Where can I find the predefined generation rules? Can you please share the code?

Thansk!

from predrnn-pytorch.