Training Question about wav2lip HOT 7 CLOSED

Are you training with LRS2?

from wav2lip.

No on LRS3 even on LRS2 same
after 999 steps

Saved checkpoint: train_checkpoint/checkpoint_step000003000.pth
Saved checkpoint: train_checkpoint/disc_checkpoint_step000003000.pth
Evaluating for 300 steps
L1: 0.026276566088199615, Sync: 0.0, Percep: 0.0 | Fake: 27.63102149963379, Real: 0.0: : 2it [00:03,  1.99s/it]

raise ValueError('Expected more than 1 value per channel when training, got input size {}'.format(size))
ValueError: Expected more than 1 value per channel when training, got input size torch.Size([1, 512, 1, 1])

from wav2lip.

How many iters do you have per epoch? You should get a thousand iterations at least per epoch.

from wav2lip.

@prajwalkr I am getting 5 iters. How can I increase that iter is there a way to train only one video from the dataset and test it.

from wav2lip.

You can increase the iter if you train on the whole LRS2 train set.

from wav2lip.

@prajwalkr @Rudrabha What is the difference between LRS2 and LRS3 I will modify the code but first I want to train on one person video and check the results what changes i need to do
Things I know

1. Fps 25
2. preprocessing.py Code changes
3. add folders of training and val in filelists Q: can i add full path example /home/user/lrs3/00001

from wav2lip.

What is the difference between LRS2 and LRS3

#49 (comment)

will modify the code but first I want to train on one person video and check the results what changes i need to do

https://github.com/Rudrabha/Wav2Lip#training-on-datasets-other-than-lrs2

3. Q: can i add full path example /home/user/lrs3/00001

only if /home/user/lrs3/00001.mp4 is a video file

from wav2lip.