Comments (12)
Why you need to train on a single video?
from articulated-animation.
Yes, but the results will be satisfactory. I'm guessing that you're looking to do some kind of quick, supervised motion transfer and get around training the model as it takes a long time (I don't blame you, it's resource heavy). It's best that you create a dataset that you can train with the specific thing you want, and infer on that. In a scenario like this, it's possible you can create a synthetic dataset (for example, 3D animations of what you want where you can control the scene) then train on that.
@AliaksandrSiarohin I think the reason why is that it might be hard to build in the wild datasets for something you want. For example, if you wanted to train a model on people doing back flips, it would be hard to find sufficient data to train on due to the different camera angles. Datasets like Taichi are easier due to stationary cameras.
To answer the second question, yes.
from articulated-animation.
When i add my own driving video and the source image it doesnt work,what could be the reason
Second thing can the driving video be anything other than the datasets videos that you have used
from articulated-animation.
I can't say, show an example.
from articulated-animation.
When I use my own driving video and the original image, the faces in the generated video are different from those in the original image. I want to ask, what is causing this?The effect of generating video is not good. Thanks.
from articulated-animation.
Send an example.
from articulated-animation.
@AliaksandrSiarohin
test_demo.zip
run command, as follows:
python demo.py --config config/ted384.yaml --driving_video driving_video.mp4 --source_image source_image.png --checkpoint checkpoints/ted384.pth
Thanks,
from articulated-animation.
Your video is not cropped. You should crop it to make it square around the person. Plus you can try to use ted-youtube config and checkpoint.
from articulated-animation.
Your video is not cropped. You should crop it to make it square around the person. Plus you can try to use ted-youtube config and checkpoint.
I run command with ffmpeg
:
ffmpeg -i driving_video.mp4 -vf scale=384:384,setdar=1:1 driving_video_crop.mp4
But result.mp4
is not so good.
test_demo_crop.zip
Is there a problem with my cropping method?Could you give a reference code? Thanks again.
from articulated-animation.
Thank for your great work! I'm going through the same thing,Is there something wrong with my data
Desktop.zip
from articulated-animation.
Hello, I would like to ask whether the model you provided is the best model and whether the training time and data are sufficient
from articulated-animation.
Image and video crops should include upper part of the legs, see examples in Readme.
from articulated-animation.
Related Issues (20)
- What version of CUDA, cuDNN are you using? HOT 6
- produce smooth video results
- Some questions about Teddataset HOT 1
- your colab brings a ton of errors.
- Why do your images work pretty well but my images make the result very bad
- When training, does the input image pixel size need to be consistent?
- What source images do you use to compute IoU for co-part segmentation (Section 4.5) in the paper?
- from skimage.draw import circle ImportError: cannot import name 'circle' from 'skimage.draw' (/home/onur/.local/lib/python3.9/site-packages/skimage/draw/__init__.py) HOT 4
- Discriminator module
- Git LFS quota limit HOT 2
- Dataset request
- RuntimeError: Error(s) in loading state_dict for Generator: size mismatch for pixelwise_flow_predictor.hourglass.encoder.down_blocks.0.conv.weight: copying a param with shape torch.Size([128, 44, 3, 3]) from checkpoint, the shape in current model is torch.Size([128, 84, 3, 3]). HOT 4
- How to get the ted-youtube384.pth ? HOT 1
- Disentanglement is not good
- Regarding the start and End time of the videos HOT 1
- Not able to fine tune ted-youtube384.pth model. HOT 9
- what should i do to test the cloth swap
- youtube-dl problem HOT 4
- Question: which Python 3 versions can I use with this repo?
- PermissionError: [Errno 13] Permission denied: './youtube-dl' HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from articulated-animation.