mrzzm / hdtf Goto Github PK

@MRzzm
Hello
Thank you for the great job
Is it possible I get access to your code by any chance?
I have to replicate your result for comparison purpose
[email protected]
That is my gmail address.

Hi! Thank you for the dataset, it's really cool! While downloading, I found 2 issues with cropping:

1. Some clips do not contain any cropping information.
2. Some videos contain cropping for a 720p version of a video when a 1080p version is available on Youtube. And there is no way to decide, which version should I download, because cropping for other videos is designed for the 1080p version.

For the first issue, here is the list of videos that do not contain any cropping in their corresponding *_crop_wh.txt files:

• RD/Radio6_0.mp4
• RD/Radio15_0.mp4
• WDA/DeanPhillips_0.mp4
• WDA/JimMcGovern1_0.mp4
• WDA/JimMcGovern_0.mp4
• WDA/JeffMerkley0_0.mp4
• WDA/LindaSnchez_0.mp4
• WDA/ByronDorgan0_0.mp4
• WRA/BillCassidy_0.mp4
• WRA/MittRomney_1.mp4
• WRA/RudyGiuliani_0.mp4
• WRA/JaimeHerreraBeutler_0.mp4
• WRA/DuncanHunter_1.mp4
• WRA/KevinBrady0_0.mp4
• WRA/CandiceMiller_0.mp4

For the second issue, here is an example of a video (but there are others!), which I downloaded in 1080p (best available quality), cropped it and the resulted crop turned out to be inconsistent with such a high resolution (but was appropriate for 720p).

• RD/Radio28

Here is the comparison between cropping a 1080p resolution (left) or 720p (right) version of the video:

I download the video the following way:

youtube-dl https://youtube.com/watch?v=VrFpdKk1UJc --quiet -f bestvideo[ext=mp4][height=1080] --output /tmp/hdtf_check/_videos_raw/RD_Radio28.mp4 --no-continue

And then I cut and crop it the following way:

ffmpeg -i /tmp/hdtf_check/_videos_raw/RD_Radio28.mp4 -strict -2 -loglevel quiet -qscale 0 -y -ss 00:05 -to 01:35 -filter:v "crop=530:530:372:0" /tmp/hdtf_check/RD_Radio28_000.mp4

So right now, it is impossible to infer in which resolution (720p or 1080p) should I download each particular video. If I download each video in its best possible resolution and crop, then a lot of videos will have incorrect cropping:

Could you please provide missing crops and also the necessary resolution for each video?

Thank you for your great work!

Can I request the code for the 'Animation-to-video' part including appro dens flow calculation and flow guided video generator?

If possible, could you send me an email via the below address?

[email protected]

where to download sound

Hello ! Thanks for releasing the code of this excellent work ! How can i perform comparisons with your method under the setup of image driven talking face generation ? The released code may be not enough. How to generate flow from images without audio ?
Looking forward to your reply ! Thanks !

如题，请问作者是如何划分训练集和测试集的呢？

请问应该怎么生成reference_projected_mesh_points和drive_projected_mesh_points？

根据作者提供的项目，我从https://github.com/universome/HDTF下载数据集，但是下载下来的视频只有157个，这是正常的吗？

Hi Zhimeng, Thanks for providing the dataset urls. Will you release the inference code? Also, I couldn't find the video demo of your work that mentioned in the supplementary file. Can you share the link to it please? Thanks

Hi, thanks for your awesome work!!!
How can I obtain 3DMM coefficients (i.e., p_mou, p_ebro...) from image/video?
Or is there any reference code for this?

Thank you in advance.

Hi, could you share the download link for the dataset? I had some trouble downloading the dataset. Thank you very much.

您好，大佬，数据集 还有推理代码啥时候可以公开呀？

智勐，你好，
请教下，1.您在实际使用的时候，有没有把3dmm/或人脸关键点，直接渲染到虚拟3d卡通形象上？
2.您觉得加入文本进行训练，会不会明显提高算法的指标？

Hi I want to use this dataset, Can you please guide me how to download I tried to download using script but it fails.