Comments (4)
My dataset is private (1080p, no noise, The expression of the speaker is very normal, not too expressive) bs 128, 4 gpus tesla p100.
If you want, you can collect dataset from youtube and then process it
or you can use avspeech dataset: https://looking-to-listen.github.io/avspeech/download.html
from wav2lip_288x288.
It's so nice of you ,thank you for your reply! what's more, i want to know how big is your dataset? how many speakers in total, and which language did you use. if the dataset is very large , maybe i'll drop my idea about recording videos by myself. or can i record one person's video for a few hours to finetune the pretrained network (using avspeech) to get a better result?
from wav2lip_288x288.
I trained on 1080p, 10s per video, a person has multiple videos, my dataset is private because it's media production. as you said you can train avspeech dataset to get trained model and then finetune on your video
from wav2lip_288x288.
I trained on 1080p, 10s per video, a person has multiple videos, my dataset is private because it's media production. as you said you can train avspeech dataset to get trained model and then finetune on your video
ok, thank you for your help
from wav2lip_288x288.
Related Issues (20)
- Hi sir, I am a beginner and I would like to inquire whether I should prepare a video of no less than 288 or a video of 384
- Find friends who are training models and share ideas with them.Welcome HOT 3
- Train syncnet use SyncNet_color_384 but train wav2lip use SyncNet_color? HOT 1
- When I use hq_wav2lip_sam_train.py。 HOT 3
- DINet implementation HOT 1
- video clips length
- train_syncnet_sam.py is not using GPU (RTX 4090) HOT 1
- What indicator represents the end of training hq_wav2lip_sam_train? HOT 4
- Why my train loss after introducing sync loss? HOT 4
- How to train HOT 6
- Why can’t training start? HOT 4
- do inference
- Generated bottom half face always blur. HOT 2
- Training failed. The lip shape of a character cannot change according to changes in speech HOT 6
- Syncnet loss does not converge HOT 22
- dataset
- DINet HOT 1
- 这个和普通的easyw字幕交换网站lip有什么区别
- Use HuBERT features to train SyncNet, the loss does not converge. HOT 2
- structure and arrangement of dataset before executing any scrip with flow of script execution!!!!!!
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from wav2lip_288x288.