Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Train for Chinese speech #6

Open
Olivia-Ye opened this issue Apr 12, 2022 · 3 comments
Open

Train for Chinese speech #6

Olivia-Ye opened this issue Apr 12, 2022 · 3 comments

Comments

@Olivia-Ye
Copy link

I want to train on Chinese speeches. But I don't know how to convert the speech videos to the type that used for training. Could u public the processing codes for raw video?
Another question confused me is that how to generate the figure in the middle in the follow picture? I have followed Readme to complete the generation for the figure on the left side of the follow picture.
))@BEP@{2)KL}9EL@QX7IXH
And it would be better if you could provide a contrast way for our discussor.
Thanks so much.

@TheTempAccount
Copy link
Owner

You can use OpenPose or AlphaPose to get the body keypoints in OpenPose format. To generate the figure in the middle you need to train a rendering model such as Vid2Vid.

@Olivia-Ye
Copy link
Author

Thanks for your reply.
I still have a question that whether it is possible to apply the pretrained model you have provided to Chinese speeches. It’s a significant issue which decided the points of the following work that I plan to do .
Can you set up a discussion group for the discussants to help everyone solve problems?

@XuJianzhi
Copy link

I want to train on Chinese speeches. But I don't know how to convert the speech videos to the type that used for training. Could u public the processing codes for raw video? Another question confused me is that how to generate the figure in the middle in the follow picture? I have followed Readme to complete the generation for the figure on the left side of the follow picture. ))@BEP@{2)KL}9EL@QX7IXH And it would be better if you could provide a contrast way for our discussor. Thanks so much.

老哥你好,请问直接用他给的模型+中文,生成效果能用吗?
我没有能力训中文,如果您试过,效果不好,我就不试了
谢谢!

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants