Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrating with tacotron 1 #19

Open
the6thsense opened this issue Aug 16, 2022 · 3 comments
Open

Integrating with tacotron 1 #19

the6thsense opened this issue Aug 16, 2022 · 3 comments

Comments

@the6thsense
Copy link

I am trying to integrate this model to tacotron 1 for TTS but since I do not have corresponding exact audios that are to be generated from the tacotron's output mel spectrogram, how should I go about training the model. When I try to pass the speaker audio from data and its corresponding generated mel-spectrogram from tacotron, I get the error due to assertion: assert in_length == (kernel_length * hop_size). Please let me know if I am missing out something. Or otherwise what should be the strategy to train model to learn to decipher model generated spectrograms.

@the6thsense
Copy link
Author

Please help me in this matter.

@Rongjiehuang
Copy link
Owner

The LJSpeech checkpoint for neural vocoding of tacotron2 output and the corresponding script has been provided. Please refer to https://github.com/Rongjiehuang/FastDiff/#using-tacotron. If you want to train FastDiff(Tacotron) by yourself, use this config: modules/FastDiff/config/FastDiff_tacotron.yaml

@the6thsense
Copy link
Author

I am using it in a different configuration and facing issues. Can you please let due to this line assert in_length == (kernel_length * hop_size). I have an entirely different configuration. Where should I look into. As the output spectrogram is produced which might or might not be the size of kernel_length*hope_size where kernel length is derived from the input audio which is not directly related to shape of generated spectrogram while training. Please help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants