Jzow
commented
2 years ago environment：
windows 11 python3.8
Closed Jzow closed 2 years ago
Jzow
commented
2 years ago environment：
windows 11 python3.8
Jzow
commented
2 years ago When I changed to tts-tacotron2-ljspeech-en, The reasoning result is only half, and then it is not very complete. How should I configure it and how to do it? Here is my code
import soundfile as sf
import numpy as np
import tensorflow as tf
from tensorflow_tts.inference import AutoProcessor
from tensorflow_tts.inference import TFAutoModel
processor = AutoProcessor.from_pretrained("tensorspeech/tts-tacotron2-ljspeech-en")
tacotron2 = TFAutoModel.from_pretrained("tensorspeech/tts-tacotron2-ljspeech-en")
melgan = TFAutoModel.from_pretrained("tensorspeech/tts-melgan-ljspeech-en")
text = "A child's education has never been about learning information and basic skills only. It has always included teaching the next generation how to be good members of society. Therefore, this cannot be the responsibility of the parents alone. " \
"In order to be a good member of any society the individual must respect and obey the rules of their community and share their values. " \
"Educating children to understand the need to obey rules and respect others always begins in the home and is widely thought to be the responsibility of parents. " \
"They will certainly be the first to help children learn what is important in life, how they are expected to behave and what role they will play in the world. " \
"However, learning to understand and share the value system of a whole society cannot be achieved just in the home. " \
"Once a child goes to school, they are entering a wider community where teachers and peers will have just as much influence as their parents do at home. " \
"At school, children will experience working and living with people from a whole variety of backgrounds from the wider society. " \
"This experience should teach them how to co-operate with each other and how to contribute to the life of their community. " \
"But to be a valuable member of any community is not like learning a simple skill. " \
"It is something that an individual goes on learning throughout life and it is the responsibility of every member of every member of a society to take responsibility for helping the younger generation to become active and able members of that society."
input_ids = processor.text_to_sequence(text)
# tacotron2 inference (text-to-mel)
decoder_output, mel_outputs, stop_token_prediction, alignment_history = tacotron2.inference(
input_ids=tf.expand_dims(tf.convert_to_tensor(input_ids, dtype=tf.int32), 0),
input_lengths=tf.convert_to_tensor([len(input_ids)], tf.int32),
speaker_ids=tf.convert_to_tensor([0], dtype=tf.int32),
)
# melgan inference (mel-to-wav)
audio = melgan.inference(mel_outputs)[0, :, 0]
# save to file
sf.write('./audio.wav', audio, 22050, "PCM_16")
Educating children to understand the need to obey rules and respect others always begins in the home and is widely thought to be the responsibility of parents. They will certainly be the first to help children learn what is important in life, how they are expected to behave and what role they will play in the world.
However, learning to understand and share the value system of a whole society cannot be achieved just in the home. Once a child goes to school, they are entering a wider community where teachers and peers will have just as much influence as their parents do at home.
At school, children will experience working and living with people from a whole variety of backgrounds from the wider society. This experience should teach them how to co-operate with each other and how to contribute to the life of their community.
But to be a valuable member of any community is not like learning a simple skill. It is something that an individual goes on learning throughout life and it is the responsibility of every member of every member of a society to take responsibility for helping the younger generation to become active and able members of that society.