-
### Problem Statement
Currently there is no different log of v0.3 and v0.2 we should have to show the different
### Idea
Create such log (with table compare 1 by 1 different in phase etc) to have …
-
Thanks for your contributions to the opensource community. There is some confusion about the training code. In `anygpt/src/stage1_pretrain.py`, I only find that the image/speech/music data is loaded, …
-
### Describe the bug
This issue serves as a placeholder for the introduction of two recipes: full whisper pretraining and a speechLLM finetuning.
People potentially interested are added.
Anyone …
-
## ❓
NEED HELP/FIX ASAP
already logged issues.
#3683 : https://github.com/facebookresearch/fairseq/issues/3683
AssertionError: Could not infer task type from {'_name': 'temp_sampled_audio_pret…
-
Could you add a native speech to speech / audio-to-audio support with encoder (tokenizer) and decoder (back to audio waves)
I was able to implement a decoder only model, I first used audio codec to…
-
hello,
I am training a new `contentvec` model in order to replace the framework's `hubert` model with the newly trained `contentvec`.
However, when I tried to run the model created by learning wit…
-
#### What is your question?
I used the python method in the Funasr documentation for exporting ONNX models to try to export the ONNX of the pretrained model paraex-en-Streaming, but kept getting er…
-
AssertionError: Could not infer task type from {'_name': 'av_hubert_pretraining', 'is_s2s': True, 'data': '/checkpoint/bshi/data/lrs3//exp/ls-hubert/tune-modality/all_tsv/', 'label_dir': '/checkpoint/…
-
Hi there,
I am trying to load the downloaded Hubert Large with 960hr finetuning from here: https://github.com/pytorch/fairseq/tree/main/examples/hubert
I downloaded the model, stored the checkpo…
-
https://github.com/OpenMOSS/AnyGPT/blame/6404dbafccc10943be6bf6e24a4b99b3a6545501/anygpt/src/m_utils/prompter.py#L45
Hello,
Is this line correct? Is this for speech-to-speech conversation?
In tha…