thevasudevgupta / gsoc-wav2vec2

GSoC'2021 | TensorFlow implementation of Wav2Vec2
https://thevasudevgupta.github.io/gsoc-wav2vec2/assets/final_report
Apache License 2.0
88 stars 29 forks source link

Feedback on the fine-tuning notebook #7

Closed sayakpaul closed 3 years ago

sayakpaul commented 3 years ago

@vasudevgupta7 great work thus far. Here ate some more pointers.

"How to train TensorFlow saved-model with extra head", I suggest "Fine-tuning with an extra head".

"In this notebook, we will load the pre-trained wav2vec2 model from TFHub and will train it on LibriSpeech dataset by appending LM head over the top of our pre-trained model.", I suggest something like -

In this notebook, we will load the pre-trained wav2vec2 model from TFHub (should be a link to the model when available) and will train it on LibriSpeech dataset by appending LM head over the top of our pre-trained model. The underlying task is to ...

"You can also refer to this repositary for some more amazing tutorials on speech-related tasks. In case you encountered any bug in this notebook, please create an issue here."

Typo.

Additional feedback:

Cc: @MorganR