dotnet / TorchSharp

A .NET library that provides access to the library that powers PyTorch.

MIT License

1.41k stars 183 forks source link

torchaudio support #1377

Open williamlzw opened 2 months ago

williamlzw commented 2 months ago

Are there any plans to support torchaudio, such as StreamReader and StreamWriter classes

yueyinqiu commented 2 months ago

Personally I think it won't be supported in the near future. NAudio might be a possible workaround?

GeorgeS2019 commented 2 months ago

https://github.com/dotnet/TorchSharp/tree/main/src/TorchAudio

I think we need to figure out how to connect NAudio to TorchSharp TorchAudio Audio I/O. There are .NET user controls for variety of spectrograms

[ ] Audio I/O

TorchAudio feasibility

https://github.com/dotnet/TorchSharp/discussions/598

[ ] Audio I/O
[x] Audio Resampling
[ ] Audio Data Augmentation
[x] Audio Feature Extractions
[ ] Audio Feature Augmentation
[x] Audio Datasets
[x] Speech Recognition with Wav2Vec2
[x] Speech Command Classification with torchaudio
[ ] Text-to-speech with torchaudio
[x] Text-to-speech with torchaudio: tacotron2

GeorgeS2019 commented 2 months ago

https://github.com/dotnet/TorchSharp/blob/main/test/TorchSharpTest/TestTorchAudio.cs

yueyinqiu commented 2 months ago

By the way, NAudio uses windows media player to support some audio formats, such as flac, which is not cross platform. (And even on Windows, some problems may happen, like the mis-calculation of audio length.) I think we need to deal with this carefully.

And @GeorgeS2019, it's really nice to find that you are still here. But it seems that @NiklasGustafsson isn't that active recently. Do you know what's going on?

NiklasGustafsson commented 2 months ago

But it seems that @NiklasGustafsson isn't that active recently. Do you know what's going on?

I am looking at the list every day...

There hasn't been a lot of issue activity at all since the release of v0.103.0, I've had some family things to deal with (a child's wedding, specifically), and I've had other projects to work on. TorchSharp is not my full-time job at Microsoft. That's what's going on. :-)

yueyinqiu commented 2 months ago

Wow! Congratulations!

GeorgeS2019 commented 2 months ago

@NiklasGustafsson @yueyinqiu

Many people are now going to be very curious about Torchsharp for Reinforcement Learning

https://github.com/dotnet/machinelearning/issues/181#issuecomment-2372238943

https://youtu.be/Aoyj7qzyung