DSGT-DLP / Deep-Learning-Playground

Web Application where people new to Deep Learning can input a dataset and toy around with basic Pytorch modules without writing any code
MIT License
24 stars 8 forks source link

Integrate UrbanSoundDataset for Audio Data Processing #1179

Open codingwithsurya opened 4 months ago

codingwithsurya commented 4 months ago

adding urbansound-dataset and schemas.py

Github Issue Number Here: <ntegrate UrbanSoundDataset for Audio Trainspace #1156> What user problem are we solving? We are enhancing the Deep Learning Playground's capabilities to include audio data processing by integrating the UrbanSound8K dataset. This allows users to work with audio data seamlessly within the existing pipeline, expanding the versatility and application of the platform.

What solution does this PR provide? This PR adds a new class, UrbanSoundDataset, to the training/core/dataset.py module. This class encapsulates functionalities for data ingestion, preprocessing, and loading specifically tailored for the UrbanSound8K dataset. It includes dataCreator, train_loader, and test_loader methods to facilitate efficient data loading into the model for training and testing. Additionally, it ensures compatibility with PyTorch's DataLoader mechanism and integrates smoothly with the existing training pipeline.

It also provides a schemas.py file that provides audio params. This file is still a WIP.

Testing Methodology

How did you test your changes and verify that existing functionality is not broken manual testing

Any other considerations Updated schemas.py to include AudioParams for defining non-tunable parameters specific to the UrbanSound8K dataset.

we also added 2 new dependencies to poetry -- torchaudio and soundata

sonarcloud[bot] commented 4 months ago

Quality Gate Passed Quality Gate passed

Issues
10 New issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarCloud

codingwithsurya commented 4 months ago

looks like one of the lints are failing. weird. @karkir0003 @DSGT-DLP/project-lead

the error message is this: Note: This error originates from the build backend, and is likely not a problem with poetry but with simpleaudio (1.0.4) not supporting PEP 517 builds. You can verify this by running 'pip wheel --no-cache-dir --use-pep517 "simpleaudio (==1.0.4)"'. Error: Process completed with exit code 1.

We just added torchaudio and soundata libraries in this pr to poetry so bc of that.

karkir0003 commented 4 months ago

looks like one of the lints are failing. weird. @karkir0003 @DSGT-DLP/project-lead

the error message is this: Note: This error originates from the build backend, and is likely not a problem with poetry but with simpleaudio (1.0.4) not supporting PEP 517 builds. You can verify this by running 'pip wheel --no-cache-dir --use-pep517 "simpleaudio (==1.0.4)"'. Error: Process completed with exit code 1.

We just added torchaudio and soundata libraries in this pr to poetry so bc of that.

whats simpleaudio? is this a lib thats a dependency used by soundata?

karkir0003 commented 4 months ago

did we install the latest stable version of torchaudio and soundata?

karkir0003 commented 4 months ago

looks like one of the lints are failing. weird. @karkir0003 @DSGT-DLP/project-lead

the error message is this: Note: This error originates from the build backend, and is likely not a problem with poetry but with simpleaudio (1.0.4) not supporting PEP 517 builds. You can verify this by running 'pip wheel --no-cache-dir --use-pep517 "simpleaudio (==1.0.4)"'. Error: Process completed with exit code 1.

We just added torchaudio and soundata libraries in this pr to poetry so bc of that.

I'd try starting the debugging with the following:

  1. Try running the command that's shown in the log. See if any further logs come up
  2. Maybe we might need to find a compatible version of soundata or potentially add simpleaudio as a dependency just like how you used DLP CLI to install torchaudio
  3. If 1 and 2 don't work, try asking in the poetry github repo by filing a github issue. There's also a discord server for Poetry that can help clarify
codingwithsurya commented 4 months ago

looks like one of the lints are failing. weird. @karkir0003 @DSGT-DLP/project-lead the error message is this: Note: This error originates from the build backend, and is likely not a problem with poetry but with simpleaudio (1.0.4) not supporting PEP 517 builds. You can verify this by running 'pip wheel --no-cache-dir --use-pep517 "simpleaudio (==1.0.4)"'. Error: Process completed with exit code 1. We just added torchaudio and soundata libraries in this pr to poetry so bc of that.

whats simpleaudio? is this a lib thats a dependency used by soundata?

still tryna figure this one out. i went through the logs and couldnt find any hints

codingwithsurya commented 4 months ago

did we install the latest stable version of torchaudio and soundata?

yup i double checked. i just ran dlp-cli backend add ____

codingwithsurya commented 4 months ago

looks like one of the lints are failing. weird. @karkir0003 @DSGT-DLP/project-lead the error message is this: Note: This error originates from the build backend, and is likely not a problem with poetry but with simpleaudio (1.0.4) not supporting PEP 517 builds. You can verify this by running 'pip wheel --no-cache-dir --use-pep517 "simpleaudio (==1.0.4)"'. Error: Process completed with exit code 1. We just added torchaudio and soundata libraries in this pr to poetry so bc of that.

I'd try starting the debugging with the following:

  1. Try running the command that's shown in the log. See if any further logs come up
  2. Maybe we might need to find a compatible version of soundata or potentially add simpleaudio as a dependency just like how you used DLP CLI to install torchaudio
  3. If 1 and 2 don't work, try asking in the poetry github repo by filing a github issue. There's also a discord server for Poetry that can help clarify

alright bet sounds good

karkir0003 commented 4 months ago

@codingwithsurya , looks like someone from poetry responded to this thread I created and shared with you in discord: https://github.com/orgs/python-poetry/discussions/9418

codingwithsurya commented 4 months ago

https://github.com/orgs/python-poetry/discussions/9418

ok. we can add it as a dependency then.

karkir0003 commented 4 months ago

https://github.com/orgs/python-poetry/discussions/9418

ok. we can add it as a dependency then.

let's give this a try and see if that works @codingwithsurya