DSGT-DLP / Deep-Learning-Playground

Web Application where people new to Deep Learning can input a dataset and toy around with basic Pytorch modules without writing any code

MIT License

24 stars 8 forks source link

Implemented custom dataset creator class #962

Open NMBridges opened 1 year ago

NMBridges commented 1 year ago

Added CustomDatasetCreator class

What user problem are we solving?

913

What solution does this PR provide? Allows backend to use user-uploaded tabular datasets for training Testing Methodology Uploaded testing dataset to dlp-upload-bucket/nolan/tabular/antennae-lengths.csv. Performed function call on endpoint and verified that the data was preserved during download. Also implemented automatic string encoding for non-numeric labels.

Any other considerations

NMBridges commented 1 year ago

teehee = CustomDatasetCreator.read_s3("nolan", "antennae-length.csv", 0.2, "label", True)
train = teehee.createTrainDataset()
test = teehee.createTestDataset()