Issue Memory Error - Githubissues

cjiang2 / VDCNN

Implementation of Very Deep Convolutional Neural Network for Text Classification

171 stars 41 forks source link

Issue Memory Error #6

Closed athn-nik closed 3 years ago

athn-nik commented 6 years ago

I am getting a Memory Error when trying to run for yahoo answers dataset!I ll try to merge in dataset api in order to cache batches and not the whole dataset into memory.If i get through this maybe I ll fork from yours and contribute to repo!(The bug isn't sprecified exactly because what I get is Memory Error and not something more indicative)

cjiang2 commented 6 years ago

Hi @nathan74 Yeah since most of those NLP datasets are having some serious sizes, MemoryError is definitely an issue. Also I only have one cloud machine, and I can only do so few tests per day. :( Let me know if you need the Collaborators access for cotributrion. It would be really nice to have some help. :)