CharCNN runs out of system memory for large datasets like IMDB and Yelp as Castor does all of the pre-processing for the entire dataset at once and stores it in memory. Making the character quantization a part of the model, rather than dataset pre-processing would only quantize one batch at a time.
CharCNN runs out of system memory for large datasets like IMDB and Yelp as Castor does all of the pre-processing for the entire dataset at once and stores it in memory. Making the character quantization a part of the model, rather than dataset pre-processing would only quantize one batch at a time.