Any suggestion for large datasets?

oswaldoludwig / Seq2seq-Chatbot-for-Keras

This repository contains a new generative model of chatbot based on seq2seq modeling.

Apache License 2.0

331 stars 98 forks source link

Any suggestion for large datasets? #25

Closed iuria21 closed 5 years ago

iuria21 commented 5 years ago

Hi, I'm trying to train the chatbot with a large dataset, and my RAM it's getting out of memory. In addition, my dataset is in Spanish, so my word-vectors are of size 300. I've lowered the vocabulary size to 4000, but there's no way. (I have 64GB of RAM).

Thanks

iuria21 commented 5 years ago

sorry, found the solution in the Readme