search

PrashantRanjan09 / WordEmbeddings-Elmo-Fasttext-Word2Vec

Using pre trained word embeddings (Fasttext, Word2Vec)
158 stars 31 forks source link

Allocation of 1258291200 exceeds 10% of system memory. Killed #4

Closed ghost closed 5 years ago

ghost commented 5 years ago

Hi,

I get the following error when I run the code. Any workaround for this?

2019-01-25 18:56:48.821520: W tensorflow/core/framework/allocator.cc:101] Allocation of 18454937600 exceeds 10% of system memory. 2019-01-25 18:56:48.821663: W tensorflow/core/framework/allocator.cc:101] Allocation of 1258291200 exceeds 10% of system memory. Killed .

I have already tried decreasing batch size but didn't help.

PrashantRanjan09 commented 5 years ago

@BuggyLife Looking at the error I think it has to do something with your data and memory allocation. Whats the size of data you are using and other params like dimensions etc.

Have you tried running it on a GPU. Not sure, but it may resolve the problem if its due to memory allocation.

SarangShaikh201 commented 5 years ago

I am also getting the same error as above. Can you please guide?

SarangShaikh201 commented 5 years ago

I m using default config

PrashantRanjan09 commented 5 years ago

@SarangShaikh201 @ghost: i think the problem is because of batch size being set to a little higher value. Try running the code with batch size = 16 or smaller value. Worst case try running it batch size = 1. Should solve the error.