Out of memory: unable to create new native thread

snuspl / cruise

Cruise: A Distributed Machine Learning Framework with Automatic System Configuration

Apache License 2.0

26 stars 2 forks source link

Open wynot12 opened 7 years ago

wynot12 commented 7 years ago

I've met an 'out of memory: unable to create new native thread' error, while running an NMF app in optiplex cluster.

It happens while starting model evaluation. I've met it only once, but let's keep it in mind.

yunseong commented 7 years ago

Thanks for the report!

Probably we are creating too many threads; i think it's time to look into the problem and come up with a better management on threads.

I'll think about it.

wynot12 commented 7 years ago

It looks that this error comes out when we run evaluators in master node, which already runs multiple Java processes for master of Hadoop and Yarn.