search

TadasBaltrusaitis / OpenFace

OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.
Other
6.71k stars 1.82k forks source link

BLAS : Program is Terminated. Because you tried to allocate too many memory regions #1069

Open yyz845935161 opened 6 months ago

yyz845935161 commented 6 months ago

Describe the bug image BLAS : Program is Terminated. Because you tried to allocate too many memory regions

Desktop (please complete the following information):

pablotanner commented 2 months ago

@yyz845935161 Were you able to fix this?

kendrew06 commented 2 months ago

您的邮件我已收到，有需要会尽快回复This is an automatic reply, confirming that your e-mail was received.Thank you

brmarkus commented 2 months ago

@yyz845935161 @pablotanner can you confirm you are operating in a server environment, using one (or many CPUs) with a high number of CPU cores?

Can you try the following ideas in from these issues:

Can you try to reduce the number of threads with the environment variable export OMP_NUM_THREADS=1; if that helps, start to increase the number of threads.

pablotanner commented 2 months ago

@brmarkus Thanks for the reply! I found a similar issue where export OPENBLAS_NUM_THREADS=10 was suggested (guessing it's the same as your solution), which ended up working fine 😄

But yes, I was working on a Podman container which was running on a server with 512 CPU cores.

brmarkus commented 2 months ago

Have you found a sweet-spot for the number of threads, to make as many as possible CPU cores available under the "too many memory regions" constrain?

pablotanner commented 2 months ago

@brmarkus I think it depends on what you're trying to run, I was doing feature extraction which was working fine with 10 threads, but after adding some parameters in the CLI I was forced to increase it to 12 threads.