FederatedAI / KubeFATE

Manage federated learning workload using cloud native technologies.
Apache License 2.0
420 stars 222 forks source link

kubefate serving proxy: unable to create new native thread #923

Open yuanbw opened 9 months ago

yuanbw commented 9 months ago

传统docker-compose方式QPS200压测时未出现该错误,但是通过helm chart部署后,20分钟左右serving proxy出现“unable to create new native thread",具体见https://github.com/FederatedAI/FATE-Serving/issues/207 @LaynePeng @dylan-fan @owlet42

owlet42 commented 7 months ago

这个看起来是内存不足,你需要给serving proxy的java分配更多可用内存

https://github.com/FederatedAI/KubeFATE/blob/2a8ce82ca08d454bce682219c65e581e4a8077a8/helm-charts/FATE-Serving/templates/serving-proxy-module.yaml#L174C106-L174C109

修改这个java命令,增大java的内存,然后重新部署在尝试新的压测