search

awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference
Apache License 2.0
998 stars 230 forks source link

Production JVM server configuration #788

Open vdantu opened 5 years ago

vdantu commented 5 years ago

Check if there are better JVM config values that can be used. There are guidelines published by oracle for JVM GC configurations in production setup

https://docs.oracle.com/cd/E40972_01/doc.70/e40973/cnf_jvmgc.htm#autoId0