Add Optuna Seed to Checkpoint

triton-inference-server / model_analyzer

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

Apache License 2.0

423 stars 74 forks source link

Add Optuna Seed to Checkpoint #913

Closed nv-braf closed 2 months ago

nv-braf commented 2 months ago

Adds the seed used in Optuna to the checkpoint file. This seed is then read back anytime a checkpoint exists ensuring that we take the same path through the search algorithm for subsequent runs.

There's not an easy way to unit test this, but I have confirmed this works via a live run on my local machine (and we now have CI tests protecting Optuna).