microsoft / nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
https://nni.readthedocs.io
MIT License
13.88k stars 1.81k forks source link

the trialId is different with the trialId displayed in openpai #4813

Open racso10 opened 2 years ago

racso10 commented 2 years ago

Describe the issue:

When I submit a trial to openpai using nni, the trialId is different with the trialId displayed in openpai. Please ignore the error of trail failed, which is caused by my program. I note assigning environment ysqsa to trial Vj7Kl in nnimanager.log, in whichysqsa is shown in openpai, and Vj7Kl is shown in nni web page.

Environment:

Configuration:

Log message:

 - dispatcher.log:

[2022-04-26 21:40:29] INFO (nni.runtime.msg_dispatcher_base/MainThread) Dispatcher started [2022-04-26 21:40:29] ERROR (nni.common.hpo_utils.validation/Thread-1) search space "combine_params" (choice) should only contain numbers or strings : OrderedDict([('_type', 'choice'), ('_value', [OrderedDict([('view_n_old', 2)]), OrderedDict([('view_n_old', 3)]), OrderedDict([('view_n_old', 4)])])])


 - nnictl stdout and stderr:

<!--
Where can you find the log files:
LOG: https://github.com/microsoft/nni/blob/master/docs/en_US/Tutorial/HowToDebug.md#experiment-root-director
STDOUT/STDERR: https://github.com/microsoft/nni/blob/master/docs/en_US/Tutorial/Nnictl.md#nnictl%20log%20stdout
-->

**How to reproduce it?**:
racso10 commented 2 years ago

Or, how can I get the trailId displayed in openpai by some command like nni.get_experiment_id() or get_trial_id()?