my nni repeats the same experiment.

Describe the issue: I'm experimenting with changing the nni tutorial(mnist) a bit.

I expected to perform hyperparameter search as many as the number of 'search_space.jsom' cases I set. However, several of the nni results have the same hyper-parameter and show the same results.

Environment:

NNI version: 2.6.1
Training service (local|remote|pai|aml|etc):
Client OS:
Server OS (for remote mode only):
Python version:
PyTorch/TensorFlow version:
Is conda/virtualenv/venv used?:
Is running in Docker?:

Configuration: here is my 'config.yml'


searchSpaceFile: search_space.json
trialCommand: python3 ../train.py --epoch 5  # NOTE: change "python3" to "python" if you are using Windows
trialGpuNumber: 0
trialConcurrency: 1
tuner:
  name: TPE
  classArgs:
    optimize_mode: maximize
trainingService:
  platform: local

my 'search_space.json'

{
    "batch_size": {"_type":"choice", "_value": [16, 20, 32, 64]},
    "lr":{"_type":"choice","_value":[0.0001, 0.001, 0.01, 0.1]},
    "optimizer":{"_type":"choice","_value":["Adam", "SGD"]},
    "criterion":{"_type":"choice","_value":["cross_entropy", "focal", "label_smoothing"]}
}

Log message:

nnimanager.log:


[2022-03-03 15:25:19] INFO (NNIDataStore) Datastore initialization done
[2022-03-03 15:25:19] INFO (RestServer) RestServer start
[2022-03-03 15:25:20] INFO (RestServer) RestServer base port is 8080
[2022-03-03 15:25:20] INFO (main) Rest server listening on: http://0.0.0.0:8080
[2022-03-03 15:25:20] INFO (NNIManager) Starting experiment: faizthyg
[2022-03-03 15:25:20] INFO (NNIManager) Setup training service...
[2022-03-03 15:25:20] INFO (LocalTrainingService) Construct local machine training service.
[2022-03-03 15:25:20] INFO (NNIManager) Setup tuner...
[2022-03-03 15:25:20] INFO (NNIManager) Change NNIManager status from: INITIALIZED to: RUNNING
[2022-03-03 15:25:20] INFO (NNIManager) Add event listeners
[2022-03-03 15:25:20] INFO (LocalTrainingService) Run local machine training service.
[2022-03-03 15:25:21] INFO (NNIManager) NNIManager received command from dispatcher: ID, 
[2022-03-03 15:25:21] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 0, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.0001, "optimizer": "SGD", "criterion": "cross_entropy"}, "parameter_index": 0}
[2022-03-03 15:25:25] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 0,
hyperParameters: {
value: '{"parameter_id": 0, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.0001, "optimizer": "SGD", "criterion": "cross_entropy"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-03 15:25:35] INFO (NNIManager) Trial job AJY3T status changed from WAITING to RUNNING
[2022-03-03 16:28:05] INFO (NNIManager) Trial job AJY3T status changed from RUNNING to SUCCEEDED
[2022-03-03 16:28:05] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 1, "parameter_source": "algorithm", "parameters": {"batch_size": 32, "lr": 0.01, "optimizer": "Adam", "criterion": "focal"}, "parameter_index": 0}
[2022-03-03 16:28:10] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 1,
hyperParameters: {
value: '{"parameter_id": 1, "parameter_source": "algorithm", "parameters": {"batch_size": 32, "lr": 0.01, "optimizer": "Adam", "criterion": "focal"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-03 16:28:15] INFO (NNIManager) Trial job ISISc status changed from WAITING to RUNNING
[2022-03-03 18:11:18] INFO (NNIManager) Trial job ISISc status changed from RUNNING to SUCCEEDED
[2022-03-03 18:11:18] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 2, "parameter_source": "algorithm", "parameters": {"batch_size": 64, "lr": 0.01, "optimizer": "Adam", "criterion": "focal"}, "parameter_index": 0}
[2022-03-03 18:11:23] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 2,
hyperParameters: {
value: '{"parameter_id": 2, "parameter_source": "algorithm", "parameters": {"batch_size": 64, "lr": 0.01, "optimizer": "Adam", "criterion": "focal"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-03 18:11:28] INFO (NNIManager) Trial job HpJl4 status changed from WAITING to RUNNING
[2022-03-03 19:09:40] INFO (NNIManager) Trial job HpJl4 status changed from RUNNING to SUCCEEDED
[2022-03-03 19:09:40] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 3, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.1, "optimizer": "SGD", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-03 19:09:45] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 3,
hyperParameters: {
value: '{"parameter_id": 3, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.1, "optimizer": "SGD", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-03 19:09:50] INFO (NNIManager) Trial job rkxWa status changed from WAITING to RUNNING
[2022-03-03 20:10:55] INFO (NNIManager) Trial job rkxWa status changed from RUNNING to SUCCEEDED
[2022-03-03 20:10:55] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 4, "parameter_source": "algorithm", "parameters": {"batch_size": 64, "lr": 0.001, "optimizer": "Adam", "criterion": "cross_entropy"}, "parameter_index": 0}
[2022-03-03 20:11:00] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 4,
hyperParameters: {
value: '{"parameter_id": 4, "parameter_source": "algorithm", "parameters": {"batch_size": 64, "lr": 0.001, "optimizer": "Adam", "criterion": "cross_entropy"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-03 20:11:05] INFO (NNIManager) Trial job liBHV status changed from WAITING to RUNNING
[2022-03-03 21:09:11] INFO (NNIManager) Trial job liBHV status changed from RUNNING to SUCCEEDED
[2022-03-03 21:09:11] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 5, "parameter_source": "algorithm", "parameters": {"batch_size": 32, "lr": 0.0001, "optimizer": "Adam", "criterion": "focal"}, "parameter_index": 0}
[2022-03-03 21:09:16] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 5,
hyperParameters: {
value: '{"parameter_id": 5, "parameter_source": "algorithm", "parameters": {"batch_size": 32, "lr": 0.0001, "optimizer": "Adam", "criterion": "focal"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-03 21:09:22] INFO (NNIManager) Trial job f3Ihr status changed from WAITING to RUNNING
[2022-03-03 22:28:43] INFO (NNIManager) Trial job f3Ihr status changed from RUNNING to SUCCEEDED
[2022-03-03 22:28:43] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 6, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.0001, "optimizer": "Adam", "criterion": "cross_entropy"}, "parameter_index": 0}
[2022-03-03 22:28:48] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 6,
hyperParameters: {
value: '{"parameter_id": 6, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.0001, "optimizer": "Adam", "criterion": "cross_entropy"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-03 22:28:53] INFO (NNIManager) Trial job BB0cP status changed from WAITING to RUNNING
[2022-03-04 00:05:43] INFO (NNIManager) Trial job BB0cP status changed from RUNNING to SUCCEEDED
[2022-03-04 00:05:43] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 7, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.01, "optimizer": "Adam", "criterion": "cross_entropy"}, "parameter_index": 0}
[2022-03-04 00:05:48] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 7,
hyperParameters: {
value: '{"parameter_id": 7, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.01, "optimizer": "Adam", "criterion": "cross_entropy"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 00:05:53] INFO (NNIManager) Trial job mKs1p status changed from WAITING to RUNNING
[2022-03-04 02:47:40] INFO (NNIManager) Trial job mKs1p status changed from RUNNING to SUCCEEDED
[2022-03-04 02:47:40] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 8, "parameter_source": "algorithm", "parameters": {"batch_size": 32, "lr": 0.01, "optimizer": "SGD", "criterion": "focal"}, "parameter_index": 0}
[2022-03-04 02:47:45] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 8,
hyperParameters: {
value: '{"parameter_id": 8, "parameter_source": "algorithm", "parameters": {"batch_size": 32, "lr": 0.01, "optimizer": "SGD", "criterion": "focal"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 02:47:50] INFO (NNIManager) Trial job n339K status changed from WAITING to RUNNING
[2022-03-04 03:53:22] INFO (NNIManager) Trial job n339K status changed from RUNNING to SUCCEEDED
[2022-03-04 03:53:22] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 9, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "SGD", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-04 03:53:27] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 9,
hyperParameters: {
value: '{"parameter_id": 9, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "SGD", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 03:53:32] INFO (NNIManager) Trial job W2u1d status changed from WAITING to RUNNING
[2022-03-04 05:08:48] INFO (NNIManager) Trial job W2u1d status changed from RUNNING to SUCCEEDED
[2022-03-04 05:08:48] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 10, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.1, "optimizer": "SGD", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-04 05:08:53] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 10,
hyperParameters: {
value: '{"parameter_id": 10, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.1, "optimizer": "SGD", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 05:08:58] INFO (NNIManager) Trial job sobUX status changed from WAITING to RUNNING
[2022-03-04 06:11:03] INFO (NNIManager) Trial job sobUX status changed from RUNNING to SUCCEEDED
[2022-03-04 06:11:03] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 11, "parameter_source": "algorithm", "parameters": {"batch_size": 64, "lr": 0.0001, "optimizer": "SGD", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-04 06:11:08] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 11,
hyperParameters: {
value: '{"parameter_id": 11, "parameter_source": "algorithm", "parameters": {"batch_size": 64, "lr": 0.0001, "optimizer": "SGD", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 06:11:13] INFO (NNIManager) Trial job qJg6Z status changed from WAITING to RUNNING
[2022-03-04 07:07:05] INFO (NNIManager) Trial job qJg6Z status changed from RUNNING to SUCCEEDED
[2022-03-04 07:07:05] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 12, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.0001, "optimizer": "Adam", "criterion": "cross_entropy"}, "parameter_index": 0}
[2022-03-04 07:07:10] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 12,
hyperParameters: {
value: '{"parameter_id": 12, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.0001, "optimizer": "Adam", "criterion": "cross_entropy"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 07:07:15] INFO (NNIManager) Trial job ceKjF status changed from WAITING to RUNNING
[2022-03-04 08:44:09] INFO (NNIManager) Trial job ceKjF status changed from RUNNING to SUCCEEDED
[2022-03-04 08:44:09] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 13, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.01, "optimizer": "Adam", "criterion": "focal"}, "parameter_index": 0}
[2022-03-04 08:44:14] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 13,
hyperParameters: {
value: '{"parameter_id": 13, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.01, "optimizer": "Adam", "criterion": "focal"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 08:44:19] INFO (NNIManager) Trial job aiJoy status changed from WAITING to RUNNING
[2022-03-04 11:08:02] INFO (NNIManager) Trial job aiJoy status changed from RUNNING to SUCCEEDED
[2022-03-04 11:08:02] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 14, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.1, "optimizer": "SGD", "criterion": "cross_entropy"}, "parameter_index": 0}
[2022-03-04 11:08:07] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 14,
hyperParameters: {
value: '{"parameter_id": 14, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.1, "optimizer": "SGD", "criterion": "cross_entropy"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 11:08:12] INFO (NNIManager) Trial job qD4vF status changed from WAITING to RUNNING
[2022-03-04 12:09:22] INFO (NNIManager) Trial job qD4vF status changed from RUNNING to SUCCEEDED
[2022-03-04 12:09:22] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 15, "parameter_source": "algorithm", "parameters": {"batch_size": 64, "lr": 0.1, "optimizer": "Adam", "criterion": "cross_entropy"}, "parameter_index": 0}
[2022-03-04 12:09:27] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 15,
hyperParameters: {
value: '{"parameter_id": 15, "parameter_source": "algorithm", "parameters": {"batch_size": 64, "lr": 0.1, "optimizer": "Adam", "criterion": "cross_entropy"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 12:09:32] INFO (NNIManager) Trial job GlHiE status changed from WAITING to RUNNING
[2022-03-04 13:58:27] INFO (NNIManager) Trial job GlHiE status changed from RUNNING to SUCCEEDED
[2022-03-04 13:58:27] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 16, "parameter_source": "algorithm", "parameters": {"batch_size": 32, "lr": 0.0001, "optimizer": "Adam", "criterion": "cross_entropy"}, "parameter_index": 0}
[2022-03-04 13:58:32] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 16,
hyperParameters: {
value: '{"parameter_id": 16, "parameter_source": "algorithm", "parameters": {"batch_size": 32, "lr": 0.0001, "optimizer": "Adam", "criterion": "cross_entropy"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 13:58:37] INFO (NNIManager) Trial job tsk6H status changed from WAITING to RUNNING
[2022-03-04 15:17:08] INFO (NNIManager) Trial job tsk6H status changed from RUNNING to SUCCEEDED
[2022-03-04 15:17:08] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 17, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.01, "optimizer": "Adam", "criterion": "focal"}, "parameter_index": 0}
[2022-03-04 15:17:13] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 17,
hyperParameters: {
value: '{"parameter_id": 17, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.01, "optimizer": "Adam", "criterion": "focal"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 15:17:18] INFO (NNIManager) Trial job Evp6p status changed from WAITING to RUNNING
[2022-03-04 18:46:54] INFO (NNIManager) Trial job Evp6p status changed from RUNNING to SUCCEEDED
[2022-03-04 18:46:54] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 18, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-04 18:46:59] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 18,
hyperParameters: {
value: '{"parameter_id": 18, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 18:47:04] INFO (NNIManager) Trial job BH0KD status changed from WAITING to RUNNING
[2022-03-04 20:20:48] INFO (NNIManager) Trial job BH0KD status changed from RUNNING to SUCCEEDED
[2022-03-04 20:20:48] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 19, "parameter_source": "algorithm", "parameters": {"batch_size": 32, "lr": 0.001, "optimizer": "SGD", "criterion": "focal"}, "parameter_index": 0}
[2022-03-04 20:20:53] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 19,
hyperParameters: {
value: '{"parameter_id": 19, "parameter_source": "algorithm", "parameters": {"batch_size": 32, "lr": 0.001, "optimizer": "SGD", "criterion": "focal"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 20:20:58] INFO (NNIManager) Trial job Msh6p status changed from WAITING to RUNNING
[2022-03-04 21:19:49] INFO (NNIManager) Trial job Msh6p status changed from RUNNING to SUCCEEDED
[2022-03-04 21:19:49] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 20, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-04 21:19:54] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 20,
hyperParameters: {
value: '{"parameter_id": 20, "parameter_source": "algorithm", "parameters": {"batch_size": 20, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 21:19:59] INFO (NNIManager) Trial job VNlsz status changed from WAITING to RUNNING
[2022-03-04 22:53:29] INFO (NNIManager) Trial job VNlsz status changed from RUNNING to SUCCEEDED
[2022-03-04 22:53:29] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 21, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-04 22:53:34] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 21,
hyperParameters: {
value: '{"parameter_id": 21, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-04 22:53:39] INFO (NNIManager) Trial job JCs5X status changed from WAITING to RUNNING
[2022-03-05 00:57:36] INFO (NNIManager) Trial job JCs5X status changed from RUNNING to SUCCEEDED
[2022-03-05 00:57:36] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 22, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-05 00:57:41] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 22,
hyperParameters: {
value: '{"parameter_id": 22, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-05 00:57:46] INFO (NNIManager) Trial job cRrMd status changed from WAITING to RUNNING
[2022-03-05 03:01:29] INFO (NNIManager) Trial job cRrMd status changed from RUNNING to SUCCEEDED
[2022-03-05 03:01:29] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 23, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-05 03:01:34] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 23,
hyperParameters: {
value: '{"parameter_id": 23, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-05 03:01:39] INFO (NNIManager) Trial job hy705 status changed from WAITING to RUNNING
[2022-03-05 05:24:12] INFO (NNIManager) Trial job hy705 status changed from RUNNING to SUCCEEDED
[2022-03-05 05:24:12] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 24, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-05 05:24:17] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 24,
hyperParameters: {
value: '{"parameter_id": 24, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-05 05:24:22] INFO (NNIManager) Trial job mWgQd status changed from WAITING to RUNNING
[2022-03-05 07:28:30] INFO (NNIManager) Trial job mWgQd status changed from RUNNING to SUCCEEDED
[2022-03-05 07:28:30] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 25, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-05 07:28:35] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 25,
hyperParameters: {
value: '{"parameter_id": 25, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-05 07:28:40] INFO (NNIManager) Trial job RWKm5 status changed from WAITING to RUNNING
[2022-03-05 09:32:52] INFO (NNIManager) Trial job RWKm5 status changed from RUNNING to SUCCEEDED
[2022-03-05 09:32:52] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 26, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-05 09:32:57] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 26,
hyperParameters: {
value: '{"parameter_id": 26, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-05 09:33:02] INFO (NNIManager) Trial job BIkuG status changed from WAITING to RUNNING
[2022-03-05 11:56:00] INFO (NNIManager) Trial job BIkuG status changed from RUNNING to SUCCEEDED
[2022-03-05 11:56:00] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 27, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-05 11:56:05] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 27,
hyperParameters: {
value: '{"parameter_id": 27, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-05 11:56:10] INFO (NNIManager) Trial job ZdrPX status changed from WAITING to RUNNING
[2022-03-05 14:00:48] INFO (NNIManager) Trial job ZdrPX status changed from RUNNING to SUCCEEDED
[2022-03-05 14:00:48] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 28, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-05 14:00:53] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 28,
hyperParameters: {
value: '{"parameter_id": 28, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-05 14:00:58] INFO (NNIManager) Trial job wXEwB status changed from WAITING to RUNNING
[2022-03-05 16:05:21] INFO (NNIManager) Trial job wXEwB status changed from RUNNING to SUCCEEDED
[2022-03-05 16:05:21] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 29, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-05 16:05:26] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 29,
hyperParameters: {
value: '{"parameter_id": 29, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-05 16:05:31] INFO (NNIManager) Trial job BB4g9 status changed from WAITING to RUNNING
[2022-03-05 18:08:54] INFO (NNIManager) Trial job BB4g9 status changed from RUNNING to SUCCEEDED
[2022-03-05 18:08:54] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 30, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-05 18:08:59] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 30,
hyperParameters: {
value: '{"parameter_id": 30, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-05 18:09:04] INFO (NNIManager) Trial job vLXlI status changed from WAITING to RUNNING
[2022-03-05 20:12:42] INFO (NNIManager) Trial job vLXlI status changed from RUNNING to SUCCEEDED
[2022-03-05 20:12:42] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 31, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-05 20:12:47] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 31,
hyperParameters: {
value: '{"parameter_id": 31, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-05 20:12:52] INFO (NNIManager) Trial job QQtZ8 status changed from WAITING to RUNNING
[2022-03-05 22:16:40] INFO (NNIManager) Trial job QQtZ8 status changed from RUNNING to SUCCEEDED
[2022-03-05 22:16:40] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 32, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-05 22:16:45] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 32,
hyperParameters: {
value: '{"parameter_id": 32, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.0001, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-05 22:16:50] INFO (NNIManager) Trial job VFFh7 status changed from WAITING to RUNNING
[2022-03-06 00:20:03] INFO (NNIManager) Trial job VFFh7 status changed from RUNNING to SUCCEEDED
[2022-03-06 00:20:03] INFO (NNIManager) NNIManager received command from dispatcher: TR, {"parameter_id": 33, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.1, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}
[2022-03-06 00:20:08] INFO (NNIManager) submitTrialJob: form: {
sequenceId: 33,
hyperParameters: {
value: '{"parameter_id": 33, "parameter_source": "algorithm", "parameters": {"batch_size": 16, "lr": 0.1, "optimizer": "Adam", "criterion": "label_smoothing"}, "parameter_index": 0}',
index: 0
},
placementConstraint: { type: 'None', gpus: [] }
}
[2022-03-06 00:20:13] INFO (NNIManager) Trial job jI5Vp status changed from WAITING to RUNNING

microsoft / nni

my nni repeats the same experiment. #4619