NNI Tuner system parameters for trial is different from nni.get_next_parameter() in every trial in tuner example code

[dzk9528]

Describe the issue:

Environment:

• NNI version: 3.0
• Training service local:
• Client OS: Ubuntu 22.04
• Python version: 3.10
• PyTorch version: 1.11.0
• Is conda/virtualenv/venv used?: No
• Is running in Docker?: Yes

Configuration:

• Experiment config:
• experiment.config.max_trial_number = 100
• experiment.config.trial_concurrency = 8
• Search space: Predefined search space
  • for each layer, the block can be different type

Log message:

• Web GUI:

• 

  • nnictl stdout and stderr:
  • stdout:

    [2023-10-11 23:59:01] INFO (nni.runtime.trial_command_channel.v3/MainThread) Connect to trial command channel http://localhost:9090/env/local-env/AUNKt
    [2023-10-11 23:59:01] PRINT {'features': 1024, 'lr': 0.0005644677962695111, 'momentum': 0.9973347380805804}
    [2023-10-11 23:59:01] PRINT Downloading http://fashion-mnist.s3-website.eu-central-1.amazonaws.com/train-images-idx3-ubyte.gz
    [2023-10-11 23:59:02] PRINT Downloading http://fashion-mnist.s3-website.eu-central-1.amazonaws.com/train-images-idx3-ubyte.gz to /ssd/data/FashionMNIST/FashionMNIST/raw/train-images-idx3-ubyte.gz
    [2023-10-11 23:59:05] PRINT Extracting /ssd/data/FashionMNIST/FashionMNIST/raw/train-images-idx3-ubyte.gz to /ssd/data/FashionMNIST/FashionMNIST/raw
    [2023-10-11 23:59:05] PRINT
    [2023-10-11 23:59:05] PRINT Downloading http://fashion-mnist.s3-website.eu-central-1.amazonaws.com/train-labels-idx1-ubyte.gz
    [2023-10-11 23:59:05] PRINT Downloading http://fashion-mnist.s3-website.eu-central-1.amazonaws.com/train-labels-idx1-ubyte.gz to /ssd/data/FashionMNIST/FashionMNIST/raw/train-labels-idx1-ubyte.gz
    [2023-10-11 23:59:06] PRINT Extracting /ssd/data/FashionMNIST/FashionMNIST/raw/train-labels-idx1-ubyte.gz to /ssd/data/FashionMNIST/FashionMNIST/raw
    [2023-10-11 23:59:06] PRINT
    [2023-10-11 23:59:06] PRINT Downloading http://fashion-mnist.s3-website.eu-central-1.amazonaws.com/t10k-images-idx3-ubyte.gz
    [2023-10-11 23:59:06] PRINT Downloading http://fashion-mnist.s3-website.eu-central-1.amazonaws.com/t10k-images-idx3-ubyte.gz to /ssd/data/FashionMNIST/Fashio

How to reproduce it?: Please run https://github.com/microsoft/nni/blob/v3.0/examples/tutorials/hpo_quickstart_pytorch/main.py