automl / neps

Neural Pipeline Search (NePS): Helps deep learning experts find the best neural pipeline.
https://automl.github.io/neps/
Apache License 2.0
39 stars 11 forks source link

Priorband: Defining default value + default_confidence for fidelity parameter #101

Open danrgll opened 1 month ago

danrgll commented 1 month ago

As far as I understand Priorband, it doesn’t make sense to have this functionality and should raise an error.

pipeline_space:
  learning_rate:
    lower: 1e-5
    upper: 1e-1
    log: True  # Log scale for learning rate
    default: 1e-2
    default_confidence: "medium"
  epochs:
    lower: 5
    upper: 20
    is_fidelity: True
    **default: 10**
    **default_confidence: "medium"**
  dropout_rate:
    lower: 0.1
    upper: 0.5
    default: 0.2
    default_confidence: "high"
  optimizer:
    choices: [adam, sgd, adamw]
    default: adam
    # default confidence low
  batch_size: 64
Neeratyoy commented 1 week ago

What exactly is the error and under what conditions?

danrgll commented 1 week ago

Sorry I should have highlighted this better. What I meant was that for the fidelity parameter I also can define a default and default_confidence. Is this intented?

Neeratyoy commented 1 day ago

Is this intented?

Don't think so. Likely an artifact from the general SearchSpace.