SciML / Surrogates.jl

Surrogate modeling and optimization for scientific machine learning (SciML)
https://docs.sciml.ai/Surrogates/stable/
Other
328 stars 70 forks source link

About additional data acquisition in optimization method for surrogates #421

Closed JinraeKim closed 1 year ago

JinraeKim commented 1 year ago

I was looking at this package and it seems that the optimization methods for surrogates such as SRBF requires additional data point acquisition. Is there any optimization method here which does not require additional data acquisition?

vikram-s-narayan commented 1 year ago

Optimization methods that form part of Surrogates require additional data point acquisition.

ChrisRackauckas commented 1 year ago

Yes, these methods are for surrogate optimization, which requires acquiring more data points to improve the surrogate and then choose the next point. That's kind of the point of these methods.

If you're looking for accelerating optimization by a surrogate, that's a different thing. For that, just train a surrogate of your model/loss and then put that into Optimization.jl. Since that doesn't require any new tooling, we just recommend using Optimization.jl there.