SciML / SciMLBenchmarks.jl

Scientific machine learning (SciML) benchmarks, AI for science, and (differential) equation solvers. Covers Julia, Python (PyTorch, Jax), MATLAB, R
https://docs.sciml.ai/SciMLBenchmarksOutput/stable/
MIT License
318 stars 85 forks source link

Get BlackBoxOptimizationBenchmarking.jl updated to Optimization.jl's interface and run on SciMLBenchmarks #640

Open ChrisRackauckas opened 1 year ago

ChrisRackauckas commented 1 year ago

@Vaibhavdixit02 can you take a look over the next week into updating/upgrading https://github.com/jonathanBieler/BlackBoxOptimizationBenchmarking.jl to Optimization.jl's interface? It would nice to have this easily re-runnable over all of Optimization.jl's methods given that it has been a pretty useful benchmark for us in the past. It will also show the completeness of Optimization.jl's interface to have something comprehensive like this.

CC @jonathanBieler

EdwardBerman commented 5 months ago

Hi all, I'm excited to work on this problem as part of the SciML small grants program. Is here an appropriate to share my progress, as well as on the official Julia slack? Thanks!

ChrisRackauckas commented 5 months ago

Please use a WIP PR to share the progress.

EdwardBerman commented 5 months ago

Sounds good, I submitted a WIP PR here: https://github.com/SciML/SciMLBenchmarks.jl/pull/936 . Thanks!

jonathanBieler commented 5 months ago

Hi @EdwardBerman, tell me if you need help :)

parteekcoder commented 2 months ago

Hi @ChrisRackauckas, can you please confirm is this issue still active in SciML projects, or if anyone is working on this?

Vaibhavdixit02 commented 2 months ago

This is open, but the scope has increased, we want to wrap all the classes in https://numbbo.github.io/coco/testsuites the current BlackBoxOptimizationBenchmarking.jl only does the bbob suite from there

parteekcoder commented 2 months ago

is anyone working on this, I would like to start working on it. Can you please tell me the procedure for the application? @Vaibhavdixit02

ChrisRackauckas commented 2 months ago

The instructions are here: https://sciml.ai/small_grants/#declaring_for_a_project