sjvrijn / mf2

Collection of Multi-Fidelity benchmark functions
https://mf2.readthedocs.io/
GNU General Public License v3.0
25 stars 7 forks source link
benchmark-functions benchmark-suite benchmarking-suite multi-fidelity python

MF2: Multi-Fidelity-Functions

Package Info Status Support
PyPI version Tests status Docs Status
Conda Coverage Status Gitter
PyPI - Python Version Codacy Badge
License: GPL v3 Project Status: Active
DOI CII Best Practices
status

Introduction

The mf2 package provides consistent, efficient and tested Python implementations of a variety of multi-fidelity benchmark functions. The goal is to simplify life for numerical optimization researchers by saving time otherwise spent reimplementing and debugging the same common functions, and enabling direct comparisons with other work using the same definitions, improving reproducibility in general.

A multi-fidelity function usually reprensents an objective which should be optimized. The term 'multi-fidelity' refers to the fact that multiple versions of the objective function exist, which differ in the accuracy to describe the real objective. A typical real-world example would be the aerodynamic efficiency of an airfoil, e.g., its drag value for a given lift value. The different fidelity levels are given by the accuracy of the evaluation method used to estimate the efficiency. Lower-fidelity versions of the objective function refer to less accurate, but simpler approximations of the objective, such as computational fluid dynamic simulations on rather coarse meshes, whereas higher fidelity levels refer to more accurate but also much more demanding evaluations such as prototype tests in wind tunnels. The hope of multi-fildelity optimization approaches is that many of the not-so-accurate but simple low-fidelity evaluations can be used to achieve improved results on the realistic high-fidelity version of the objective where only very few evaluations can be performed.

The only dependency of the mf2 package is the numpy package.

Documentation is available at mf2.readthedocs.io

Installation

The recommended way to install mf2 in your (virtual) environment is with Python's pip:

pip install mf2

or alternatively using conda:

conda install -c conda-forge mf2

For the latest version, you can install directly from source:

pip install https://github.com/sjvrijn/mf2/archive/main.zip

To work in your own version locally, it is best to clone the repository first, and additionally create an editable install that includes the dev-requirements:

git clone https://github.com/sjvrijn/mf2.git
cd mf2
pip install -e ".[dev]"

Example Usage

import mf2
import numpy as np

# set numpy random seed for reproducibility
np.random.seed(42)
# generate 5 random samples in 2D as matrix
X = np.random.random((5, 2))

# print high fidelity function values
print(mf2.branin.high(X))
# Out: array([36.78994906 34.3332972  50.48149005 43.0569396  35.5268224 ])

# print low fidelity function values
print(mf2.branin.low(X))
# Out: array([-5.8762639  -6.66852889  3.84944507 -1.56314141 -6.23242223])

For more usage examples, please refer to the full documentation on readthedocs.

Contributing

Contributions to this project such as bug reports or benchmark function suggestions are more than welcome! Please refer to CONTRIBUTING.md for more details.

Contact

The Gitter channel is the preferred way to get in touch for any other questions, comments or discussions about this package.

Citation

Was this package useful to you? Great! If this leads to a publication, we'd appreciate it if you would cite our JOSS paper:

@article{vanRijn2020,
  doi = {10.21105/joss.02049},
  url = {https://doi.org/10.21105/joss.02049},
  year = {2020},
  publisher = {The Open Journal},
  volume = {5},
  number = {52},
  pages = {2049},
  author = {Sander van Rijn and Sebastian Schmitt},
  title = {MF2: A Collection of Multi-Fidelity Benchmark Functions in Python},
  journal = {Journal of Open Source Software}
}