search

antoinecarme / pyaf

PyAF is an Open Source Python library for Automatic Time Series Forecasting built on top of popular pydata modules.
BSD 3-Clause "New" or "Revised" License
456 stars 73 forks source link

Release Process : Pre-release Benchmarks #194

Closed antoinecarme closed 2 years ago

antoinecarme commented 2 years ago

Following #176 and #188 :

Need to update PyAF benchmarks with the results for the next release.

https://github.com/antoinecarme/PyAF_Benchmarks

Some refactoring is needed to automate the benchmark execution and integration.

A better Reporting is also needed.

  1. Add a report about training times and their evolution between the previous releases.
  2. Add a global quality report (MAPE + L1 distribution/quantiles for all releases and all benchmark datasets)
  3. A summary report presenting the results (Jupyter notebook)

Target Release : 2022-07-14

antoinecarme commented 2 years ago

FIXED