baler-collaboration / baler

Repository of Baler, a machine learning based data compression tool
https://github.com/baler-collaboration/baler.github.io
Apache License 2.0
33 stars 32 forks source link
computational-fluid-dynamics machine-learning particle-physics

DOI\ License\ example workflow example workflow

Introduction

Baler is a tool used to test the feasibility of compressing different types of scientific data using machine learning-based autoencoders. Baler provides you with an easy way to:

  1. Train a machine learning model on your data
  2. Compress your data with that model. This will also save the compressed file and model
  3. Decompress the file using the model at a later time
  4. Plot the performance of the compression/decompression

Getting Started

NOTE: For the same performance and version as presented in our Arxiv paper, please use release v1.0.0 and the setup instructions given there. v1.0.0 also has a working docker implementation. We are currently experiencing some performance issues on the main branch compared.

In the links below we offer instructions on how to set up Baler and working tutorial examples to get you started. We offer two ways to run baler:

Contributing

If you wish to contribute, please see the contribution guidelines.