debiai/DebiAI - Githubissues

[![Online documentation](https://img.shields.io/static/v1?label=&message=Online documentation&color=0077de)](https://debiai.irt-systemx.fr/)
[![License](https://img.shields.io/badge/License-Apache_2.0-blue.svg)](https://opensource.org/licenses/Apache-2.0) ![cd](https://github.com/debiai/debiai/actions/workflows/docker-push.yml/badge.svg)
![Activity](https://img.shields.io/github/commit-activity/m/debiai/debiai) ![Last commit](https://img.shields.io/github/last-commit/debiai/debiai)
[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black) [![Code style: flake8](https://img.shields.io/badge/code%20style-flake8-1c4a6c.svg)](https://flake8.pycqa.org/en/latest/) [![code style: prettier](https://img.shields.io/badge/code_style-prettier-ff69b4.svg?style=flat-square)](https://github.com/prettier/prettier)

Why DebiAI?

DebiAI is an open-source web application that aims to facilitate the process of developing Machine Learning models, especially in the stage of the project data analysis and the model performance comparison.

DebiAI provides data scientists with features to:

Identify biases and errors in your input, results, contextual or ground truth project data
Make a comparison of the performance of your ML according to their contextual results
Select and create sets of data graphically for further analysis or (re-)training purposes
Quickly create and share statistical visualizations of your project data for your team or client

Documentation

The full documentation is available on the DebiAI website.

Dashboard

DebiAI has a Web Graphical User Interface with a complete data visualization toolkit offering many statistical analysis tools:

The dashboard is highly customizable and can be used for large and small projects. Learn more about the widgets and how to use them.

Data

DebiAI is designed to be used for any kind of projects and data, it is particularly useful for projects that involve many contextual data.

DebiAI provide two main ways to import your data:

A DebiAI Python module is provided to insert, directly from your Python workflow, the data and model results that you want to study.
You can also create a Data Provider, a Web API that will allow DebiAI to reach your data and model results from any programming language and any data sources without duplication. Check out the DebiAI Data Provider Node.js template for an example of a Data Provider.

Installation

DebiAI is available with pip or as a Docker image. To install it, you can follow the installation guide.

Use cases

As part of the Confiance.ai program, we (the IRT SystemX) are using and developing DebiAI for a wide range of use cases.

One of them is the Valeo - WoodScape dataset:

Valeo - WoodScape

The Valeo - WoodScape dataset is an annotated image dataset taken from 4 fisheye cameras. DebiAI is used to analyze the dataset for biases and outliers in the data.

Within the Confiance.ai program, DebiAI has been able to import the project data, detect biases, find annotations errors and export them to the project's image annotation tool.

Scientific publications

ICAS 2024 DebiAI: Open-Source Toolkit for Data Analysis, Visualization and Evaluation in Machine Learning.
- Best paper award! 🏆

Citation

If you use DebiAI in your research, please cite the following paper:

@inproceedings{mansion2024debiai,
  title={DebiAI: Open-Source Toolkit for Data Analysis, Visualisation and Evaluation in Machine Learning},
  author={Mansion, Tom and Braud, Rapha{\"e}l and Amrani, Ahmed and Chaouche, Sabrina and Adjed, Faouzi and Cantat, Lo{\"\i}c},
  booktitle={ICAS 2024},
  year={2024}
}

DebiAI is developed by And is integrated in

debiai / DebiAI

readme