DataSAIL is a tool that splits data while minimizing Information Leakage. This tool formulates the splitting of a dataset as a constrained minimization problem and computes the assignment of data points to splits while minimizing the objective function that accounts for information leakage.
Internally, DataSAIL uses disciplined quasi-convex programming and binary quadratic programs to formulate the optimization task. DataSAIL utilizes solves like SCIP, one of the fastest non-commercial solvers for this type of problem, and MOSEK, a commercial solver that distributes free licenses for academic use. There are other options; please check the documentation.
Apart from the short overview, you can find a more detailed explanation of the tool on ReadTheDocs.
DataSAIL is installable from conda using mamba. using
mamba create -n sail -c conda-forge -c kalininalab -c bioconda datasail
conda activate sail
pip install grakel
to install it into a new empty environment or
mamba install -c conda-forge -c kalininalab -c bioconda -c mosek datasail
pip install grakel
to install DataSAIL in an already existing environment. Alternatively, one can install DataSAIL-lite from conda. DataSAIL-lite is a version of DataSAIL that does not install all clustering algorithms as the standard DataSAIL. Installing either package usually takes less than 5 minutes.
DataSAIL is available for Python 3.8 and newer.
DataSAIL is installed as a command-line tool. So, in the conda environment, DataSAIL has been installed to, you can run
datasail --e-type P --e-data <path_to_fasta> --e-sim mmseqs --output <path_to_output_path> --technique C1e
to split a set of proteins that have been clustered using mmseqs. For a full list of arguments, run datasail -h
and
checkout ReadTheDocs. There is a more detailed explanation of the arguments and example notebooks. The runtime largy depends on the number and type of splits to be computed and the size of the dataset. For small datasets (less then 10k samples) DataSAIL finished within minutes. On large datasets (more than 100k samples) it can take several hours to complete.
One can distinguish two main ways to train a machine-learning model on biological data.
DataSAIL is created to compute complex data splits by separating data based on similarities. This makes
complex data splits for the first scenario. So, you can use DataSAIL when your model is applied to data
different from your training data but not if the data in the application is more or less the same as in the training.
If you used DataSAIL to split your data, please cite DataSAIL in your publication.
@article{joeres2023datasail,
title={DataSAIL: Data Splitting Against Information Leakage},
author={Joeres, Roman and Blumenthal, David B. and Kalinina, Olga V},
journal={bioRxiv},
pages={2023--11},
year={2023},
publisher={Cold Spring Harbor Laboratory}
}