x-atlas-consortia / ubkg-neo4j

A container implementation to serve the Unified Biomedical Knowledge Graph in Neo4j
MIT License
1 stars 0 forks source link

Optimize compression of neo4j database #54

Closed AlanSimmons closed 2 months ago

AlanSimmons commented 4 months ago

fyi @yuanzhou

Statement of problem

The current distribution architecture employs as a compression application the default version of zip that is part of MacOs.

Because of the size of some of the deployments of UBKG (e.g., Data Distillery), compression can take a very long time.

We need a compression solution that optimizes both file compression time and file size.

Solution

Compare other options, including: