InternetHealthReport / internet-yellow-pages

A knowledge graph for the Internet
https://iyp.iijlab.net
GNU General Public License v3.0
44 stars 18 forks source link

Automating Data Dumping from Internet Yellow Pages to Neo4j using Docker Compose #25

Closed mohamedawnallah closed 1 year ago

mohamedawnallah commented 1 year ago

Description

Currently, our data dumping to Neo4j is built and run using individual docker commands. This makes it difficult to manage dependencies and configurations, and can lead to inconsistencies between development and production environments.

Proposed Solution

I propose using a docker-compose.yaml file to manage the dependencies and configurations of our data dumping into Neo4j. This will allow us to easily spin up and down the entire pipeline with a single command docker-compose up and docker-compose down respectively, and ensure consistency between development and production environments.

Benefits