typedb / typedb-driver-examples

TypeDB Driver Example Projects and Tutorials
https://typedb.com
Apache License 2.0
84 stars 57 forks source link

Introduce example using TypeDB-Loader with Catalogue of Life dataset #119

Closed dmitrii-ubskii closed 2 years ago

dmitrii-ubskii commented 2 years ago

What is the goal of this PR?

We add an example using TypeDB-Loader. The example uses the Catalogue of Life dataset to represent the taxonomic structure and some horizontal relations (e.g. geographical distribution). We aim to preserve as much data as possible during migration, within reason.

What are the changes implemented in this PR?

Loader fetches the dataset data off the web (~500 MB compressed), inflates and prepares it for typedb-loader to process and upload into the catalogue-of-life database. The schema includes rules that should make for interesting inference examples.

Order of operations:

flyingsilverfin commented 2 years ago

The changes section of the PR can be improved a bit to include slightly more detail of what was implemented. Bullet points are fine! And finally, the title might do better as Introduce Cataloge of Life example using TypeDB Loader

flyingsilverfin commented 2 years ago

Left one comment, and the one thing we're missing is adding the tests to CI: see here: https://github.com/vaticle/typedb-examples/blob/b9f182237ec40d7ad7b6eae4ce89e4694ccd7d55/.grabl/automation.yml#L42

this is our own CI system (called Grabl/Factory) that runs jobs as defined in this yaml file :)