search

ACCESS-NRI / access-nri-intake-catalog

Tools and configuration info used to manage ACCESS-NRI's intake catalogue
https://access-nri-intake-catalog.rtfd.io
Apache License 2.0
8 stars 1 forks source link

Ship schema with package #185

Closed dougiesquire closed 2 months ago

dougiesquire commented 3 months ago

Current behaviour is that the schema used to validate the datastore and catalog entries are downloaded and cached the first time access-nri-intake is imported - see here and here. This has obvious issues when someone is trying to use access-nri-intake for the first time from a computer without network access (e.g. Gadi compute nodes).

To avoid this issue, we probably need to refactor how the schema are handled so that the appropriate schema are shipped with the access-nri-intake package.

dougiesquire commented 3 months ago

@marc-white is this something you could take on?

aidanheerdegen commented 3 months ago

Surely we can ship a datafile with a conda package?

dougiesquire commented 3 months ago

Yeah, we can. It just requires a small amount of thought/refactor so that we can easily update the schema

marc-white commented 2 months ago

Dumping here for my own reference: https://sixty-north.com/blog/including-package-data-in-python-packages.html

access-hive-bot commented 2 months ago

This issue has been mentioned on ACCESS Hive Community Forum. There might be relevant details there:

https://forum.access-hive.org.au/t/payu-archives-and-restarts/3626/3