search

BCDA-APS / use_bluesky

Tools to help APS use the Bluesky Framework (https://blueskyproject.io/)
8 stars 3 forks source link

registry of mongodb data repositories #86

Closed prjemian closed 2 years ago

prjemian commented 3 years ago

As the number of Bluesky installations increases at APS, there is a distinct need to maintain a common registry of databases to enable easily discoverable data repositories.

Need tools to administer registry entries (add, update, freeze, archive).

Also, backups.

prjemian commented 3 years ago

Another motivation for this is to inform whether a proposed database repository is already in use.

prjemian commented 3 years ago

A web interface would be useful.

prjemian commented 3 years ago

Initially, using intake-style catalogs defined by YAML files, one single file could suffice. YAML supports single-line comments so annotations are possible.

prjemian commented 3 years ago

Such as this catalog for 16-ID laboratory development:

sources:
    testlaue:
        args:
            asset_registry_db: mongodb://s100apps.xray.aps.anl.gov:27017/testlaue-file_refs
            metadatastore_db: mongodb://s100apps.xray.aps.anl.gov:27017/testlaue-run_data
        driver: bluesky-mongo-normalized-catalog
prjemian commented 3 years ago

move to next milestone

prjemian commented 2 years ago

Just opened a repository for internal use at APS in our GitLab server.