Downloads data when the stack is started, rather than baking data into the image
Specifies mapping of collection name to Synapse file in apps/agora/data/src/data/collections.csv
Specifies indexes per collection in apps/agora/data/src/data/collections-indexes.json
Tags images with data release identifier (DATA_FILE.DATA_VERSION)
Adds a new collection (dataversion) to document the DATA_FILE, DATA_VERSION, and TEAM_IMAGES_ID
Updates agora-app service based on model-ad-app project
Renames agora-web-app service to agora-app for consistency with project name
Adds a Dockerfile as well as serve-detach and *-image tasks, so agora stack can be started using nx run agora-app:serve-detach
Preview
Generate the .env file for agora-data:
$ nx run agora-data:create-config
> nx run agora-data:create-config
——————————————————————————————————————————————————————————————————————————————————————
NX Successfully ran target create-config for project agora-data (77ms)
Update the .env file to specify the desired data release by updating DATA_FILE and DATA_VERSION.
Create a Synapse PAT with view/download permissions for a user that can download the data release (i.e. the data manifest file specified by DATA_FILE and DATA_VERSION and all files described within the manifest) and the team image files (i.e. all files within the folder specified by TEAM_IMAGES_ID).
Build images:
$ agora-build-images
✔ nx run agora-app:build:production [local cache]
✔ nx run agora-mongo:build-image (3s)
✔ nx run agora-app:server:production (9s)
✔ nx run agora-app:build-image (3s)
✔ nx run agora-data:build-image (25s)
——————————————————————————————————————————————————————————————————————————————————————
NX Successfully ran target build-image for 3 projects and 2 tasks they depend on (25s)
Start agora stack:
$ nx run agora-app:serve-detach
> nx run agora-app:serve-detach
[+] Running 3/3
✔ Container agora-mongo Started 0.5s
✔ Container agora-data Exited 73.5s
✔ Container agora-app Started 74.0s
——————————————————————————————————————————————————————————————————————————————————————
NX Successfully ran target serve-detach for project agora-app (1m)
See agora-app at http://localhost:5200.
See seeded/indexed mongoDB in the MongoDB extension with this connection string: mongodb://{DB_USER}:{DB_PASS}@agora-mongo:{DB_PORT}, using the values specified in apps/agora/data/.env.
Description
Adds an
agora-dataservice to import data intoagora-mongo.Related Issue
Changelog
agora-dataservice based onopenchallenges-edam-etlserviceapps/agora/data/src/data/collections.csvapps/agora/data/src/data/collections-indexes.jsonDATA_FILE.DATA_VERSION)dataversion) to document theDATA_FILE,DATA_VERSION, andTEAM_IMAGES_IDagora-appservice based onmodel-ad-appprojectagora-web-appservice toagora-appfor consistency with project nameserve-detachand*-imagetasks, soagorastack can be started usingnx run agora-app:serve-detachPreview
Generate the
.envfile foragora-data:Update the
.envfile to specify the desired data release by updatingDATA_FILEandDATA_VERSION.Create a Synapse PAT with view/download permissions for a user that can download the data release (i.e. the data manifest file specified by
DATA_FILEandDATA_VERSIONand all files described within the manifest) and the team image files (i.e. all files within the folder specified byTEAM_IMAGES_ID).Build images:
Start
agorastack:See
agora-appathttp://localhost:5200.See seeded/indexed mongoDB in the MongoDB extension with this connection string:
mongodb://{DB_USER}:{DB_PASS}@agora-mongo:{DB_PORT}, using the values specified inapps/agora/data/.env.