chorus-ai / chorus-cloud-pm

A repo to track cloud-related tasks for deploying CHoRUS services on Azure
0 stars 0 forks source link

1.2 Provisioning environment for analysis #17

Open CmCC1435 opened 4 months ago

CmCC1435 commented 4 months ago
rkamaleswaran commented 4 months ago

The DevOps environment is still in development mode, the basic skeleton is in place, however, many other services are still not incorporated into terraform, e.g. leaderboard, discussions, benchmarking. Needs maturation and development.

-- Initial bolus of work need to be done to do the initial production; containers are based on docker so local developments can be performed before pushed to azure. -- Testbed for the app development, validation, and push to Chorus -- -- Pipeline for build, testing and reference on azure is available, and to be used for chorus applications. (available in azure advisor, recommendations and notes available ZZZZZZ)

@Tony to work with Dileep: terraform for the challenge services (primarily web-based tools and data provisioning)

rkamaleswaran commented 3 months ago

Dileep to meet with Jared to discuss the DevOps and scripting needs for the data challenge

Investigate operationalization of the data challenge support tools to monitor utilization, computation, and costs

CmCC1435 commented 3 months ago

Dev environment is needed first

Production/admin for dataset provisioning space needs to be created --Jared is meeting with Jon to implement terraform --Dileep needs access to Gitlab/terraform

CmCC1435 commented 2 months ago

Go forward with user container apps instead of workspace approach

rkamaleswaran commented 2 months ago

@jshoughtaling can you please update this. Do we have a final config and strategy for the user container apps to implement private workspaces for each participant?

We need to create a container app for a 'demo challenge team' that has jupyter notebook, and access to the data to run some demo ML tasks.

CmCC1435 commented 1 month ago

Each user can get a portal (firefox browser) that they can access the jupyter access