search

wfau / ScienceArchives

0 stars 0 forks source link

Create a VM on Somerville to experiment with next generation database curation #557

Open Ross-ROE opened 3 months ago

Ross-ROE commented 3 months ago

We'll be using the VM to host both the curation database and run the curation scripts, unlike old generation system.

We'll need to define a file system layout to store databases, flat files, which doesn't have to follow the old system as we'll be using all new software.

Access to the VM should be granted for all science archive staff via individual user accounts.

We'll need to define a way of listing and managing the standard tools we want to have available on the VM too, like "git", "screen", "nano", "rsync".

tms-epcc commented 2 months ago

18/JUL/24 @astrodb reported via email

Ross-ROE commented 2 months ago

To progress following issues #558 & #559 we'll either need sudo access, or Mark will need to install for us the Postgres and Python3 software via the OS. See those issues for details.

Ross-ROE commented 2 months ago

Also, someone with root access needs to setup the common file system: Maybe the top-level should be the name of the archive? e.g.

/moons-archive/database/ /moons-archive/products/

These will need read-write access for all.

zexpe commented 2 months ago

Thanks for the database directory. Can we have the products directory too? Not sure we'll need anything else from the shared file system.

Ross-ROE commented 2 months ago

On another point, how can I comment on this project with my other account - do we want this project to be writable by anyone??

tms-epcc commented 2 months ago

@Ross-ROE - tell me name of your other account and I can add it to the repo

Ross-ROE commented 2 months ago

That's the thing - I seem to be able to comment here with my other account, which I'm surprised about (see comment prior to my previous one). Is the repo at least protected to just WFAU staff? As I was intending to use it for the new code.

tms-epcc commented 2 months ago

@Ross-ROE - it was setup as a public repo, visible to anyone. Currently the 14 members of the WFAU organisation have write access.

Ross-ROE commented 2 months ago

OK, that's fine - was just surprised anyone can comment here! Only problem then is I'm now getting twice the email notifications! That'll teach me not to check which account I'm using!