search

UQ-RCC / ipp

The IPP is a Web portal for biologists to interact with High Performance Compute (HPC) systems. Designed and funded by the IMB Microscopy Facility & the Research Computing Centre (RCC)
https://rcc.uq.edu.au/
MIT License
3 stars 0 forks source link

Detailed Job Logging #55

Open DrSpringy opened 3 years ago

DrSpringy commented 3 years ago

Management page that is viewable by both users and admins of the portal

users can search by date range their own data and save that as a report (admins can access and save anyones data).    Ability to export the following information to .xlsx or .csv file

Fields to include but not limited to: Job submission, job start, job end times, username, email, ID, Job Name/type, number of nodes, number of GPUs, elapsed time, Job outcome (aborted, error/failed, completed, etc), Input, Output directories, memory per job + pretty much every field so that we can data mine down the track to understand how people are using the portal, or use it for cost recovery to help pay for the portal development and microvolution licenses

In future we would define pricing rules based on this data and push the charge as a PPMS order, or track the wall time in PPMS using the PPMS PUMAPI API

markendr commented 8 months ago

JS, NC, ND, ME zoom call on 20-Mar-2024:

Looks straightforward, slurm email has start and finish time (assign to 2H2024 project)

markendr commented 7 months ago

Include a submit time field in logs and on admin page, as per https://github.com/UQ-RCC/ipp/issues/18