Documentation on using HTC

gwarf commented 1 year ago

While I was trying to test the UI role/package we have in UMD, I took some notes and drafted a tutorial on using HTC. It needs some reviews/polishing, and as I haven't been doing this kind of things since long, all suggestions are very welcome!

See:

https://docs.egi.eu/documentation/535/users/tutorials/htc-job-submission/

https://docs.egi.eu/documentation/535/users/compute/high-throughput-compute/querying-information-system/

https://docs.egi.eu/documentation/535/internal/operations-portal/using-vapor/

In the HTC section we only cover the Workload Manager, but I feel it may be handy to have this covered, at least for us or for more advanced use cases/users.

It's also based on ansible-roles that are being updated, same for the repo for setting up the UI.

Missing (at least):

[x] provide proper documentation for querying the information system using GLUE 2
[x] Document querying the information system using GLUE 2 to find resources accessible for a given VO
[x] documenting/managing credential setup ~and possible transfer to the VM~ (this part was moved to the related repo)
[x] add intro with references and so on
[x] cover DIRAC CLI? (added references to existing documentation)
[x] ~cover or link to basic data management~ (postponed to later)

github-actions[bot] commented 1 year ago

Documentation preview deployed!

Available at https://docs.egi.eu/documentation/535

github-actions[bot] commented 1 year ago

Documentation preview deployed!

Available at https://docs.egi.eu/documentation/535

gwarf commented 1 year ago

To make the tutorial a bit shorter, I've extracted some stuff to dedicate pages.

github-actions[bot] commented 1 year ago

Documentation preview deployed!

Available at https://docs.egi.eu/documentation/535

github-actions[bot] commented 1 year ago

Documentation preview deployed!

Available at https://docs.egi.eu/documentation/535

gwarf commented 1 year ago

@enolfc , @andrea-manzi any feedback from tests in the UI? If you don't have time to test more, should we merge it and assume we will fix problems later when they are identified/reported?

github-actions[bot] commented 1 year ago

Documentation preview deployed!

Available at https://docs.egi.eu/documentation/535

enolfc commented 1 year ago

@enolfc , @andrea-manzi any feedback from tests in the UI? If you don't have time to test more, should we merge it and assume we will fix problems later when they are identified/reported?

:+1: For me the test just worked as expected - but I just went very direct to submit with ARC to the sample endpoint, which is nice as it proves that what you provided works.

gwarf commented 1 year ago

@paolini78 it seems we need your blessing here :)

github-actions[bot] commented 1 year ago