search

dcppc / 2018-august-workshop

Repository and website for the August 2018 Workshop in Chicago
http://nih-data-commons.us/2018-august-workshop
Other
0 stars 0 forks source link

DOS service for multi-stack compute #14

Open keanderka opened 5 years ago

keanderka commented 5 years ago

Description: The full stack teams have agreed to each stand up a DOS instance to serve up the data coming out of our cross stack compute demo plan for October. So, ideally, we do our shared, multi-stack recompute and each stack (Helium, Xenon, and Calcium) share the resulting GTEx CRAMs and VCFs using a DOS service. This DOS service is usable with a token from each full stack (we already showed in the July F2F that we could onboard users in each stack) and that gives the DOS caller a 1) native path with temporary credentials and/or 2) a signed URL. For Argon we get a manifest/bdbag and a shared bucket location to pull RNAseq analysis data files. Each stack then uses the DOS endpoints and bdbag from Argon to onboard these data into their system as is appropriate.

Desired Room: Conference room, 16 people

Target audience: Full stacks

alisonleaf commented 5 years ago

@keanderka Can this topic be part of a larger discussion on planning for the full stacks demo on October 1/October 16.

Xenon and Argon (possibly other full stack teams) would like to participate in the GUID breakout session currently planning for Day 1, so perhaps this breakout session could be on Day 2?

keanderka commented 5 years ago

Hi @alisonleaf - yes, great suggestion! I called out this topic specifically because it seems like there is a lot of technical scoping that needs to be done. I agree that it definitely fits into a larger discussion of logistics on who is doing what for the October demo.

abartimmo commented 5 years ago

Will we be collecting the following information during the Breakout Session?

  1. Functional Summary:
  2. Scientific Purpose:
  3. Issue or Problem:
  4. Risk:
  5. Assumptions:
abartimmo commented 5 years ago

Can we also please get a Zoom link for this Breakout session? I have team members that will not be in Chicago but do want to follow this discussion.

raynamharris commented 5 years ago

Hey @abartimmo, you or someone in your group will need to set up your own Zoom or WebEx conference call. If you need a Zoom account, you can request one from dcppc.inbox@gmail.com .

briandoconnor commented 5 years ago

Hi, I agree with @alisonleaf , I think we should combine this breakout into a larger, full-stacks breakout to focus on this and other topics for the Oct 16th demo.

I created a ticket for this here: https://github.com/dcppc/2018-august-workshop/issues/18