search

ESIPFed / Earth-Data-Provenance-Workshop

https://esipfed.github.io/Earth-Data-Provenance-Workshop/
Apache License 2.0
3 stars 5 forks source link

Extend Provisium work to see how it would integrate with the Jupyter notebook use case #13

Open esip-lab opened 6 years ago

esip-lab commented 6 years ago

Specifically, actively harvesting and/or accepting submissions of provenance

skybristol commented 6 years ago

I'd suggest building a write API method on Provisium as the base for this. That would allow something like what I'm working up in Jupyter to shoot PROV off to the API if that's appropriate but could also be extended with some harvesting middleware to go retrieve PROV from registered sources. For the two use cases (data management/processing and analytical workflows), I will be caching PROV from those in some type of organizational repository as part of a package. So, I could simply inform some harvester to come check for it, or I could send it off at runtime.

narock commented 6 years ago

Thanks for the update @skybristol. @fils and I are meeting to discuss implementation ideas. We should get to some actual coding next week. I'll keep you posted.

esip-lab commented 6 years ago

HI @narock @fils @skybristol any movement forward on this task?

narock commented 6 years ago

Not on my end and I'm probably holding everyone else up. Sorry for that. I've been delayed due to teaching/university commitments. My semester just ended so I now have a lot more time to devote to this. I'll have a working API for Sky by the end of May.

narock commented 6 years ago

@abburgess @fils where should we deploy the updated provisium service? I remembered there being discussion of moving to a new server. Maybe I'm remembering that incorrectly. Are we continuing to use the server from our ESIP Labs project or something else?

Revised API is almost ready for deployment and testing. I'll have it ready to go next week.

esip-lab commented 6 years ago

Remind me @narock are you running on an AWS instance we're paying for?

narock commented 6 years ago

@abburgess we're currently running on NSF's XSEDE services. Doug set it up as part of the ESIP Labs project. When we discussed keeping Provisium running there was mention of moving it to an ESIP AWS instance. Let me know if you'd like to do that. We're just about ready to deploy the next version of Provisium

esip-lab commented 6 years ago

Could you give me an estimate of the monthly cost to run on AWS?

Annie Burgess, PhD

ESIP Lab Director |Earth Science Information Partners (ESIP)

www http://esipfed.org | phone 585.738.7549

Sign up for the monthly ESIP Lab newsletter here http://eepurl.com/dtKL8z.

On Wed, May 30, 2018 at 4:14 AM, Tom Narock notifications@github.com wrote:

@abburgess https://github.com/abburgess we're currently running on NSF's XSEDE services. Doug set it up as part of the ESIP Labs project. When we discussed keeping Provisium running there was mention of moving it to an ESIP AWS instance. Let me know if you'd like to do that. We're just about ready to deploy the next version of Provisium

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/ESIPFed/Earth-Data-Provenance-Workshop/issues/13#issuecomment-393123296, or mute the thread https://github.com/notifications/unsubscribe-auth/AG_XwPleot0J58ecZZAUN7I1RGhffUL-ks5t3n8BgaJpZM4THKNp .