search

bird-house / emu

PyWPS processes for testing and demo.
http://emu.readthedocs.io/en/latest/
Other
3 stars 10 forks source link

Live Emu server for public testing #41

Open huard opened 6 years ago

huard commented 6 years ago

Description

I think it would be useful to have a public live emu server that can be used for testing. The server would have both anonymous access and known credentials (testuser, testpassword) so we can test clients.

cehbrecht commented 6 years ago

Needed on the WPS client side testing: https://github.com/bird-house/birdy/issues/36

huard commented 6 years ago

@tomLandry Is this something CRIM could look at ?

tomLandry commented 6 years ago

Probably, but on the medium-term track. Meaning probably not this summer.

cehbrecht commented 6 years ago

See also: https://github.com/bird-house/bird-house.github.io/issues/24

huard commented 5 years ago

We have that now, right ?

cehbrecht commented 5 years ago

@huard If you mean the one at DKRZ, it is only a demo installation and not maintained for testing. We probably want to have one Emu which is used for testing only and updated from release to release.

huard commented 5 years ago

@tomLandry Is this something CRIM could contribute?

tomLandry commented 5 years ago

Trying to wrap my mind on how/if this is useful for the Compute Challenge.

huard commented 5 years ago

At the moment Emu has a subset process that complies (or should) with the CWT API. One thing we could do is run the certification script on this process, and eventually implement the other services (aggregate, regrid).

More generally, we use Emu to test clients. For example, WPS should in principle work with identifiers that include &;-. and unicode characters. There is a process in Emu with such characters and that revealed bugs in PyWPS, birdy and possibly owslib (unconfirmed). We could use Emu to test security and so on. Emu allows us to create dummy processes that can exercise corner cases, instead of the happy path we restrict ourselves to with production servers.

tomLandry commented 5 years ago

Cool, thanks. I'm currently surveying issues related to ESGF and CWT that are within reach and useful short term - before creating new ones with help of David Byrns. We still have flexibility in how we present that handful of taks to OGC. Of course I have https://github.com/bird-house/birdy/issues/102 and https://github.com/bird-house/birdy/issues/58 on my radar.

cehbrecht commented 5 years ago

At the moment Emu has a subset process that complies (or should) with the CWT API. One thing we could do is run the certification script on this process, and eventually implement the other services (aggregate, regrid).

@huard @tomLandry Do you think it would be useful to have a dedicated WPS service (bird) for the CWT API?

huard commented 5 years ago

@cehbrecht Hum. Yes, I suppose you're right. But there is still a need for a live test server IMO.

tomLandry commented 5 years ago

I think we need a live test server (or only service?) for CWT API. If you look at OGC Testbed-15 Call For Participation, it says "The Testbed-15 solution will be tested with platforms provided by NASA, ESA, and ideally the ESGF." That assumes that once TB-15 is started, whoever get the D124 Deliverable will like us very much if we give a headstart to interoperate with NASA/LLNL stacks and endpoints through the API. For "ESA platforms", that roughly translates to Twitcher in WPS 2.0 REST and enabling the Thematic Exploitation Platform configuration. See here: https://portal.opengeospatial.org/files/?artifact_id=82290#EOPAD

huard commented 5 years ago

A new full implementation of the CWT API backend with PyWPS would be a lot of work.

tomLandry commented 5 years ago

Yes, mucho work. My intention for the OGC-DOE project (in the associated "ESGF Compute" Engineering Report) is to neatly document how it could be done, to broadly design the solution. If it's compelling, there will be participants of OGC's testbed paid to take this in account in their own implementations. Also, that's the type of work we'd like to do in DACCS.