SmartAPI challenges

[edeutsch]

Hi everyone, I'm just stumbling back into things after the trip. I did a git pull in devED and saw:

 code/ARAX/ARAXQuery/ARAX_query.py                     |  1 +
 code/ARAX/ARAXQuery/ARAX_query_tracker.py             |  2 ++
 code/ARAX/ARAXQuery/Expand/kg2_querier.py             | 27 +++++++++++++++++----------
 code/UI/interactive/rtx.js                            | 55 +++++++++++++++++++++++++++++--------------------------
 code/UI/interactive/rtx.version                       |  2 +-
 code/reasoningtool/kg-construction/QueryNCBIeUtils.py | 88 +++++++++++++++++++++++++++++++++++++++++++++++++---------------------------------------
 deploy/arax/scripts/download_database.sh              | 16 +++++++++++++++-
 deploy/arax/templates/deployment.yaml                 |  6 +++++-
 deploy/arax/values.yaml                               | 15 +++++++++++----
 deploy/kg2/scripts/download_database.sh               |  2 +-
 requirements.txt                                      |  1 +

and restarted the service. It restarted okay (although seemed quite slow to start) but when I do our example 1 query, I see:

I've not seen the "KP does not have a development TRAPI 1.4 endpoint" message before and it is weird that we claim that MolePro does not support this edge. This is a classic MolePro query I think?

Anyone know what might be going on? https://arax.ncats.io/devED/?r=171450

It works much better in CI: https://arax.ci.transltr.io/?r=171451

I just tried running on /beta with the same problem as devED. It seems that the KP selector system is broken on multiple endpoints on arax.ncats.io. Does anyone know anything about this?

[edeutsch]

it does seem like a lot of services are missing development maturity: https://arax.ncats.io/devED/?smartapi=1

Is our code confused or is there a systemic problem with many Translator services not having an development maturity?

[isbluis]

I am not sure if this is related, but there seem to be two different KPs with the infores:molepro identifier right now:

It does appear that none of the automat KPs have a dev endpoint: https://arax.ncats.io/index.html?smartapi=1

[edeutsch]

aha, good eye! I wonder if there would be a good way to detect such duplication and flag it red! with animated blood spattering, even.

[isbluis]

Something like this? https://arax.ncats.io/devLM/?smartapi=3

[edeutsch]

sure, looks good.

There's a chance that we may have to accept this as the new normal, in which case we'll have to change our code, which I assume somewhere assumes that there is only one entry per infores key per TRAPI version or something..

[isbluis]

This seems counterintuitive, since, among other issues, it would obfuscate provenance.

In any case, let me know if/when this should be pushed to master.

[edeutsch]

I would agree, but I can imagine arguments against..

push it!

[isbluis]

Awful Prairie dog pushed!

[edeutsch]

great, thanks! deployed to instances tracking master

[isbluis]

Looks like MolePro is no longer duplicated:

And the Automat ones also have a 1.4 dev endpoint.

Are you able to run your test again?

[edeutsch]

sure, but I see somewhat unusual results.

at devED, I see: https://arax.ncats.io/devED/?r=172032

But at CI, I see: https://arax.ci.transltr.io/?r=172031

(no gelinea!!)

I wonder if a restart is needed to pick up changes to SmartAPI? I assumed that this would automatically refresh after 10 minutes? I suppose it possible that the refresher died on CI.

[isbluis]

gelinea only has a dev endpoint, and no staging -- is this what CI is?

[edeutsch]

ah yes, you are right, exactly!

[edeutsch]

With all that considered, this has been fixed, closing.