VEuPathDB / service-eda

Repo containing EDA web service
Apache License 2.0
0 stars 0 forks source link

microbiome user: farmm, stratification does not seem to work #5

Closed aurreco-uga closed 4 months ago

aurreco-uga commented 4 months ago

email on Apr 11 2024 ReplyTo: hawa.patel@mail.utoronto.ca

When attempting to visualize data in the FARMM Study, under the 'browse and subset' tab, when selecting filters, specifically choosing to filter based on Clinical history -> Antibiotic medication related to sample collection -> choosing all three options: antibiotics treatment, post antibiotics, and pre antibiotics. These are the three groups I am interested in comparing. Whenever i go to visualize the data using any method, be it beta diversity, alpha diversity etc., the only graph that shows up after selecting for stratification variable "Antibiotic medication related to sample collection" is the pre-antibiotics data, the other 2 categories (post antibiotics and antibiotics treatment) do not show up at all, and only show up if the pre-antibiotics option is deselected. Why is this?? What can I do. Thank you

d-callan commented 4 months ago

im not convinced this is a backend issue. i can see the two missing values are in the response

image

dmfalke commented 4 months ago

My first thought is that this could be related to filter sensitivity. I will take a closer look later today.

dmfalke commented 4 months ago

I stand corrected. The reason this is happening is that the variable's vocabulary only includes the value Pre antibiotics. That vocabulary is used by stratification, etc. I think the reason is so that the values are ordered in a specific way (if ordinal, as this variable happens to be).

aurreco-uga commented 4 months ago

from dave:

https://github.com/VEuPathDB/ApiCommonData/blob/572804e4288f692af88d623ed7e4d5e2cd[…]/ontology/Microbiome/studies/farmm_metagenomics/owlOverride.csv owlOverride.csv "EUPATH_0009125","Antibiotic medication related to sample collection","FARMM_metagenomics.txt::antibiotics","FARMM_metagenomics.txt",,,"yes",,,,,,,,,,,,"[""Pre antibiotics""]"

this explains the problem, and if this file is the complete list of variable with overridden vocabs, then it would be pretty easy to manually check.

jaycolin commented 4 months ago

Study reloaded, vocabulary issue resolved

https://github.com/VEuPathDB/ApiCommonData/commit/252170f99c154427fe3dc8ea46ec7eadf094c966

dmfalke commented 4 months ago

does the metadata cache need to be invalidated?

dmfalke commented 4 months ago

i see it's fixed on qa. can this easily be fixed on prod? do we want that? @aurreco-uga @dpbisme ?

aurreco-uga commented 4 months ago

i think so if not too complicated.

jaycolin commented 4 months ago

ok I have patched edab67n/s and cleared md caches

aurreco-uga commented 4 months ago
Screenshot 2024-04-15 at 3 27 41 PM