EyeSeeTea / Bulk-Load-blessed

Bulk Load is a DHIS2 application designed to ease the integration of data from excel into DHIS2 and generate templates for datasets and programs
https://eyeseetea.github.io/Bulk-Load-blessed/
3 stars 3 forks source link

Filter COC for programs and/or datasets #112

Closed loriannaz3 closed 10 months ago

loriannaz3 commented 1 year ago

We are unable to populate a template with data for some of our Entomology event programs -- the ones that have a lot of categories and category options. One program has over 90,000 COCs. The app doesn't crash, but it takes hours to cycle through all the CO options for each Org Unit when pulling events (and there are only 821 events in this program for this OU).

I'm curious if the new feature to "Filter category option combos based on selected organisation units" might help us in this regard. However, I don't see this as an option after installing 3.20.1 on our server (version 2.37.9).

Thanks for any help you can provide. I'm happy to provide additional information.

Lori Metz Abt Associates

adrianq commented 1 year ago

@loriannaz3 The filter for the category option combos based on selected organisation units happens behind the scene. There is no graphical interface. Basically, we filter out the category option combos based on the selected org units in the template download section. Some COC are not included in the Excel file based on the org unit selected. What you described is a very interesting feature and it can certainly be added. We have similar features ("Filter columns for programs" and "Filter columns for data sets") in the Settings section and we could add something like "Filter COC for programs and/or datasets". I will rename this issue and add it to the road plan to the "Future (unfunded ideas)" column. At this moment, we don't have funding for this so it may take some time until we take care of it (cc @ifoche )

loriannaz3 commented 1 year ago

@adrianq Thanks so much for your reply. Does the current feature to filter out the category option combos based on the selected org units impact the event pulls? Or is it strictly filtering them out of the template on the metadata tab?

Thanks for adding this to the road plan! Understood about the funding realities. For our specific instance -- since we use a lot of categories and category options in general -- having the option to exclude the COs from the event api calls would allow us to pull data for our programs that have an large number of COCs. That may be what you are suggesting above but wanted to mention that in case it wasn't clear in my original message. cc @ifoche