search

OpenTechStrategies / torque-sites

Open source code specific to OTS-managed Torque sites (usually client sites).
3 stars 1 forks source link

"Funders TOC" in RacialEquity2030 needs to update if live funder data changes. #108

Open kfogel opened 3 years ago

kfogel commented 3 years ago

If one were to edit the funders in RacialEquity2030, the Funders TOC currently wouldn't update, as it's generated at ETL time from the original ETL data.

Thus there are two degrees of possible fix:

  1. When regenerating the TOC in a (presumably manually initiated) ETL process, pull data from the running system.
  2. Just generate the TOC from live data at page-load time (or if it takes a long time, then generate it periodically and cache the result?). I don't know how hard this second option would be; I'm just pointing out that it exists and -- from an up-to-dateness point of view -- is better than the ETL-time option.
frankduncan commented 3 years ago

Some information on option 2. Torque is currently designed to be data agnostic, so it means we would need to either put the grouping logic into jinja, or create a way to have torque passed code that it runs the data through (through specification or code). I'm guessing it would be better to explore one of those options rather than do it in the etl pipeline, from a user experience point of view.