search

SWS-Methodology / faoswsTrade

World trade data processing for the FAO Statistical Working System
http://www.fao.org/economic/ess/ess-home/en/
5 stars 2 forks source link

Is it necessary to have complete and total trade plugins separate? #176

Open chrMongeau opened 5 years ago

chrMongeau commented 5 years ago

We usually run complete trade and THEN total trade. Always. As far as I remember there has not been any separate use of the two.

Can we combine them?

chrMongeau commented 5 years ago

Also: if complete fails, there is no point in running total, which needs to be launched again.

chrMongeau commented 5 years ago

Note: the results of the two plugins go to two different datasets.

chrMongeau commented 4 years ago

Additional note on this: currently the complete plugin takes around 25 minutes to complete on average, while the total plugin takes 7: unfortunately 25 is the average, sometimes it can take slightly above 30 minutes, so that scheduling of total plugin need to be done after 1 hour the complete plugin is launched. If the two plugins are merged, then the process would take around 35 minutes. Being this the case, two runs of the merged plugin could be done by the hour, while currently it takes 1.5 hours.