We should plan for sensible capacity architecture on Yunikorn that takes into consideration the following components:
Ingestions jobs that run pure Java application (small) and those that required Spark (large) using different demands of resources.
Occurrence downloads: small (multi-threaded Java app s using Elasticsearch) and big Downloads (using dynamic settings depending on the amount of data to process)
Batch and scheduled tasks: maps, table builds, gridded datasets, grscicoll cache, analytics, etc.
We should plan for sensible capacity architecture on Yunikorn that takes into consideration the following components: