Currently, I need to merge 8 JSON files which about 30-50MB each file, the file include an object with multiple nested arrays
I can see during the merge it uses lots of CPU, it works fine on local computer but I the code running in the dockerize just as ECS/EKS, the container will get killed when the CPU hit 100%. Is their any document/guideline for large object merge?
Currently, I need to merge 8 JSON files which about 30-50MB each file, the file include an object with multiple nested arrays
I can see during the merge it uses lots of CPU, it works fine on local computer but I the code running in the dockerize just as ECS/EKS, the container will get killed when the CPU hit 100%. Is their any document/guideline for large object merge?