Closed nj1973 closed 4 months ago
When not set in offload.env this defaults to 2G, this is far too small for any production deployment. We can spend longer initiating a Spark job than actually transferring data.
offload.env
2G
Perhaps 8G or 16G are better defaults.
8G
16G
When not set in
offload.envthis defaults to2G, this is far too small for any production deployment. We can spend longer initiating a Spark job than actually transferring data.Perhaps
8Gor16Gare better defaults.