search

exasol / cloud-storage-extension

Exasol Cloud Storage Extension for accessing formatted data Avro, Orc and Parquet, on public cloud storage systems
MIT License
7 stars 11 forks source link

Parallelism examples #213

Closed allipatev closed 1 year ago

allipatev commented 1 year ago

It seems that together with the latest release 2.4.0: Support for automatic parallelism examples of manual parallelism settings were removed from User Guide.

Guessing right values for PARALLELISM parameter is, obviously, hard, if possible.

As you have seen from the recent tickets (SUPPORT-34484), tuning PARALLELISM parameter might be often needed for small tables to avoid having, for example, too many single-row files.

Please consider returning back the explanation of typical PARALLELISM parameter values for IMPORT_PATH and EXPORT_PATH scripts.

morazow commented 1 year ago

Hey @allipatev,

Thanks for the feedback!

Yes, we removed it from docs intentionally. But maybe good idea to bring it back and update it with examples from the support ticket. I will do it in our next bug fixing week.