exasol / script-languages

Base Repository for the Script Language Container for user defined functions (UDF's) that can be used in the EXASOL database. You can find the release repository under https://github.com/exasol/script-languages-release
https://docs.exasol.com/database_concepts/udf_scripts.htm
MIT License
13 stars 15 forks source link

#883: Update packages #404

Closed tomuben closed 4 months ago

tomuben commented 4 months ago

related to https://github.com/exasol/script-languages-release/issues/883

  1. Update pandas, numpy and pyarrow in template-Python3.10 flavor.
  2. Deactivate conversion tests for pandas dataframes for halffloat[pyarrow] + float and float16[pyarrow] and float because in newer versions of pandas this conversion is fixed, but we cannot (yet) use the latest versions in all flavors (pandas 2.1 and later require >= Python3.9)
  3. Update ignore list in import_modules.py (due to latest packages in new standard-all flavor)
  4. Changed test import_modules.py: Instead of importing ALL python modules in one UDF, fetch first list of installed python packages, and then call UDF one by one. This is to avoid an out-of memory issue. For example, importing sagemaker already allocates ~150MB on the heap.