Open jcermauwedu opened 3 months ago
The pytest currently fails. It looks like the raw data is there, but the test is not producing the parquet file. I am using the latest commit: https://github.com/c-proof/pyglider/commit/71c6e1309279ae39a74c17a6edcc4d6cf6a715ac
pytest
============================================================= test session starts ============================================================== platform linux -- Python 3.12.2, pytest-8.1.1, pluggy-1.4.0 rootdir: /home/portal/src/pyglider plugins: cov-4.1.0 collected 26 items / 1 error ==================================================================== ERRORS ==================================================================== ___________________________________________________ ERROR collecting tests/test_pyglider.py ____________________________________________________ tests/test_pyglider.py:21: in <module> outname = seaexplorer.raw_to_L0timeseries(rawncdir, l0tsdir, ../upstream/pyglider/pyglider/seaexplorer.py:317: in raw_to_timeseries gli = pl.read_parquet(f'{indir}/{id}-rawgli.parquet') ../../miniconda3/envs/pyglider/lib/python3.12/site-packages/polars/_utils/deprecation.py:134: in wrapper return function(*args, **kwargs) ../../miniconda3/envs/pyglider/lib/python3.12/site-packages/polars/_utils/deprecation.py:134: in wrapper return function(*args, **kwargs) ../../miniconda3/envs/pyglider/lib/python3.12/site-packages/polars/io/parquet/functions.py:171: in read_parquet lf = scan_parquet( ../../miniconda3/envs/pyglider/lib/python3.12/site-packages/polars/_utils/deprecation.py:134: in wrapper return function(*args, **kwargs) ../../miniconda3/envs/pyglider/lib/python3.12/site-packages/polars/_utils/deprecation.py:134: in wrapper return function(*args, **kwargs) ../../miniconda3/envs/pyglider/lib/python3.12/site-packages/polars/io/parquet/functions.py:311: in scan_parquet return pl.LazyFrame._scan_parquet( ../../miniconda3/envs/pyglider/lib/python3.12/site-packages/polars/lazyframe/frame.py:458: in _scan_parquet scan = _scan_parquet_fsspec(source, storage_options) # type: ignore[arg-type] ../../miniconda3/envs/pyglider/lib/python3.12/site-packages/polars/io/parquet/anonymous_scan.py:21: in _scan_parquet_fsspec schema = polars.io.parquet.read_parquet_schema(data) ../../miniconda3/envs/pyglider/lib/python3.12/site-packages/polars/io/parquet/functions.py:213: in read_parquet_schema return _read_parquet_schema(source) E FileNotFoundError: No such file or directory (os error 2): ...yglider/tests/example-data/example-seaexplorer/realtime_rawnc//dfo-eva035-rawgli.parquet =========================================================== short test summary info ============================================================ ERROR tests/test_pyglider.py - FileNotFoundError: No such file or directory (os error 2): ...yglider/tests/example-data/example-seaexplorer/realtime_rawnc//dfo-eva035-raw... !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! =============================================================== 1 error in 3.86s ===============================================================
Do you have polars installed?
I appear to have it in my environment.
$ conda list | grep polars polars 0.20.16 py312h21dbfff_0 conda-forge
The
pytest
currently fails. It looks like the raw data is there, but the test is not producing the parquet file. I am using the latest commit: https://github.com/c-proof/pyglider/commit/71c6e1309279ae39a74c17a6edcc4d6cf6a715ac