search

man-group / ArcticDB

ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem.
http://arcticdb.io
Other
1.52k stars 93 forks source link

Compat lmdb tests occasionally segfault. #1922

Open IvoDD opened 1 month ago

IvoDD commented 1 month ago

Describe the bug

We are seeing segdaults in compat linux tests on lmdb occasionally like here:

The failure looks like:

INFO     Compatibility tests:conftest.py:24 Executing command: ['bin/python', '/tmp/tmp7t1w0w1d/run.py']
WARNING  Compatibility tests:conftest.py:28 Command failed, stdout: b'', stderr: b'terminate called without an active exception\n'
...
FAILED tests/compat/arcticdb/test_compatibility.py::test_modify_old_library_option_with_current[1.6.2-lmdb] - tests.compat.conftest.ErrorInVenv: Executing ['from arcticdb import Arctic', 'import pandas as pd', 'import numpy as np', "ac = Arctic('lmdb:///tmp/parallel_test/temp-pytest-output/test_modify_old_library_option0')", "expected_df = pd.read_parquet('/tmp/tmp7t1w0w1d/expected_df.parquet')", "lib = ac.get_library('test_modify_old_library_option.280_2024-10-15T11_32_54_011409')", "read_df = lib.read('sym').data", 'pd.testing.assert_frame_equal(read_df, expected_df)'] failed with return code -6

Steps/Code to Reproduce

Rerun any of the compat lmdb tests.

Expected Results

Test always succeeds.

OS, Python Version and ArcticDB Version

Any linux version in CI

Backend storage used

No response

Additional Context

No response