c-w-m commented 3 years ago

Arctic Version

# Arctic version: 1.80.0
based on 12/22/20 clone of https://github.com/man-group/arctic.git

My Test System:

Ubuntu 16.04
Python 3.6 environment
Virtualenv 20.0.35 (.venv36)
PyCharm 2020.3

Problem Description

close to ~300 test failures on first attempted test
```
python setup.py develop test
```

I suspect some of the dependencies I'm using do not match your development setup. I'll list my setup requirements.txt and FIXME notes which outline my attempted remedies.

Any guidance on the setup or my approach to 'FIX' the issues would be greatly appreciated.

Thanks, cm

My Requirements.txt

apipkg~=1.5
attrs~=20.2.0
certifi~=2020.12.5
cffi~=1.14.4
chardet~=3.0.4
contextlib2~=0.6.0.post1
coverage~=5.3.1
cryptography~=3.1.1
Cython~=0.29.21
decorator~=4.4.2
enum-compat~=0.0.3
enum34~=1.1.10
execnet~=1.7.1
Faker~=5.0.2
future~=0.18.2
idna~=2.10
inflection~=0.5.1
iniconfig~=1.1.1
ipython~=5.8.0
lz4~=3.1.1
mock~=4.0.3
mockextras~=1.0.2
nose~=1.3.7
numpy~=1.19.4
packaging~=20.8
pandas~=1.1.5
path~=15.0.1
pexpect~=4.8.0
pickleshare~=0.7.5
pip~=20.3.3
pluggy~=0.13.1
psutil~=5.8.0
ptyprocess~=0.6.0
py~=1.9.0
pycparser~=2.20
Pygments~=2.7.3
pymongo~=3.11.2
pyparsing~=2.4.7
pytest-cov~=2.10.1
pytest-server-fixtures~=1.7.0
pytest-timeout~=1.4.2
pytest-xdist~=1.26.1
pytest~=6.1.2
python-dateutil~=2.8.1
pytz~=2020.4
Quandl~=3.5.3
requests~=2.24.0
retry~=0.9.2
setuptools-git~=1.2
setuptools~=49.6.0
simplegeneric~=0.8.1
six~=1.15.0
toml~=0.10.2
traitlets~=4.3.3
tzlocal~=2.1
urllib3~=1.25.11
virtualenv~=20.0.35
wcwidth~=0.2.5
wheel~=0.36.2
zipp~=3.3.2

My `FIXME` Notes

My attempts to remedy (or ignore) test errors:

Note: the line numbers might differ from from your code base due to the comments and attempted FIX code that was added.

| Descriptions ....................................| Line Numbers | Notes

FIXME: CM#001 - (str)

tzlocal does not have a zone property , string cast
look for benchmark impact
arctic
- arctic/date/_mktz.py: 33 str cast
  tests
- tests/unit/date/test_mktz.py 9 str cast

FIXME: CM#002 - (xfail) - BUG? datastructure changed

if the datastructure changed then update expected value by removing the missing field
xfail
test_indexes(arctic):
tests
- test_arctic.py 81-127 remove u'ns': u'arctic.library',

FIXME: CM#003 - similar to (issue #420)

date read from MongoDB does not come back with freq set (it is null)
new method
add_idx_freq
tests
- tests/util.py 77-91 add add_idx_freq(idx, freq) (similarly for other files)
- tests/integration/chuckstore/test_chunckstore.py 12 from tests.util import add_idx_freq
- tests/integration/chuckstore/test_chunckstore.py 716-723 expose reads and add freq
- tests/integration/chuckstore/test_chunckstore.py 1044-1046 expose reads and add freq
- tests/integration/chunkstore/test_fixes.py 12 from tests.util import add_idx_freq
- tests/integration/chunkstore/test_fixes.py 171-173 expose reads and add freq
- tests/integration/store/test_pandas_store.py 16 from tests.util import add_idx_freq
- tests/integration/store/test_pandas_store.py 858-904 expose reads and add freq
- tests/integration/store/test_version_store.py 29

FIXME: CM#004 - (xfail) - verify mock behavior of MongoDB transactions

verify mock behavior of MongoDB transactions
xfail
test_cleanup_orphaned_chunks(mongo_host, library, data, dry_run, fw_pointers_config)
test_cleanup_orphaned_snapshots(mongo_host, library, data, dry_run, fw_pointers_config)
tests
- tests/integration/scripts/test_arctic_fsck.py 32 xfail
- tests/integration/scripts/test_arctic_fsck.py 50-56 expand for debug - no fix
- tests/integration/scripts/test_arctic_fsck.py 144 xfail
- tests/integration/scripts/test_arctic_fsck.py 174-175 expand for debug - no fix

FIXME: CM#005 - (deprecate pandas.util.testing)

replace pandas.util.testing to pandas.testing
arctic
- arctic/tickstore/_util.py 6
  tests
- tests/integration/chunckstore/tools/test_tools.py 6
- tests/integration/chuckstore/test_chunckstore.py 10
- tests/integration/chunkstore/test_fixes.py 10
- tests/integration/chunckstore/test_utils.py 6
- tests/integration/scripts/test_copy_data.py 3
- tests/integration/store/test_bitemporal_store.py 10
- tests/integration/store/test_metadata_store.py 9
- tests/integration/store/test_pandas_store.py 13
- tests/integration/store/test_version_store.py 14
- tests/integration/store/test_version_store_audit.py 6
- tests/integration/tickstore/test_toplevel.py 6
- tests/integration/tickstore/test_ts_read.py 9
- tests/integration/tickstore/test_ts_write.py 5
- tests/integration/test_arctic.py 6
- tests/integration/test_copy_data.py 3
- tests/unit/chunkstore/test_date_chunker.py 7
- tests/unit/serialization/test_numpy_arrays.py 4
- tests/unit/store/test_bitemporal_store.py 4
- tests/unit/tickstore/test_toplevel.py 12
- tests/unit/test_multi_index.py 8

FIXME: CM#006 - (xfail) - verify library.write and prune behavior

verify library.write and prune behavior
xfail
test_fix_broken_snapshot_references(library)
test_keep_only_one_version(library)
test_fix_broken_snapshot_references(library)
test_keep_only_one_version(library)
tests
- tests/integration/scripts/test_prune_versions.py 2 import pytest
- tests/integration/scripts/test_prune_versions.py 54 xfail
- tests/integration/scripts/test_prune_versions.py 57-67 expand for debug - no fix
- tests/integration/scripts/test_prune_versions.py 70 xfail
- tests/integration/scripts/test_prune_versions.py 74-84 expand for debug - no fix

FIXME: CM#007 - (deprecated tostring)

replace with tobytes() or str cast, no change for some code not yet revised
look for benchmark impact
arctic
- arctic/serialization/incremental.py 223 tobytes
- arctic/serialization/numpy_arrays.py 119 tobytes
- arctic/store/_ndarray_store.py 449 tobytes
- arctic/store/_ndarray_store.py 600 tobytes
- arctic/store/_ndarray_store.py 657 tobytes
- arctic/store/_pandas_ndarray_store.py 58 tobytes
- arctic/tickstore/tickstore.py 707 tobytes
- arctic/tickstore/tickstore.py 718 tobytes
- arctic/tickstore/tickstore.py 727 tobytes
  tests
- tests/integration/store/test_ndarray_store_append.py 112 tobytes
- tests/integration/store/test_ndarray_store_append.py 138 tobytes
- tests/integration/store/test_ndarray_store_append.py 155 tobytes
- tests/integration/store/test_ndarray_store_append.py 172 tobytes
- tests/unit/serialization/test_incremental.py 53 str cast
- tests/unit/serialization/test_incremental.py 73, 101, 136 tobytes

FIXME: CM#008 - (expand cases for build_index_array)

multiple cases need to be handled for `def _index_from_records(self, recarr)
verify benchmark impact
arctic

arctic/serialization/numpy_records.py: 95-107 add build_index_array

FIXME: CM#009 - (replace assert_frame_equal with df.equals)

replace assert_frame_equal with df.equals
tests
- tests/integration/store/test_pickle_store.py: 802-826
- tests/integration/store/test_pickle_store.py: 838, 843
- tests/integration/store/test_pickle_store.py: 917-935
- tests/integration/store/test_version_store.py 1162, 1165, 1183, 1186, 1234, 1241
- tests/integration/store/test_version_store.py 1262, 1281, 1285, 1289, 1303, 1312
- tests/integration/store/test_version_store.py 1365, 1382, 1403, 1426, 1446, 1465
- tests/integration/store/test_version_store.py 1488
- tests/integration/tickstore/test_toplevel.py 65, 84, 202, 205, 221
- tests/integration/tickstore/test_ts_read.py 245-281

FIXME: CM#010 - (deprecate numpy.testing.utils)

replace numpy.testing.utils with numpy.testing
tests
- tests/integration/tickstore/test_ts_read.py 9

FIXME: CM#011 - (xfail) - BUG? read does not return Jan 1st

read does not return January 1st
xfail
test_should_return_data_when_date_range_falls_in_a_single_underlying_library(toplevel_tickstore, arctic)
test_should_return_data_when_date_range_spans_libraries(toplevel_tickstore, arctic)
test_should_write_top_level_with_list_of_dicts(arctic)
test_should_write_top_level_with_correct_timezone(arctic)
tests
- tests/integration/tickstore/test_toplevel.py 51 xfail
- tests/integration/tickstore/test_toplevel.py 64 res read BUG?
- tests/integration/tickstore/test_toplevel.py 68 xfail
- tests/integration/tickstore/test_toplevel.py 76-80 expose variables for debug
- tests/integration/tickstore/test_toplevel.py 82 res read BUG?
- tests/integration/tickstore/test_toplevel.py 191 xfail
- tests/integration/tickstore/test_toplevel.py 201 res read BUG?
- tests/integration/tickstore/test_toplevel.py 208 xfail
- tests/integration/tickstore/test_toplevel.py 220 res read BUG?

FIXME: CM#012 - (xfail) - BUG? first value in CLOSED-CLOSED read is not returned

correct expected value
xfail
test_date_range(tickstore_lib)
test_date_range_end_not_in_range(tickstore_lib)
test_date_range_default_timezone(tickstore_lib, tz_name)
def test_date_range_no_bounds(tickstore_lib)
tests

tests/integration/tickstore/test_toplevel.py 232, 287, 312, 347

FIXME: CM#013 - (xfail) - BUG? losing_writer did not call `delete_version`

losing_writer did not call delete_version
xfail
test_ArcticTransaction_detects_concurrent_writes()
tests

tests/unit/store/test_version_store_audit.py 179

FIXME: CM#014 - (xfail) - (?query string format changed)

the query string content matches with the exception of some added detail
xfail
test_mongo_date_range_query()
tests

tests/unit/tickstore/test_tickstore.py 43

FIXME: CM#015 - (xfail) - (?index string format changed)

the index string content matches but there is some added detail
xfail
test_tickstore_to_bucket_with_image()
test_tickstore_pandas_to_bucket_image()
tests

tests/unit/tickstore/test_tickstore.py 99 tests/unit/tickstore/test_tickstore.py 169

FIXME: CM#016 - (xfail) - (OverlappingDataException)

toplevel_tickstore.add fails with OverlappingDataException
xfail
test_should_add_underlying_library_where_another_library_exists_in_a_non_overlapping_daterange(toplevel_tickstore, arctic)
tests

tests/integration/tickstore/test_toplevel.py 118

bmoscon commented 3 years ago

no, none of them are expected, and all need to be fixed

flxsa-dev commented 3 years ago

Do you want my changes on a new branch to decide if you want to merge them back into the master?

bmoscon commented 3 years ago

sure if you open a PR we'd probably take the fixes

c-w-m commented 3 years ago

Hi Bryant ( @bmoscon ), I pushed the partial fix changes (leaving out the skip test changes). My notes are in the /docs/history directory and most the code changes have a #FIXME: CM... comment to help find like items.

I've also added tox.ini to help setup env for dev/test, and benchmarking Initially I had tox.ini use setup.py to determine the requirement packages but after looking into .travis.yml I see pip is used to update many items to that has also been added to the tox.ini. Similarly, the benchmark env is setup in .tox.ini (but not run) and expects the /asv directory in the arctic project root. (I tried asv as a submodule but this breaks travis testing so I've removed it).

I'm still kicking the tires on this project but I very much like what the team has put together ;-)

Hope this is helpful, cm

Travis Results

Python 2.7:

Status	before	after	delta
failed	0	0	0
passed	1317	1317	0
skipped	3	3	0
xfailed	6	6	0
xpassed	13	13	0
warnings	41	41	0
test time	1301.89	1320.49	-18.6

Python 3.6:

Status	before	after	delta
failed	61	5	-56
passed	1255	1311	+56
skipped	3	3	0
xfailed	19	19	0
xpassed	1	1	0
warnings	60848	60744	-104
test time	1322.83	1292.21	+30.62

Python 3.7

Travis log was truncated (log reached size limit and aborted test). From the tox run I get the following:

Python 3.7 (dev37) Test Pareto

Status	before	after
failed	broken	230
passed	broken	1086
skipped	broken	3
xfailed	broken	20
xpassed	broken	0
warnings	broken	58860
test sec	broken	2560.64

Note: dev37 was broken due to the pandas Panel


=========================== short test summary info ============================
FAILED tests/integration/test_arctic.py::test_indexes - AssertionError: asser...
FAILED tests/integration/test_arctic.py::test_quota - NameError: name 'Panel'...
FAILED tests/integration/test_arctic.py::test_lib_rename - NameError: name 'P...
FAILED tests/integration/test_arctic.py::test_lib_rename_namespace - NameErro...
FAILED tests/integration/test_arctic_multithreading.py::test_multiprocessing_safety
FAILED tests/integration/test_arctic_multithreading.py::test_multiprocessing_safety_parent_children_race
FAILED tests/integration/test_howtos.py::test_howto[how_to_use_arctic.py] - N...
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks[True-data0-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks[True-data1-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks[True-data2-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks[False-data6-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks[False-data7-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks[False-data8-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks[False-data9-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks[False-data10-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks[False-data11-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_noop[True-data0-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_noop[True-data1-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_noop[True-data2-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_noop[False-data6-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_noop[False-data7-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_noop[False-data8-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks_ignores_recent[True-data0-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks_ignores_recent[True-data1-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks_ignores_recent[True-data2-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks_ignores_recent[False-data6-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks_ignores_recent[False-data7-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunks_ignores_recent[False-data8-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunk_doesnt_break_versions[data0-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunk_doesnt_break_versions[data1-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunk_doesnt_break_versions[data2-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunk_doesnt_break_versions[data3-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunk_doesnt_break_versions[data4-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_chunk_doesnt_break_versions[data5-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots[True-data0-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots[True-data1-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots[True-data2-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots[False-data6-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots[False-data7-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots[False-data8-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots[False-data9-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots[False-data10-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots[False-data11-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots_nop[True-data0-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots_nop[True-data1-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots_nop[True-data2-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots_nop[False-data6-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots_nop[False-data7-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_cleanup_orphaned_snapshots_nop[False-data8-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_dont_cleanup_recent_orphaned_snapshots[True-data0-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_dont_cleanup_recent_orphaned_snapshots[True-data1-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_dont_cleanup_recent_orphaned_snapshots[True-data2-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_dont_cleanup_recent_orphaned_snapshots[False-data6-FwPointersCfg.DISABLED]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_dont_cleanup_recent_orphaned_snapshots[False-data7-FwPointersCfg.HYBRID]
FAILED tests/integration/scripts/test_arctic_fsck.py::test_dont_cleanup_recent_orphaned_snapshots[False-data8-FwPointersCfg.ENABLED]
FAILED tests/integration/scripts/test_initialize_library.py::test_init_library
FAILED tests/integration/scripts/test_initialize_library.py::test_init_library_no_arctic_prefix
FAILED tests/integration/scripts/test_prune_versions.py::test_prune_versions_full
FAILED tests/integration/scripts/test_prune_versions.py::test_keep_recent_snapshots
FAILED tests/integration/scripts/test_prune_versions.py::test_fix_broken_snapshot_references
FAILED tests/integration/scripts/test_prune_versions.py::test_keep_only_one_version
FAILED tests/integration/store/test_bitemporal_store.py::test_write_ts_with_column_name_same_as_observed_dt_ok
FAILED tests/integration/store/test_ndarray_store.py::test_write_new_column_name_to_arctic_1_40_data
FAILED tests/integration/store/test_ndarray_store.py::test_save_read_simple_ndarray
FAILED tests/integration/store/test_ndarray_store.py::test_save_read_big_1darray[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store.py::test_save_read_big_1darray[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store.py::test_save_read_big_1darray[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store.py::test_save_and_resave_reuses_chunks[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store.py::test_save_and_resave_reuses_chunks[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store.py::test_save_and_resave_reuses_chunks[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store.py::test_save_read_big_2darray[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store.py::test_save_read_big_2darray[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store.py::test_save_read_big_2darray[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store.py::test_get_info_bson_object
FAILED tests/integration/store/test_ndarray_store.py::test_save_read_ndarray_with_array_field
FAILED tests/integration/store/test_ndarray_store.py::test_save_read_ndarray
FAILED tests/integration/store/test_ndarray_store.py::test_multiple_write[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store.py::test_multiple_write[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store.py::test_multiple_write[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store.py::test_save_read_large_ndarray
FAILED tests/integration/store/test_ndarray_store.py::test_mutable_ndarray - ...
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_simple_ndarray[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_simple_ndarray[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_simple_ndarray[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_simple_ndarray_promoting_types[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_simple_ndarray_promoting_types[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_simple_ndarray_promoting_types[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_promote_types
FAILED tests/integration/store/test_ndarray_store_append.py::test_promote_types2
FAILED tests/integration/store/test_ndarray_store_append.py::test_promote_types_smaller_sizes
FAILED tests/integration/store/test_ndarray_store_append.py::test_promote_types_larger_sizes
FAILED tests/integration/store/test_ndarray_store_append.py::test_promote_field_types_smaller_sizes
FAILED tests/integration/store/test_ndarray_store_append.py::test_promote_field_types_larger_sizes
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_ndarray_with_field_shape[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_ndarray_with_field_shape[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_ndarray_with_field_shape[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_read_large_ndarray[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_read_large_ndarray[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_read_large_ndarray[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_save_append_read_ndarray[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_save_append_read_ndarray[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store_append.py::test_save_append_read_ndarray[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_save_append_read_1row_ndarray
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_too_large_ndarray
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_field_append_keeps_all_columns
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_promotes_dtype[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_promotes_dtype[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_promotes_dtype[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_promotes_dtype2
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_promotes_dtype3
FAILED tests/integration/store/test_ndarray_store_append.py::test_convert_to_structured_array
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_concat_and_rewrite[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_concat_and_rewrite[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_concat_and_rewrite[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_concat_and_rewrite_2[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_concat_and_rewrite_2[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_concat_and_rewrite_2[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_concat_and_rewrite_3[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_concat_and_rewrite_3[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store_append.py::test_empty_append_concat_and_rewrite_3[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_with_extra_columns
FAILED tests/integration/store/test_ndarray_store_append.py::test_save_append_delete_append[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_save_append_delete_append[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store_append.py::test_save_append_delete_append[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_after_failed_append[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_after_failed_append[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_after_failed_append[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_ndarray_store_append.py::test_append_reorder_columns
FAILED tests/integration/store/test_pandas_store.py::test_can_write_pandas_df_with_object_columns
FAILED tests/integration/store/test_pandas_store.py::test_duplicate_labels - ...
FAILED tests/integration/store/test_pandas_store.py::test_no_labels - NameErr...
FAILED tests/integration/store/test_pickle_store.py::test_save_read_bson - Na...
FAILED tests/integration/store/test_pickle_store.py::test_save_read_big_encodable
FAILED tests/integration/store/test_pickle_store.py::test_save_read_bson_object
FAILED tests/integration/store/test_pickle_store.py::test_get_info_bson_object
FAILED tests/integration/store/test_pickle_store.py::test_bson_large_object
FAILED tests/integration/store/test_pickle_store.py::test_bson_leak_objects_delete
FAILED tests/integration/store/test_pickle_store.py::test_bson_leak_objects_prune_previous
FAILED tests/integration/store/test_pickle_store.py::test_prune_previous_doesnt_kill_other_objects
FAILED tests/integration/store/test_pickle_store.py::test_write_metadata - Na...
FAILED tests/integration/store/test_version_store.py::test_read_metadata_throws_on_deleted_symbol[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_read_metadata_throws_on_deleted_symbol[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_read_metadata_throws_on_deleted_symbol[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_append_should_overwrite_after_delete[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_append_should_overwrite_after_delete[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_append_should_overwrite_after_delete[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_list_version_deleted
FAILED tests/integration/store/test_version_store.py::test_delete_bson_versions[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_delete_bson_versions[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_delete_bson_versions[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_read_none_does_not_exception[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_read_none_does_not_exception[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_read_none_does_not_exception[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_delete_item_has_symbol[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_delete_item_has_symbol[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_delete_item_has_symbol[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_delete_item_snapshot[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_delete_item_snapshot[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_delete_item_snapshot[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_prunes_multiple_versions[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_prunes_multiple_versions[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_prunes_multiple_versions[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_prunes_doesnt_prune_snapshots[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_prunes_doesnt_prune_snapshots[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_prunes_doesnt_prune_snapshots[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_list_symbols[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_list_symbols[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_list_symbols[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_list_symbols_regex[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_list_symbols_regex[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_list_symbols_regex[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_list_symbols_newer_version_with_lower_id[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_list_symbols_newer_version_with_lower_id[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_list_symbols_newer_version_with_lower_id[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_list_symbols_write_snapshot_write_delete[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_list_symbols_write_snapshot_write_delete[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_list_symbols_write_snapshot_write_delete[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_list_symbols_delete_write[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_list_symbols_delete_write[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_list_symbols_delete_write[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_write_metadata_new_symbol[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_write_metadata_new_symbol[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_write_metadata_new_symbol[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_write_metadata_purge_previous_versions[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_write_metadata_purge_previous_versions[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_write_metadata_purge_previous_versions[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_write_metadata_delete_symbol[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_write_metadata_delete_symbol[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_write_metadata_delete_symbol[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_restore_version_snap_delete_symbol_restore[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_restore_version_snap_delete_symbol_restore[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_restore_version_snap_delete_symbol_restore[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_restore_from_version_with_deleted_symbol[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_restore_from_version_with_deleted_symbol[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_restore_from_version_with_deleted_symbol[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_snapshot_list_versions_after_delete[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_snapshot_list_versions_after_delete[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_snapshot_list_versions_after_delete[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_write_non_serializable_pickling_default[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_write_non_serializable_pickling_default[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_write_non_serializable_pickling_default[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_write_strict_no_daterange[FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_write_strict_no_daterange[FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_write_strict_no_daterange[FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_write_df_with_objects_in_index
FAILED tests/integration/store/test_version_store.py::test_write_series_with_objects_in_index
FAILED tests/integration/store/test_version_store.py::test_write_series_with_some_objects[input_series0]
FAILED tests/integration/store/test_version_store.py::test_write_series_with_some_objects[input_series1]
FAILED tests/integration/store/test_version_store.py::test_fwpointer_enabled_write_delete_keep_version_append
FAILED tests/integration/store/test_version_store.py::test_version_arctic_version
FAILED tests/integration/store/test_version_store.py::test_prune_crossref_fwpointer_configs[FwPointersCfg.DISABLED-FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_prune_crossref_fwpointer_configs[FwPointersCfg.DISABLED-FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_prune_crossref_fwpointer_configs[FwPointersCfg.HYBRID-FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store.py::test_prune_crossref_fwpointer_configs[FwPointersCfg.HYBRID-FwPointersCfg.ENABLED]
FAILED tests/integration/store/test_version_store.py::test_prune_crossref_fwpointer_configs[FwPointersCfg.ENABLED-FwPointersCfg.HYBRID]
FAILED tests/integration/store/test_version_store.py::test_prune_crossref_fwpointer_configs[FwPointersCfg.ENABLED-FwPointersCfg.DISABLED]
FAILED tests/integration/store/test_version_store_audit.py::test_write_after_delete
FAILED tests/integration/tickstore/test_toplevel.py::test_should_return_data_when_date_range_falls_in_a_single_underlying_library
FAILED tests/integration/tickstore/test_toplevel.py::test_should_return_data_when_date_range_spans_libraries
FAILED tests/integration/tickstore/test_toplevel.py::test_should_return_data_when_date_range_spans_libraries_even_if_one_returns_nothing
FAILED tests/integration/tickstore/test_toplevel.py::test_should_add_underlying_library_where_another_library_exists_in_a_non_overlapping_daterange
FAILED tests/integration/tickstore/test_toplevel.py::test_should_write_top_level_with_list_of_dicts
FAILED tests/integration/tickstore/test_toplevel.py::test_should_write_top_level_with_correct_timezone
FAILED tests/integration/tickstore/test_ts_read.py::test_date_range[tickstore]
FAILED tests/integration/tickstore/test_ts_read.py::test_date_range_end_not_in_range[tickstore]
FAILED tests/integration/tickstore/test_ts_read.py::test_date_range_no_bounds[tickstore]
FAILED tests/unit/store/test_version_store_audit.py::test_ArcticTransaction_detects_concurrent_writes
FAILED tests/unit/tickstore/test_tickstore.py::test_mongo_date_range_query - ...
FAILED tests/unit/tickstore/test_tickstore.py::test_tickstore_to_bucket_with_image
FAILED tests/unit/tickstore/test_tickstore.py::test_tickstore_pandas_to_bucket_image
```|

c-w-m commented 3 years ago

Closing this based on proposed next step

903 opened 3 minutes ago by c-w-m

pin pandas to a max version to green light travis py3.x builds

man-group / arctic

v1.80 test failures - are these expected? #878

Arctic Version

My Test System:

Problem Description

My Requirements.txt

My FIXME Notes

FIXME: CM#001 - (str)

arctic

tests

FIXME: CM#002 - (xfail) - BUG? datastructure changed

xfail

tests

FIXME: CM#003 - similar to (issue #420)

new method

tests

FIXME: CM#004 - (xfail) - verify mock behavior of MongoDB transactions

xfail

tests

FIXME: CM#005 - (deprecate pandas.util.testing)

arctic

tests

FIXME: CM#006 - (xfail) - verify library.write and prune behavior

xfail

tests

FIXME: CM#007 - (deprecated tostring)

arctic

tests

FIXME: CM#008 - (expand cases for build_index_array)

arctic

FIXME: CM#009 - (replace assert_frame_equal with df.equals)

tests

FIXME: CM#010 - (deprecate numpy.testing.utils)

tests

FIXME: CM#011 - (xfail) - BUG? read does not return Jan 1st

xfail

tests

FIXME: CM#012 - (xfail) - BUG? first value in CLOSED-CLOSED read is not returned

xfail

tests

FIXME: CM#013 - (xfail) - BUG? losing_writer did not call delete_version

xfail

tests

FIXME: CM#014 - (xfail) - (?query string format changed)

xfail

tests

FIXME: CM#015 - (xfail) - (?index string format changed)

xfail

tests

FIXME: CM#016 - (xfail) - (OverlappingDataException)

xfail

tests

Travis Results

Python 2.7:

Python 3.6:

Python 3.7

Python 3.7 (dev37) Test Pareto

903 opened 3 minutes ago by c-w-m

My `FIXME` Notes

FIXME: CM#013 - (xfail) - BUG? losing_writer did not call `delete_version`