search

carbonplan / data

data catalogs and utilities
https://carbonplan.org/data
MIT License
16 stars 3 forks source link

Improve testing of flakey datasets #13

Closed jhamman closed 4 years ago

jhamman commented 4 years ago

This initial commit is expected to fail. Will fine tune using this branch/PR.

vercel[bot] commented 4 years ago

This pull request is being automatically deployed with Vercel (learn more).
To see the status of your deployment, click below or on the icon next to each commit.

🔍 Inspect: https://vercel.com/carbonplan/data/a38m61v9y
✅ Preview: https://data-git-fix-tests.carbonplan.vercel.app

jhamman commented 4 years ago

Here's the summary of currently failing tests:

2020-08-21T07:43:16.8957086Z =========================== short test summary info ============================
2020-08-21T07:43:16.8957592Z FAILED tests/test_catalogs.py::test_get_intake_source[('mtbs.raw_raster', {})]
2020-08-21T07:43:16.8958091Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raw_raster', {})]
2020-08-21T07:43:16.8958668Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raw_raster', {'option': 'error', 'region': 'conus', 'variable': 'foresttype'})]
2020-08-21T07:43:16.8959259Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raw_raster', {'option': 'error', 'region': 'conus', 'variable': 'forestgroup'})]
2020-08-21T07:43:16.8959844Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raw_raster', {'option': 'error', 'region': 'ak', 'variable': 'foresttype'})]
2020-08-21T07:43:16.8960421Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raw_raster', {'option': 'error', 'region': 'ak', 'variable': 'forestgroup'})]
2020-08-21T07:43:16.8961000Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raw_raster', {'option': 'raster', 'region': 'conus', 'variable': 'foresttype'})]
2020-08-21T07:43:16.8961593Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raw_raster', {'option': 'raster', 'region': 'conus', 'variable': 'forestgroup'})]
2020-08-21T07:43:16.8962174Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raw_raster', {'option': 'raster', 'region': 'ak', 'variable': 'foresttype'})]
2020-08-21T07:43:16.8963120Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raw_raster', {'option': 'raster', 'region': 'ak', 'variable': 'forestgroup'})]
2020-08-21T07:43:16.8963759Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {})] - ...
2020-08-21T07:43:16.8964354Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'conus', 'option': 'group', 'resolution': '250m'})]
2020-08-21T07:43:16.8965034Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'conus', 'option': 'group', 'resolution': '4000m'})]
2020-08-21T07:43:16.8965693Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'conus', 'option': 'type', 'resolution': '250m'})]
2020-08-21T07:43:16.8966268Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'conus', 'option': 'type', 'resolution': '4000m'})]
2020-08-21T07:43:16.8966847Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'conus', 'option': 'group_error', 'resolution': '250m'})]
2020-08-21T07:43:16.8967434Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'conus', 'option': 'group_error', 'resolution': '4000m'})]
2020-08-21T07:43:16.8968034Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'conus', 'option': 'type_error', 'resolution': '250m'})]
2020-08-21T07:43:16.8968619Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'conus', 'option': 'type_error', 'resolution': '4000m'})]
2020-08-21T07:43:16.8969201Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'ak', 'option': 'group', 'resolution': '250m'})]
2020-08-21T07:43:16.8969771Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'ak', 'option': 'group', 'resolution': '4000m'})]
2020-08-21T07:43:16.8970344Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'ak', 'option': 'type', 'resolution': '250m'})]
2020-08-21T07:43:16.8970914Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'ak', 'option': 'type', 'resolution': '4000m'})]
2020-08-21T07:43:16.8971495Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'ak', 'option': 'group_error', 'resolution': '250m'})]
2020-08-21T07:43:16.8972076Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'ak', 'option': 'group_error', 'resolution': '4000m'})]
2020-08-21T07:43:16.8972652Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'ak', 'option': 'type_error', 'resolution': '250m'})]
2020-08-21T07:43:16.8973232Z FAILED tests/test_catalogs.py::test_get_intake_source[('nftd.raster', {'region': 'ak', 'option': 'type_error', 'resolution': '4000m'})]
2020-08-21T07:43:16.8973737Z FAILED tests/test_catalogs.py::test_get_intake_source[('nlcd.raw_raster', {})]
2020-08-21T07:43:16.8974238Z FAILED tests/test_catalogs.py::test_get_intake_source[('nlcd.raster', {})] - ...
2020-08-21T07:43:16.8974752Z FAILED tests/test_catalogs.py::test_get_intake_source[('spawnetal2020.raw_raster', {})]
2020-08-21T07:43:16.8975265Z FAILED tests/test_catalogs.py::test_get_intake_source[('spawnetal2020.raster', {})]
2020-08-21T07:43:16.8975436Z =========== 31 failed, 85 passed, 2 skipped, 155 warnings in 56.60s ============