checking the md5 of 50Gb file (sCMOS..dat) takes several minutes, which is unacceptable if the entire test is a few minutes long anyway. Plus this will happen in any test where we wish to use the sCMOS file. This is a perfect usecase to skip the checksum (by specifying hash: None) for this entry, and take the responsibility of not modifying the file on dropbox to ourselves.
No need for pytest.ini - pyproject.toml should suffice.
I don't like the idea of decorating tests as @expensive. This is fine for one-off tests, but we're putting all expensive tests in a separate folder anyway, so essentially we're specifying the same thing twice. Plus we will need to decorate every single test in this folder in the future. pytest is capable of ignoring folders using certain flags, so those kinda flags should be specifiable in pyproject.toml as well.
Data in dropbox should go in a common folder, and links obtained once files are moved to their most natural locations (mimicking the experiment folder structure we're likely to encounter). EDIT: I see you already did this? A bit dangerous to do since this would modify the links. Fortunately for us Dropbox doesn't seem to modify the links when you move files/folders around without changing their contents. But in any case the new links need to be double checked to make sure they haven't changed.
Make the dropbox folder readonly once you've verified that everything works.
Some issues here:
md5of 50Gb file (sCMOS..dat) takes several minutes, which is unacceptable if the entire test is a few minutes long anyway. Plus this will happen in any test where we wish to use thesCMOSfile. This is a perfect usecase to skip the checksum (by specifyinghash: None) for this entry, and take the responsibility of not modifying the file on dropbox to ourselves.pytest.ini-pyproject.tomlshould suffice.@expensive. This is fine for one-off tests, but we're putting all expensive tests in a separate folder anyway, so essentially we're specifying the same thing twice. Plus we will need to decorate every single test in this folder in the future.pytestis capable of ignoring folders using certain flags, so those kinda flags should be specifiable inpyproject.tomlas well.