Pre-processing enhancements

[AlexandruPascu]

Description

• Added the option for the user to say where the header data starts in the file, and the cycler the experiment was conducted with.
• Sanity checks are implemented as a tool for better understanding the pre-processing and the data available for further segmentation or processing techniques, besides the logger.
• Changed the handling of the cycler detection to be more robust and be able to pick up the cycler, but affected the time it takes, also improved data header detection.
• Added a new feature to detect the absolute time of the experiment from the experimental data or the metadata of the file which is added as a new column.

Fixes #22 (issue) Fixes #14 (issue) Fixes #11 (issue) Fixes #9 (issue)

Type of change

Please add a line in the relevant section of CHANGELOG.md to document the change (include PR #) - note reverse order of PR #s. If necessary, also add to the list of breaking changes.

• [x] New feature (non-breaking change which adds functionality)
• [ ] Optimization (back-end change that speeds up the code)
• [x] Bug fix (non-breaking change which fixes an issue)

Key checklist

• [ ] No style issues: $ python -m nox -s lint
• [ ] All tests pass: $ python -m nox -s unit examples integration
• [ ] Coverage is complete $ python -m nox -s coverage
• [ ] The documentation builds: $ python -m nox -s sphinx

Further checks

• [x] Code is commented, particularly in hard-to-understand areas
• [ ] Tests added that prove fix is effective or that feature works

[PipGrylls]

Working on it now but most of the tests are failing, if the parser is updated, especially the default cycler e.t.c, the tests need to be updated in lockstep.

[PipGrylls]

Hi @AlexandruPascu Could you look over the tests, and do a bit of digging into the function defaults you’ve given. Some of the positional/default arguments are now None or Empty strings that get checked and crash out later. The command:

nox -s unit

Should pass without issue and until it does we cant merge these branches. I’ve pushed my initial work on it happy to chat on teams/zoom e.t.c...

[AlexandruPascu]

Hello @PipGrylls! Thanks for having a look over everything! Can you please drop me a message over Teams with when you'd be available for a call tomorrow? I think it would be easier to understand

[AlexandruPascu]

@PipGrylls could you please have a look at the Ubuntu tests? I think they are trying to run the example while the others not? Please let me know if there is smth I can do about that and have a look again at the code since now it's passing the tests :)