SainsburyWellcomeCentre / aeon_mecha

Project Aeon's main library for interfacing with acquired data. Contains modules for raw data file io, data querying, data processing, data qc, database ingestion, and building computational data pipelines.
BSD 3-Clause "New" or "Revised" License
6 stars 6 forks source link

new readers and schemas for reduced data storage in db #437

Closed jkbhagatio closed 2 weeks ago

jkbhagatio commented 1 month ago

Summary by CodeRabbit

github-actions[bot] commented 1 month ago

Image description CodeRabbit

Walkthrough

The changes primarily focus on restructuring the data ingestion process in the Aeon project. The read method from the Encoder class has been removed, potentially affecting how encoder data is read and processed. New readers for encoder and video data have been introduced, along with new streams and stream groups. Schemas for different experimental setups have been defined and exported for external use. The changes also include new readers and schemas for reduced data storage, adjustments in function calls and imports, and new classes for reading encoder and video data.

Changes

Files Summary
aeon/io/reader.py, aeon/schema/ingestion_schemas.py, tests/io/test_api.py These files have undergone significant structural changes. The read method from the Encoder class has been removed, which could impact the way encoder data is read and processed. New readers for encoder and video data have been introduced, along with new streams and stream groups. Schemas for different experimental setups have been defined and are now available for external use. Additionally, these changes introduce new readers and schemas for reduced data storage in the database. The code changes involve significant additions and modifications that may impact the overall behavior and structure of the system.

Uplevel your code reviews with CodeRabbit Pro ### CodeRabbit Pro If you like this project, please support us by purchasing the [Pro version](https://coderabbit.ai). The Pro version has advanced context, superior noise reduction and several proprietary improvements compared to the open source version. Moreover, CodeRabbit Pro is free for open source projects.
codecov[bot] commented 1 month ago

Codecov Report

Attention: Patch coverage is 87.80488% with 5 lines in your changes missing coverage. Please review.

Project coverage is 19.41%. Comparing base (83cd905) to head (daf6224).

Files with missing lines Patch % Lines
aeon/schema/ingestion_schemas.py 87.50% 5 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #437 +/- ## ========================================== + Coverage 18.77% 19.41% +0.63% ========================================== Files 37 38 +1 Lines 3009 3039 +30 ========================================== + Hits 565 590 +25 - Misses 2444 2449 +5 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

jkbhagatio commented 2 weeks ago

Closing this since this was done in #438