search

SciCatProject / scicat-filewriter-ingest

Python client that connects to a kafka queue and creates new datasets when receiving notification that a file has been written
0 stars 0 forks source link

[Refactoring] Split file omitting logics #3

Open YooSunYoung opened 4 months ago

YooSunYoung commented 4 months ago

Granular issue of #2

We will start with splitting file omitting logics from ingestor.

Probably this part....?? https://github.com/SciCatProject/scicat-filewriter-ingest/blob/3c5c22ea4e606719e55b7999e407f18470b4e76c/ingestor_lib.py#L261-L279