search

nicolay-r / AREkit

Document level Attitude and Relation Extraction toolkit (AREkit) for sampling and processing large text collections with ML and for ML
https://nicolay-r.github.io/arekit-page/
MIT License
58 stars 3 forks source link

DataFolding has dictionary type (Exception) #518

Closed nicolay-r closed 1 year ago

nicolay-r commented 1 year ago

Here, data_type has dict type, so we just need to direct access folding for the related type. However, we need to consider the case of doc_ids when we do not provide folding.

489 related

https://github.com/nicolay-r/AREkit/blob/2b2dd19789bc8a09d25490f1cae147c4f2b8d8cf/arekit/contrib/utils/pipelines/items/sampling/base.py#L56

https://github.com/nicolay-r/AREkit/blob/2b2dd19789bc8a09d25490f1cae147c4f2b8d8cf/arekit/contrib/utils/pipelines/items/sampling/base.py#L35-L56C59