Closed nicolay-r closed 1 year ago
Reason: In some cases we may end up dealing with the very long sentences and texts without punkt signs. Once saved into samples, these sentences may quickly occupy the whole disk space :floppy_disk:
To enable this option, there is a need to switch onto cropping modes here: https://github.com/nicolay-r/ARElight/blob/75c339508215aa8383dbcf65eca11bea2e2fd981/arelight/samplers/bert.py#L50-L51
Reason: In some cases we may end up dealing with the very long sentences and texts without punkt signs. Once saved into samples, these sentences may quickly occupy the whole disk space :floppy_disk:
To enable this option, there is a need to switch onto cropping modes here: https://github.com/nicolay-r/ARElight/blob/75c339508215aa8383dbcf65eca11bea2e2fd981/arelight/samplers/bert.py#L50-L51