Natooz / MidiTok

MIDI / symbolic music tokenizers for Deep Learning models 🎶
https://miditok.readthedocs.io/
MIT License
665 stars 81 forks source link

Adding a `need_to_decode_bpe` argument to `data_augmentation_tokens` … #113

Closed Natooz closed 10 months ago

Natooz commented 10 months ago

If given None, the method will check if the sequence contains token ids encoded with BPE. This fixes a bug when giving non-be-encoded tokens to the method with a tokenizer using BPE.

codecov[bot] commented 10 months ago

Codecov Report

Attention: 6 lines in your changes are missing coverage. Please review.

Comparison is base (89c4678) 91.40% compared to head (89b0929) 91.33%.

Files Patch % Lines
miditok/data_augmentation/data_augmentation.py 25.00% 6 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #113 +/- ## ========================================== - Coverage 91.40% 91.33% -0.08% ========================================== Files 33 33 Lines 4794 4799 +5 ========================================== + Hits 4382 4383 +1 - Misses 412 416 +4 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.