n-grams feature update & support for swerik v1.1.0 data - Githubissues

humlab-swedeb / swedeb-api

1 stars 0 forks source link

n-grams feature update & support for swerik v1.1.0 data #42

Closed roger-mahler closed 2 months ago

roger-mahler commented 2 months ago

Breaking changes:

Support for ^v1.1.0 ParlaClarin data (#35, #35)

Changes:

Added speech ids to n-gram result data (API change in NGramResult, https://github.com/humlab-swedeb/swedeb-api/commit/9749bdb7a8ee9c5c21564f4c6f2b5ef593af2b63, https://github.com/humlab-swedeb/swedeb-api/commit/4d299bc6d3874c2e4217644656a40c06c13d413e)
- Added (fixed) passing phrases to n-gram searches (https://github.com/humlab-swedeb/swedeb-api/commit/2134de3e379e2591e81afcdc3acf743545b58502, https://github.com/humlab-swedeb/swedeb-api/commit/25c5c7d010879496e702fcd48e626eafca457053, resolves #17)
CQP compiler now correctly compiles string literal patterns (https://github.com/humlab-swedeb/swedeb-api/commit/095effd7eaf635a4c618ebec81e94a3a280c5526)

Fixes related to v1.1.0:

Fixed discrepancy in protocol names (XML files attrbute vs name of file)

Other fixes:

Case-insensitive now handles values correctly (https://github.com/humlab-swedeb/swedeb-api/commit/e12cba1ff4c809f6d962ed9b1a8d9785862f68ec)
- Fixed handling of undefined prefix (#41, https://github.com/humlab-swedeb/swedeb-api/commit/caa0396307af9a485bc2a68b309fc7488b212c14)
- Removed faulty assignment of cached property (https://github.com/humlab-swedeb/swedeb-api/commit/095effd7eaf635a4c618ebec81e94a3a280c5526)

Dev. env. changes:

Test cases now uses v1.1.0 test data (https://github.com/humlab-swedeb/swedeb-api/commit/4047fb347e89583aba4127215933b7f9c5be3902)
Added and fixed several test cases (mosly adjusted to v1.1.0 test data, e.g. https://github.com/humlab-swedeb/swedeb-api/commit/d2c37588f6e9c32034aff2754880b05a2d4b5527)
A number of files have been formatted using isort and black