issues
search
cldf
/
segments
Unicode Standard tokenization routines and orthography profile segmentation
Apache License 2.0
31
stars
13
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Stricter validation in csvw breaks profile
#51
xrotwang
closed
2 years ago
1
Vietnamese tone contour grouping
#50
lfashby
closed
3 years ago
5
Averts IndexError on strings that are only diacritics
#49
lfashby
closed
4 years ago
7
Removes unused logging import and basicConfig.
#48
kylebgorman
closed
4 years ago
5
Logging in tokenizer.py ‘absorbs’ downstream logging
#47
lfashby
closed
4 years ago
2
Tokenizer IndexError on strings with just stress markers
#46
kylebgorman
closed
4 years ago
1
Add "keep" strategy for error handling
#45
Anaphory
closed
3 years ago
3
Tokenizer.transform ignores error handling argument
#44
Anaphory
opened
4 years ago
6
Deal with prenasalization marks
#43
Anaphory
closed
5 years ago
17
fixing one problem of the error handling procedure
#42
LinguList
closed
4 years ago
0
IPA tokenizer does not recognize pre-aspiration and pre-nazalization
#41
Anaphory
opened
5 years ago
3
re-add characters function
#40
bambooforest
closed
6 years ago
0
Fix confusing column labels in profile __unicode__ result
#39
Anaphory
closed
6 years ago
3
Citing Segments with DOI
#38
HughP
closed
6 years ago
3
Non-conatative orthography
#37
HughP
opened
6 years ago
3
Support tokenization with concatenated orthography profiles
#36
xrotwang
closed
6 years ago
1
Major Refactoring
#35
xrotwang
closed
6 years ago
11
Multi-segment graphemes
#34
xrotwang
opened
6 years ago
7
In CSVW description "NULL" in target column of profile should be specified as "null" property
#33
xrotwang
closed
6 years ago
0
Using plain "?" as exception marker conflicts with e.g. X-SAMPA
#32
xrotwang
closed
6 years ago
3
Fixed bug when tokenizing longer-than-one-char unknown graphemes.
#31
tresoldi
closed
6 years ago
2
Update to official orthography profile spec
#30
xrotwang
closed
6 years ago
3
Use information provided in BIPA of CLTS to provide a state-of-the-art IPA segmentizer
#29
LinguList
closed
6 years ago
5
adding state-of-the-art x-sampa conversion
#28
LinguList
opened
6 years ago
23
Handling of longer-than-one graphemes in case of errors
#27
tresoldi
closed
6 years ago
18
Parsing glitch with dental click (?)
#26
SimonGreenhill
closed
6 years ago
11
Text edits
#25
bambooforest
closed
6 years ago
1
refactored into a more modern package
#24
xrotwang
closed
6 years ago
5
update authorship
#23
bambooforest
closed
6 years ago
1
please draft a release and link to zenodo!
#22
LinguList
closed
6 years ago
7
fix problematic bug introduced by new clldutils api for csv files due to quotechar
#21
LinguList
closed
7 years ago
3
Add test for handling of special "NULL" target
#20
xrotwang
opened
7 years ago
0
consider putting segments on an official organisation
#19
LinguList
closed
6 years ago
2
Add some context info to profile creation
#18
xrotwang
closed
6 years ago
12
refactored cli, for usage see README.md
#17
xrotwang
closed
7 years ago
0
follow the profile spec more closely
#16
xrotwang
closed
7 years ago
1
Change orthography profile format default to "csv"
#15
LinguList
closed
7 years ago
25
Allow specification of lexeme boundary marker
#14
xrotwang
closed
7 years ago
3
Release 0.3
#13
xrotwang
closed
7 years ago
1
Profile creation should preset the `mapping` column with a copy of `graphemes`
#12
xrotwang
closed
7 years ago
0
Print line number when warning about duplicate graphemes
#11
xrotwang
closed
7 years ago
0
Logging must be configured
#10
xrotwang
closed
7 years ago
0
preparing release 0.2, with full test coverage
#9
xrotwang
closed
7 years ago
2
Refactored error handling
#8
xrotwang
closed
7 years ago
1
Confusing tokenization behaviour for incomplete orthography profiles
#7
xrotwang
closed
7 years ago
19
fix travis config
#6
xrotwang
closed
7 years ago
1
initial release on pypi
#5
xrotwang
closed
7 years ago
0
Streamlined package
#4
xrotwang
closed
7 years ago
2
refined functionality of tokenizer for interaction with other libraries
#3
LinguList
closed
7 years ago
3
Allow for NFC normalization in output
#2
LinguList
closed
7 years ago
5
Next