issues
search
modernmt
/
DataCollection
Data collection, alignment and TAUS repository
Apache License 2.0
20
stars
8
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
#19
mzeidhassan
opened
6 years ago
0
Cleaning script filter_hunalign_bitext.py silently fails when running out of memory
#18
achimr
opened
6 years ago
0
Remove duplicates from per-domain results
#17
achimr
closed
6 years ago
0
Index server domain hardcoded in locate_candidates_cc_index_api.py
#16
achimr
opened
6 years ago
0
Add rate-limiting for index server queries to locate_candidates_cc_index_api.py
#15
achimr
opened
6 years ago
0
locate_candidates.py cannot find about 30% of candidate locations in 2016_50 crawl
#14
achimr
closed
6 years ago
3
Arabic support
#13
mzeidhassan
closed
6 years ago
2
Compression, not language tagging seems to be the bottleneck in extract_monolingual.sh
#12
achimr
opened
7 years ago
0
Add support for CommonCrawl Index Server API
#11
treigerm
closed
6 years ago
1
candidates2corpus.py: verify that splitters exist
#10
achimr
opened
7 years ago
4
Update S3 CommonCrawl URL
#9
treigerm
closed
7 years ago
1
langstat2candidates.py requires large amounts of RAM
#8
achimr
opened
7 years ago
1
candidates2corpus.py to download corpus sometimes fails with OpenSSL.SSL.ZeroReturnError
#7
achimr
closed
7 years ago
1
Script candidates2corpus.py needs days to run for large language pairs
#6
achimr
opened
7 years ago
4
error installing pyrocksdb
#5
menpente
closed
7 years ago
5
Metadata database assumes wrong path in cdx files
#4
achimr
closed
7 years ago
0
Check whether we are using ranged requests to access subsections of WARC files
#3
achimr
closed
7 years ago
1
Filter log not written by filter_hunalign_bitext.py
#2
achimr
closed
7 years ago
0
testing pull requests
#1
christianbuck
closed
9 years ago
0