modernmt DataCollection issues

modernmt / DataCollection

Data collection, alignment and TAUS repository

Apache License 2.0

20 stars 8 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

error: command 'x86_64-linux-gnu-gcc' failed with exit status 1

#19 mzeidhassan opened 6 years ago
0
Cleaning script filter_hunalign_bitext.py silently fails when running out of memory

#18 achimr opened 6 years ago
0
Remove duplicates from per-domain results

#17 achimr closed 6 years ago
0
Index server domain hardcoded in locate_candidates_cc_index_api.py

#16 achimr opened 6 years ago
0
Add rate-limiting for index server queries to locate_candidates_cc_index_api.py

#15 achimr opened 6 years ago
0
locate_candidates.py cannot find about 30% of candidate locations in 2016_50 crawl

#14 achimr closed 6 years ago
3
Arabic support

#13 mzeidhassan closed 6 years ago
2
Compression, not language tagging seems to be the bottleneck in extract_monolingual.sh

#12 achimr opened 7 years ago
0
Add support for CommonCrawl Index Server API

#11 treigerm closed 6 years ago
1
candidates2corpus.py: verify that splitters exist

#10 achimr opened 7 years ago
4
Update S3 CommonCrawl URL

#9 treigerm closed 7 years ago
1
langstat2candidates.py requires large amounts of RAM

#8 achimr opened 7 years ago
1
candidates2corpus.py to download corpus sometimes fails with OpenSSL.SSL.ZeroReturnError

#7 achimr closed 7 years ago
1
Script candidates2corpus.py needs days to run for large language pairs

#6 achimr opened 7 years ago
4
error installing pyrocksdb

#5 menpente closed 7 years ago
5
Metadata database assumes wrong path in cdx files

#4 achimr closed 7 years ago
0
Check whether we are using ranged requests to access subsections of WARC files

#3 achimr closed 7 years ago
1
Filter log not written by filter_hunalign_bitext.py

#2 achimr closed 7 years ago
0
testing pull requests

#1 christianbuck closed 9 years ago
0