Improve documentation for the first release

dkpro / dkpro-c4corpus

DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate removal, language detection, and near-duplicate removal.

https://dkpro.github.io/dkpro-c4corpus

Apache License 2.0

50 stars 8 forks source link

Improve documentation for the first release #2

Closed habernal closed 8 years ago

habernal commented 8 years ago

add some typical use-case scenarios
describe reproducibility of the reported results
- [ ] Separate issue #4
[x] how to access the corpus from AWS

habernal commented 8 years ago

Closing for now - we have several use-cases and quite a detailed description of the pipeline and how to access the data.