CCIndexWarcSparkJob requires one of --query or --csv

commoncrawl / cc-pyspark

Process Common Crawl data with Python and Spark

MIT License

406 stars 86 forks source link

Closed sebastian-nagel closed 4 years ago

sebastian-nagel commented 4 years ago

(reported by @calee88 in #12)

CCIndexWarcSparkJob requires one of --query or --csv, hence these options are not optional but mutually exclusive.