search

quinngroup / dr1dl-pyspark

Dictionary Learning in PySpark
Apache License 2.0
1 stars 1 forks source link

Make number of partitions a command-line parameter #58

Closed magsol closed 8 years ago

magsol commented 8 years ago

Provide a command-line option to set the number of partitions in the RDD. This will make running experiments a little easier. e.g.

spark-submit R1DL.py --partitions 10