quinngroup / dr1dl-pyspark

Dictionary Learning in PySpark
Apache License 2.0
1 stars 1 forks source link

Performance analysis #49

Closed magsol closed 8 years ago

magsol commented 8 years ago

Test scalability of Spark implementation on a cluster (LJ cluster at UGA; AWS EC2 clusters using the thunder-ec2 scripts). Identify bottlenecks in the code.