Yelp / mrjob

Run MapReduce jobs on Hadoop or Amazon Web Services
http://packages.python.org/mrjob/
Other
2.62k stars 586 forks source link

Support Python 3.8 #2150

Open coyotemarin opened 4 years ago

coyotemarin commented 4 years ago

Python 3.8 was released last October.

Currently, tests do not pass with Python 3.8. The problem seems to be with pyspark.

coyotemarin commented 4 years ago

"Solved" this by disabling Spark tests when unit-testing Python 3.8 (see #2152).

Can't really do this without a working pyspark library to run unit tests against. pyspark 2.4.5, released Feb 6, 2020, did not work.