crs4 / pydoop

A Python MapReduce and HDFS API for Hadoop
Apache License 2.0
236 stars 59 forks source link

Delay HDFS unit tests #346

Closed simleo closed 5 years ago

simleo commented 5 years ago

Several Travis jobs have been failing lately with errors like:

org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /tmp/pydoop-test-1337ed0df8624e07975aebfdee4c5b97 could only be written to 0 of the 1 minReplication nodes. There are 1 datanode(s) running and 1 node(s) are excluded in this operation.

Although the message says the data node is running, this might be due to HDFS still being in a somewhat inconsistent state after the initial startup. This PR delays HDFS-related tests so that HDFS has a couple more seconds to stabilize.