crs4 / pydoop

A Python MapReduce and HDFS API for Hadoop
Apache License 2.0
237 stars 59 forks source link

Uninitialized variables in CoreHdfsFs.open_file #309

Closed simleo closed 6 years ago

simleo commented 6 years ago
from pydoop.hdfs.core import init
hdfs = init()
fs = hdfs.CoreHdfsFs("default", 0)
f = fs.open_file("/tmp/foo", "w")

Leads to org.apache.hadoop.ipc.RemoteExceptions like:

Requested replication factor of -2365 is less than the required minimum of 1

or:

Specified block size is less than configured minimum value (dfs.namenode.fs-limits.min-block-size): 32723 < 1048576

For some reason, Python 2 seems to be unaffected by this.