Open liammac opened 10 years ago
What version of hadoop are you running against?
Took another look and it's probably trying to used the wrong port to talk to the name node (it defaults to 9000 which is what EMR uses). Try adding the namenode port to the paramaters in jes.py.
for cluster in settings.clusters:
monitors.append(HdfsMr2LogMonitor(jobflow=cluster.id,
cluster_id=cluster.id,
cluster_name=cluster.name,
host=cluster.host,
publisher=publisher,
port=8020,
elasticsearch=settings.elasticsearch))
I had the same issue on a HDP cluster. You are correct specifying the port fixed the issue.
In a similar fashion, I also had to change the port in index_cluster_stats.py from 9026 to 8088.
I'm following the instructions for the quick start and I get to the point where I run the jes.py
It fails with the following