husky-team / husky

A more expressive and most importantly, more efficient system for distributed data analytics.
http://www.husky-project.com/
Other
98 stars 55 forks source link

Error when running Master. #316

Open ph0123 opened 4 years ago

ph0123 commented 4 years ago

Dear all,

I try to run husky on the server.

Everything is ok. However, when I run

./Master --conf config.ini &

The error is

/tcmalloc.cc:332] Attempt to free invalid pointer 0x7ffd5214c6b0

module list

Currently Loaded Modules:
  1) StdEnv                      (S)   6) bzip2/1.0.8-GCCcore-8.3.0 (H)
  2) GCCcore/8.3.0                     7) XZ/5.2.4-GCCcore-8.3.0    (H)
  3) zlib/1.2.11-GCCcore-8.3.0   (H)   8) ICU/64.2-GCCcore-8.3.0    (H)
  4) binutils/2.32-GCCcore-8.3.0 (H)   9) Boost/1.71.0-GCC-8.3.0
  5) GCC/8.3.0                        10) CMake/3.12.1

  Where:
   S:  Module is Sticky, requires --force to unload or purge
   H:             Hidden Module

I try to run Make PI and it ok.

Configure is

# Required
master_host=localhost
master_port=10086
comm_port=12306

# Optional
log_dir=logs-husky
hdfs_namenode=localhost
hdfs_namenode_port=10010

# For Master
serve=1

# Session for worker information
[worker]
info=localhost:3

Thanks,

ph0123 commented 4 years ago

The error is from # Optional log_dir=logs-husky hdfs_namenode=localhost hdfs_namenode_port=10010

I did not know why? but when I remove these lines. The master worked.

kygx-legend commented 4 years ago

Seems you didn't install libhdfs3 so hdfs_namenode and hdfs_namenode_port are not needed.