search

rajasekarv / vega

A new arguably faster implementation of Apache Spark from scratch in Rust
Apache License 2.0
2.23k stars 205 forks source link

How to run the codes in examples? #11

Closed ariesdevil closed 4 years ago

ariesdevil commented 4 years ago

I create a test_native_spark project and copy codes in make_rdd.rs to the project's main.rs Then run this project using cargo +nightly-2019-09-11 run got some errors:

thread 'main' panicked at 'Unable to open the file: Os { code: 2, kind: NotFound, message: "No such file or directory" }', src/libcore/result.rs:1165:5
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace.

How can I solve this?

rajasekarv commented 4 years ago

First, Install Cap'n Proto Then, run these following steps for local mode:(Tested only on Linux) 1.git clone https://github.com/rajasekarv/native_spark/

  1. cd native_spark
  2. copy hosts.conf file in config_files directory to your home directory. cp config_files/hosts.conf ~/hosts.conf
  3. export SPARK_LOCAL_IP=0.0.0.0
  4. cargo run --example make_rdd

Note: Initial build time can be very long. In my machine, it takes around 3 mins just for debug build. If it is still not working, let me know.

ariesdevil commented 4 years ago

It works.