This tool will analyze and find the best routes for trade data persuant to several parameters:
This is a Spark program, and thus requires Spark. Tips to simplify installation are listed below.
It is recommended that you download Apache Spark from Cloudera's repositories. Instructions can be found at [http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cdh_ig_spark_install.html]
It is recommended to download the apache-spark
package from Homebrew.
Manual installation is required. Locations listed here are used for simplicity and completely optional. You can use your prefered locations.
Download the Pre-Built Spark for Hadoop 2.4+ from [https://spark.apache.org/downloads.html]. Extract it to "C:\spark". Download Hadoop from [https://www.apache.org/dyn/closer.cgi/hadoop/common/] and extract it to "C:\hadoop". It is also necessary to get the Windows runtimes, which can be downloaded here [http://www.srccodes.com/p/article/39/error-util-shell-failed-locate-winutils-binary-hadoop-binary-path]. Unpack them and copy to "C:\hadoop\bin". Overwrite only older files. Before running Spark, you must set the %HADOOP_HOME%
environment variable to point at "C:\hadoop". Also add "C:\spark\bin" and "C:\hadoop\bin" to %Path%
environment variable.
spark-submit spark.py
to generate the routes. The results will be displayed in JSON format at the end of the output.