Elly
Elly is a Hadoop HDFS and Yarn client. It provides:
- A familiar Julia
ClusterManager
interface, making it possible to
use the familiar Julia parallel constructs on any Hadoop/Yarn
cluster: addprocs
, @parallel
, spawn
, pmap
, etc.
- Lower level APIs to write native Yarn applications.
- A familiar Julia IO API for accessing HDFS files. It is a pure Julia
implementation with no dependencies on
libhdfs
.
Using Elly
Requirements
- Since Elly uses the newer Protobuf interface, it requires a Hadoop 2.2+ distribution.