Serialize job parameters (task vars and arguments) via a modified version of EDN. Make the active job configuration available during de/serialization, allowing objects access to other parameters in the configuration. Use this access to implement "distributed values" or dvals, which arrange to distribute their serialized representation via the Hadoop distributed cache.
Serialize job parameters (task vars and arguments) via a modified version of EDN. Make the active job configuration available during de/serialization, allowing objects access to other parameters in the configuration. Use this access to implement "distributed values" or dvals, which arrange to distribute their serialized representation via the Hadoop distributed cache.