[CAY-1268] Introduce Tasklet

wynot12 commented 6 years ago

Resolves #1268 Resolves cmssnu/elastic-tables#15 Resolves cmssnu/elastic-tables#120 Resolves cmssnu/elastic-tables#133

This PR

Introduces Tasklet in ET
- ET does not use REEF's Task anymore.
Changes existing engines (e.g., dolphin) and example apps to adopt Tasklet
- Dolphin job submits one Tasklet to one Executor; Executor can run multiple Tasklets from multiple dolphin jobs
- Dolphin uses ET's network layer provided for custom usage

Additionally this PR resolves #1225. Introducing Tasklet requires clean separation of each tasklet instance in executors. And this separation resolves #1225 consequently.

Note that this PR does not include changing dolphin-jobserver to share executors across job.

wynot12 commented 6 years ago

@yunseong I'd like to give you a brief overview of the PR. Ping me when you have time :)

wynot12 commented 6 years ago

I'll add inline comments until tomorrow.

yunseong commented 6 years ago

Thanks for the work! Let me review it this afternoon.

wynot12 commented 6 years ago

I've just added comments :)

wynot12 commented 6 years ago

I've resolved your comments! thx :)

snuspl / cruise

[CAY-1268] Introduce Tasklet #1269