Performed code refactoring

[giuseppetotaro]

Performed code refactoring based on the following suggestions:

• remove "crawl-segments" as default output path
• avoid committing before starting the job
• use of constant value for task identifier
• remove unnecessary method
• avoid code dublication

[chrismattmann]

@thammegowda please review

[thammegowda]

Sorry, I missed it last weekend. I will review it before the end of this week.

[thammegowda]

@giuseppetotaro Merged. Thanks.

I made a few edits (mostly optimizations, see https://github.com/USCDataScience/sparkler/commit/ee332d6795fa65f8f53c4af9c8dbf96e64c4e1c5 if you are curious how I merged score and status updates into a single update)

We need a plugin, and we need atleast one testcase to accompany that plugin, we dont have any!