twitter / summingbird

Streaming MapReduce with Scalding and Storm
https://twitter.com/summingbird
Apache License 2.0
2.14k stars 267 forks source link

Try Travis caching of jars #591

Open johnynek opened 9 years ago

johnynek commented 9 years ago

should speed up builds, potentially.

sritchie commented 9 years ago

You can check if it worked once the tests pass by running travis cache at the command line.

sritchie commented 9 years ago

Well, I guess the tests have been erroring for quite some time. Maybe this isn't the best project to test this opt on.

johnynek commented 9 years ago

yeah, right now the tests are pretty hosed. fracking storm.

sritchie commented 9 years ago

realtime is the future. Any negativity or inference that there might be a problem with Storm is a sign of impending codgerhood.

sritchie commented 9 years ago

@johnynek merged develop since tests now pass. Pushed again.

johnynek commented 9 years ago

@sritchie thanks old friend.

sritchie commented 9 years ago

I'm seeing

Setting up build cache
$ export CASHER_DIR=$HOME/.casher
0.03s$ Installing caching utilities
0.48sattempting to download cache archive
found cache

Unclear how much time's getting saved on the build.

johnynek commented 9 years ago

total of this run was 58 min, whereas this was 57 min: https://github.com/twitter/summingbird/pull/601

So far, no evidence of a win.

sritchie commented 9 years ago

Or if your metric is "distance away from a 1 hour run time", I'm seeing 50% improvement :)

johnynek commented 9 years ago

:)

CLAassistant commented 5 years ago

CLA assistant check
All committers have signed the CLA.