search

microsoft / agogosml

agogosml is a flexible data processing pipeline that addresses the common need for operationalizing ML models at scale
MIT License
34 stars 16 forks source link

reduces CI build time based upon ENV variable #286

Closed cicorias closed 5 years ago

cicorias commented 5 years ago

TOX_VERSION=all keeps ALL versions tested TOX_VERSION= or TOX_VERSION-py37 the default builds with Python 3.7.2

On local build moves time from

before after
real 14m29.701s real 6m20.022s
user 0m0.859s user 0m0.484s
sys 0m0.953s sys 0m0.563s 
real    14m29.701s
user    0m0.859s
sys     0m0.953s

to 

real    6m20.022s
user    0m0.484s
sys     0m0.563s

Currenlty only the CLI is using tox matrix. base agogosml is not.

cicorias commented 5 years ago

@sayar - do we want to on CI NOT run any tox tests? while this last push reduces time, it's not 3 mins as it used to be. The time taken is still in the test-all/single aspect. So, if we had a NOCI or CI flag (variable) that would help.

RUN make clean && \
    make lint && \
    make test && \
    make test-single && \
    make docs && \
    make dist