nginyc / rafiki

Rafiki is a distributed system that supports training and deployment of machine learning models using AutoML, built with ease-of-use in mind.
Apache License 2.0
36 stars 23 forks source link

Setup framework for running tests #89

Closed nginyc closed 5 years ago

nginyc commented 5 years ago

There are no tests for Rafiki, making it hard to determine whether there were any regressions.

We would want a single line test command and a framework to add/modify tests, which would reliably ensure that our code works as intended when changes are made.

nudles commented 5 years ago

I suggest to go top-down manner to save time of doing test for very small functions. e.g.,

def funcA():
    funcB()
    funcC()

def funcB():

def funcC():

We do test for funcA().

nginyc commented 5 years ago

ok understood. i will mainly add end-to-end tests e.g. full train-inference flow