google / nitroml

NitroML is a modular, portable, and scalable model-quality benchmarking framework for Machine Learning and Automated Machine Learning (AutoML) pipelines.
Apache License 2.0
42 stars 6 forks source link

Create a test that runs a pipeline using the Beam runner. #7

Closed cweill closed 4 years ago

cweill commented 4 years ago

Create a absltest.TestCase subclass that makes it easy to define pipeline tests. It should take a tfx.Pipeline and run it using the Beam runner. It should fail if any of the components fail.

While this can currently be limited to the starter project, eventually we will want to add this to a nitroml.testing package to help benchmark authors.