Add tests for TFLite models - Githubissues

iree-org / iree-test-suites

Test suites for IREE and related projects

Apache License 2.0

1 stars 3 forks source link

Add tests for TFLite models #5

Open ScottTodd opened 1 month ago

ScottTodd commented 1 month ago

See https://github.com/nod-ai/SHARK-TestSuite/issues/291

Popular TFLite models: https://www.kaggle.com/models/?orderby=downloadCount&framework=tfLite
Old TFLite tests in IREE: https://github.com/iree-org/iree/tree/main/integrations/tensorflow/test/python/iree_tfl_tests

Search around for upstream test suites (corpus of .tflite files)

Could also test TOSA operators maybe using https://git.mlplatform.org/tosa/conformance_tests.git/ (see https://www.mlplatform.org/tosa/software.html)

ScottTodd commented 3 weeks ago

We can also test across different tensorflow package versions, to show when compatibility breaks (e.g. when TOSA ops change, see https://discord.com/channels/689900678990135345/689900680009482386/1276633806643662868 and https://discord.com/channels/689900678990135345/689900680009482386/1255019974867550208).