CI: add a test for inference using downloaded GGUF

certik / mlc

Machine Learning Compiler

MIT License

9 stars 1 forks source link

CI: add a test for inference using downloaded GGUF #69

Closed certik closed 6 months ago

certik commented 6 months ago

This PR adds a new test to the CI that just downloads GGUF from https://huggingface.co/certik/mnist/tree/main and uses it directly. This simplifies deployment greatly: no need to train, and the C inference has no dependency on TensorFlow or PyTorch.