search

neo-ai / neo-ai-dlr

Neo-AI-DLR is a common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.
Apache License 2.0
491 stars 106 forks source link

Can we add treelite specific backend? #385

Open mycpuorg opened 2 years ago

mycpuorg commented 2 years ago

I noticed this comment: https://github.com/neo-ai/neo-ai-dlr/blob/a8afcafbcc8c43b734faf092b2f4dd7e8fe40ea0/src/dlr_common.cc#L124

Promotes confusing logic while determining backend from model elem

apivovarov commented 2 years ago

If TVM_LIB (.so) found but TVM_PARAMS (.params) not found it will return DLRBackend::kTREELITE.

Treelite mode has has one file - .so file.