triton-inference-server / fil_backend

FIL backend for the Triton Inference Server
Apache License 2.0
68 stars 35 forks source link

Provide faster development workflow #225

Closed wphicks closed 2 years ago

wphicks commented 2 years ago

Provide options for building the FIL backend libraries on the host machine and testing them within a Docker container. This allows for substantially faster iteration during development with less disk usage from repeated Docker builds. Also provide a Hypothesis profile with fewer max_examples to be used by default in local builds.

Documentation of these new options is provided, but a follow up PR addressing #224 should be used to flesh out common use cases and make these options more easily discoverable.

Resolve #163.