search

triton-inference-server / triton_cli

Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inference Server.
48 stars 2 forks source link

Setup repo and package structure #1

Closed rmccorm4 closed 11 months ago

rmccorm4 commented 11 months ago

Setup a baseline project structure with some automated building/testing.

Note for @dyastremsky - this is intentionally using ruff instead of black/isort/flake8 because I want to try it out. I understand it diverges from our consistency a bit, but wanted to get some experience with it. If we run into consistency problems, I don't mind swapping back to black/isort/flake8 to match the other repos when this is more mature.

You can find more details on ruff here, but some of the most popular python projects like FastAPI, Pandas, and HuggingFace have started using it instead.

Also all names are subject to change, such as the python package being called triton_cli. Don't want to get too hung up on names until there is more fleshed out design and direction.