Clean up flags - Githubissues

google / jetstream-pytorch

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"

Apache License 2.0

32 stars 14 forks source link

Clean up flags #83

Closed qihqi closed 3 months ago

qihqi commented 3 months ago

run_server.py run_interactive.py and benchmarks/run_offline.py all uses similar flags. Let's move those flags; as well as the create_pytorch_engine function that reads those flags into a common .py file to be shared. Also makes the flag names consistent.