search

vllm-project / llm-compressor

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
Apache License 2.0
644 stars 52 forks source link

metrics #104

Closed horheynm closed 2 months ago

horheynm commented 2 months ago

SUMMARY: Pytest goes thru the repo twice , once for capturing/generating fixtures the tests and the second for running. Fixed bug where if levels of loguru were already set, skip. Collision happened when second iteration happened

TEST PLAN: pass pytest

rahul-tuli commented 2 months ago

LGTM, could you add a PR description too please!