neuralmagic / guidellm

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Apache License 2.0
160 stars 11 forks source link

Standardize Logger Implementation with Loguru and Add Comprehensive Unit Tests #5

Closed markurtz closed 3 months ago

markurtz commented 4 months ago

Summary

Standardizes the logger implementation around the loguru library and latest standards for NM. It enhances logging flexibility and configurability and introduces comprehensive unit tests to ensure reliability.

Details

Test Plan

Automation Testing:

parfeniukink commented 4 months ago

@markurtz Side topic: "What about using the pydantic for the settings and environment variables management in thr project? It is still to be a dependency for the openai package btw"

markurtz commented 3 months ago

@markurtz Side topic: "What about using the pydantic for the settings and environment variables management in thr project? It is still to be a dependency for the openai package btw"

Good idea, I'm going to push this off, though, to another PR once the pydantic one lands and we can refactor around that