defenseunicorns / leapfrogai

Production-ready Generative AI for local, cloud native, airgap, and edge deployments.
https://leapfrog.ai
Apache License 2.0
253 stars 29 forks source link

chore(vllm): Review VLLM Code for Improved Logging and Debugging Support #685

Open CollectiveUnicorn opened 3 months ago

CollectiveUnicorn commented 3 months ago

Describe what should be investigated or refactored

We need to review our VLLM code to determine if our current logging practices are sufficient for effective debugging. Specifically, we should:

  1. Assess the current logging coverage.
  2. Identify areas where additional logging could provide valuable insights during troubleshooting.
  3. Evaluate the level of detail in existing log messages and determine if they provide enough context for debugging.
  4. Check if we're using appropriate log levels (INFO, DEBUG, WARNING, ERROR) consistently throughout the codebase.
  5. Consider implementing structured logging for better log parsing and analysis.

Additional context