defenseunicorns / leapfrogai

Production-ready Generative AI for local, cloud native, airgap, and edge deployments.
https://leapfrog.ai
Apache License 2.0
243 stars 25 forks source link

chore(llama-cpp-python): Review llama-cpp-python Code for Improved Logging and Debugging Support #686

Open CollectiveUnicorn opened 6 days ago

CollectiveUnicorn commented 6 days ago

Describe what should be investigated or refactored

We need to review our llama-cpp-python code to determine if our current logging practices are sufficient for effective debugging. Specifically, we should:

  1. Assess the current logging coverage.
  2. Identify areas where additional logging could provide valuable insights during troubleshooting.
  3. Evaluate the level of detail in existing log messages and determine if they provide enough context for debugging.
  4. Check if we're using appropriate log levels (INFO, DEBUG, WARNING, ERROR) consistently throughout the codebase.
  5. Consider implementing structured logging for better log parsing and analysis.

Additional context