bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
https://petals.dev
MIT License
9.26k stars 524 forks source link

Enhance Logging in RemoteGenerationMixin for Better Debugging #612

Open mandlinsarah opened 2 months ago

mandlinsarah commented 2 months ago

This update enhances the logging mechanism in the RemoteGenerationMixin class, allowing for better traceability and debugging. The added logging provides insights into key steps of the token generation process without altering its core functionality.