Add debug setup for inference server & worker

LAION-AI / Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

https://open-assistant.io

Apache License 2.0

36.94k stars 3.22k forks source link

Add debug setup for inference server & worker #3575

Open 0xfacade opened 1 year ago

0xfacade commented 1 year ago

I couldn't find an existing way to attach a debugger to the inference server or worker. In this PR, I enable both to be debugged using debugpy, the Python debugger that integrates easily with VS Code.

Open issues:

[x] add documentation
[x] test once more
[x] run pre-commit (still having issues with the setup)

github-actions[bot] commented 1 year ago

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] commented 1 year ago

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

github-actions[bot] commented 1 year ago

:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md

0xfacade commented 1 year ago

@olliestanley From my side, this is ready to be merged, now that I've figured out why pre-commit was failing (see other message).

olliestanley commented 1 year ago

@olliestanley From my side, this is ready to be merged, now that I've figured out why pre-commit was failing (see other message).

I'm happy for it to be merged but it touches repo root files etc so will need approval from @andreaskoepf or @yk

If one of them is reading this - would also be good to get Florian collaborator access to the repo