docs: improve general and development documentatation

[rickstaa]

This pull request improves both the documentation and developer documentation making it easier for developers to work with the AI worker and runner.