Improve extensibility - Githubissues

Providing hooks to customise the default behaviour is key to avoiding feature bloat in the simulator.

The current extensibility has a couple of challenges:

it relies on dict types rather than actual typed objects - this makes authoring hooks harder than desired
it only allows importing a single python file (this makes it cumbersome to add larger customisations)

Work:

7
8
Refactor extensibility to add extensibility for limiters and latency
Make auth opt-in per forwarder/generator. This would address the issue highlighted in https://github.com/stuartleeks/aoai-simulated-api/pull/25
As part of this work, I think it makes sense to re-focus the core on OpenAI APIs. The doc intelligence forwarder/generator can be moved to examples (with tests to ensure they continue working). The generator in particular is more likely to be a starting point than something that serves the general need, so making it an example represents that better as well as providing a good extensibility example (and test case)

stuartleeks / aoai-simulated-api