Expanded the dummy provider and endpoint to also allow producing fake completions. These can be used to test apps or evals without invoking any real APIs. Also expanded the custom_app example to make use of the dummy api.
Other details good to know for developers
Added tests using dummy endpoint, provider, and custom_app, making sure they produce consistent results/records from now on.
Added documentation about dummy api, provider, endpoint to docs.
Pulled in a more complex custom_app example from another ongoing PR. Added documentation about it to docs.
Adjusted pull template to add checkmarks for test changes and changes that require regenerating golden results.
Type of change
[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
Description
Expanded the dummy provider and endpoint to also allow producing fake completions. These can be used to test apps or evals without invoking any real APIs. Also expanded the custom_app example to make use of the dummy api.
Other details good to know for developers
Type of change