A chain is run to to create a standalone question using the chat history
This standalone question is then passed to a new chain
The model used to create a standalone question affects the model output also.
Having a feature to select a model that's good at the rephrasing step can
be great in cases where a user wants to use a particular model(e.g. for cost reasons), but it isn't good at rephrasing.
The user can then select a potentially more expensive model but just for the rephrasing part.
The user asks a question.
A chain is run to to create a standalone question using the chat history This standalone question is then passed to a new chain
The model used to create a standalone question affects the model output also.
Having a feature to select a model that's good at the rephrasing step can be great in cases where a user wants to use a particular model(e.g. for cost reasons), but it isn't good at rephrasing. The user can then select a potentially more expensive model but just for the rephrasing part.