Add support for using the PRO RAG Pipeline

[homanp]

⚠️ Please check that this feature request hasn't been suggested before.

• [X] I searched previous Ideas in Discussions didn't find any similar feature requests.
• [X] I searched previous Issues didn't find any similar feature requests.

🔖 Feature description

Utilize the Superagent Pro RAG pipeline

📝 Additional Context

No response

Acknowledgements

• [X] My issue title is concise and descriptive.
• [X] I have searched the existing issues to make sure this feature has not been requested yet.
• [X] I have provided enough information for the maintainers to understand and evaluate this request.

[VJlaxmi]

Hi @homanp, I'm interested in working on adding support for the PRO RAG Pipeline.

Before starting, I'd like to gather more details:

• Specifics of the PRO RAG Pipeline: Could you elaborate on the key differences between the standard RAG Pipeline and the PRO version? Are there specific libraries or dependencies involved?
• Integration Approach: Do you have any preferences for how this should be integrated into the existing codebase? Should this become an optional feature or replace the standard RAG implementation?
• Documentation: Are there official resources or documentation on the PRO RAG pipeline that I can reference?

I'm eager to get started on this integration!