Summary:
This Pull Request facilitates a scalable deployment of Haystack components. The new deployment approach is designed to optimize resource usage and improve efficiency by reusing instantiated models across different applications and endpoints.
Key Changes:
HaystackComponentDeployment: Introduced a new deployment that allows any Haystack component to be launched as a Deployment.
RemoteHaystackComponent: Added functionality to connect remotely to Haystack Component Deployments from within the Haystack Pipeline.
Integration Test Suite: Implemented testing for the new deployment and remote connection capabilities to ensure robust integration and functionality.
Asynchronous Utility Function (run_async): Added a utility function to facilitate asynchronous operations within synchronous environments. This function is essential for interacting with Haystack components that do not support async operations yet. The function works with asyncio and uvloop (uvloop is used by default in Ray).
Summary: This Pull Request facilitates a scalable deployment of Haystack components. The new deployment approach is designed to optimize resource usage and improve efficiency by reusing instantiated models across different applications and endpoints.
Key Changes:
HaystackComponentDeployment: Introduced a new deployment that allows any Haystack component to be launched as a Deployment.
RemoteHaystackComponent: Added functionality to connect remotely to Haystack Component Deployments from within the Haystack Pipeline.
Integration Test Suite: Implemented testing for the new deployment and remote connection capabilities to ensure robust integration and functionality.
Asynchronous Utility Function (
run_async): Added a utility function to facilitate asynchronous operations within synchronous environments. This function is essential for interacting with Haystack components that do not support async operations yet. The function works with asyncio and uvloop (uvloop is used by default in Ray).