search

elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.76k stars 8.16k forks source link

[ResponseOps] Support streaming in executor #188467

Open stephmilovic opened 2 months ago

stephmilovic commented 2 months ago

Problem

The actions execute route does not support streaming. In order to call a subaction that supports streaming (GenAI connectors), one must implement a route to call the actions api directly. This is fine for implementation, but has caused issues for testing.

Since these routes exist only in solutions code, in order to test the streaming subactions we have called the security GenAI execute API instead of the actions execute API. As this API has become more complex (now calls LangChain), this is not a sustainable solution for testing streaming. We are removing this test in this PR: https://github.com/elastic/kibana/pull/188168/commits/18d089b7c6381d3ec528a3201e9f2d69144b5a63#diff-8767010a93b0293eb61f9d1061507b34e948691983ff0952aa6a410e44c55a71L435

Suggestion

Extend the execute route to support streaming. That way, we can add a test for streaming subactions that call the actions execute API.

elasticmachine commented 2 months ago

Pinging @elastic/response-ops (Team:ResponseOps)