We need to be able to perform operations on data lists. The main features needed at the moment are:
concatenating data lists (already possible, but maybe should rethought in this broader context)
filtering data lists
The app infrastructure already has a data pipe parser (written in Typescript). Eventually we would like to use the same system for both app and chatbot (ecosystem), but the effort required for the integration is not worth it at this stage. However, at least from a conceptual point of view we should build the chatbot functionality keeping in mind a future integration.
Here are some links to relevant information for the app data pipe parser:
RFC document outlining the specifications of the data pipes feature.
The logic of the data pipe operations can be found in the main repo folder packages/shared/src/models/dataPipe, github link here.
The PRs that introduced the code (focusing solely on that same folder):
This PR is the main one that introduces the logic. Chris's PR description is pretty good. Essentially the PR adds a folder at packages/shared/src/models/dataPipe that contains the main logic, broken up into modular files.
This follow up PR integrated the data pipe parser into the general parsing pipeline. Most of these changes can be ignored, but it did also make some minor improvements to the data_pipe methods in packages/shared/src/models/dataPipe so is worth referencing.
Finally, this PR added an additional operation to the data_pipe parser: sort.
We need to be able to perform operations on data lists. The main features needed at the moment are:
The app infrastructure already has a data pipe parser (written in Typescript). Eventually we would like to use the same system for both app and chatbot (ecosystem), but the effort required for the integration is not worth it at this stage. However, at least from a conceptual point of view we should build the chatbot functionality keeping in mind a future integration.
Here are some links to relevant information for the app data pipe parser:
RFC document outlining the specifications of the data pipes feature.
The logic of the data pipe operations can be found in the main repo folder
packages/shared/src/models/dataPipe, github link here.The PRs that introduced the code (focusing solely on that same folder):
packages/shared/src/models/dataPipethat contains the main logic, broken up into modular files.packages/shared/src/models/dataPipeso is worth referencing.