Open mrsimpson opened 6 years ago
Technical remarks as discussed with @westei
The Chatpal-provider is similar to a conversational provider: The query to be executed shall be generated by Smarti, with all bells and whistles about partial matching, weighting and so on. This potentially complex query has to be issued to the Chatpal index. However, the Chatpal index must not be consumed directly: The Rocket.Chat Search Backend adds restricting parameters based on the accessibility of rooms. Consequently, Chatpal "only" needs to expose a method to the widget which receives the prepared query and returns search results.
FYI this is the main story for the v0.8.*
releases of Smarti. Currentl it is planed out in two releases:
0.8.0
release with all features that are possible without changes in the current Rocket.Chat Search implementation and the Chatpal0.8.1
release that depends on the acceptence of Recket.Chat Search pull requests and releases of those in a Rocket.Chat release as well as additional features for the Chatpal provider@westei can you let us know the chatpal RC PRs? We can merge them into our fork at least
@mrsimpson the two issues (#278 and #288) are now implemented (they do require assistify/Rocket.Chat#601). With that work on this project has completed. So I suggest to also markt this meta issue as complete after review.
The release of #278 and #288 is now scheduled as part of 0.9.0
Motivation
Until now, Smarti was focusing on creating a common, anonymized body of knowledge for a team based on its conversations. Real user interaction has shown that people don't care much about creating coherent conversations but write in a continuous stream. It is crucial that even in these cases, Smarti can deliver value in order to accelerate the conversation.
Suggestion
With Chatpal being a part of Rocket.Chat, it provides an explicit search with a focus on individual, message-based knowledge. Thus, considering Chatpal as an additional knowledge source in Smarti seems reasonable. This way, Smarti can provide an implicit, NLP-backed, federated search with the personal body of knowledge by Chatpal.