search

BookStackApp / BookStack

A platform to create documentation/wiki content built with PHP & Laravel
https://www.bookstackapp.com/
MIT License
15.37k stars 1.92k forks source link

Semantic search engine #5318

Open fariquelme opened 4 days ago

fariquelme commented 4 days ago

Describe the feature you'd like

We use bookstack for internal purposes on my current working place and we developed a semantic search engine feature. We'd like to contribute with the feature to the repo, but since it requires hosting a microservice and a vector database in addition to bookstack I'd like to know if it's something that you guys would be interested in having 😁

Describe the benefits this would bring to existing BookStack users

Ability to search content semantically and get summarized response (1 on image) based on most the relevant content + links (2 on image) to pages where the content was found.

Can the goal of this request already be achieved via other means?

No, as far as I know there are no solid libraries to perform semantic search and LLM orchestration with php

Have you searched for an existing open/closed issue?

How long have you been using BookStack?

Under 3 months

Additional context

image

fariquelme commented 4 days ago

@ssddanbrown

ssddanbrown commented 4 days ago

Hi @fariquelme,

Thanks for offering this but to be up-front, this isn't something I'd look to officially include, support & maintain as it blows out the scope a fair bit for what would have to be an optional feature due to the extra infrastructure/technology requirements, as well as this kind of thing being tricky to fully support as an official feature in the full context of what's supported in BookStack (thinking permissions/role requirements). Plus, this area of technology is moving fast so I'd rather not have the burden of attempting to chase or keep up as technologies, desires and platforms/services/software/offerings change.

Instead I'd rather keep such solutions external, but allow them to connect with BookStack via methods of extension (API, logical/visual theme service). I built and added a basic API-based integration to Danswer, but didn't build any part unit the UI (Was really just a quick integration to test out the idea).

I'd be happy to consider additional integration points where needed to better provide a general abstract interface which any external solution (Both LLM or other search engine options) could be potentially use.