blinko-space / blinko

An open-source, self-hosted personal note tool prioritizing privacy, built using TypeScript .
https://blinko-demo.vercel.app/
GNU Affero General Public License v3.0
1.05k stars 86 forks source link

ai 对话搜索结果太少, 答非所问, 润色功能添加奇怪符号, 希望可以自定义 prompt || ai There are too few dialogue search results, and the answers are incorrect. The polish function adds strange symbols. I hope the prompt can be customized. #217

Open LiangWei88 opened 2 days ago

LiangWei88 commented 2 days ago

ai 连接的是千问32b的模型, 嵌入是网易 b3m 模型 使用ai提问搜索的时候, 答非所问, 然后给出的相关记录太少.

另外在输出润色的功能上老是给出一些转义字符, 保存后形成 /Blinko/ 之类的斜杠符号 说不定是模型问题, 希望可以自己自定义 prompt 进行调试

目前最好用的功能是 ai 标签 另外一个就是占用的 内存越来越高了, 数据库 50-70m正常 本体目测基本超过200, 如果能少一些就好了

不过这的确是一个很好的软件. 辛苦大佬了.

Describe the bug A clear and concise description of what the bug is.

To Reproduce Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Smartphone (please complete the following information):

Additional context Add any other context about the problem here.


The ai is connected to the Qianwen 32b model, and the embedded model is the NetEase b3m model. When using AI to ask questions and search, the answers are incorrect and too few relevant records are given.

In addition, the output polishing function always provides some escape characters, which form slash symbols such as /Blinko/ after saving. Maybe it's a model problem. I hope I can customize the prompt for debugging.

The best feature currently is the ai tag The other thing is that the memory occupied is getting higher and higher. The database is 50-70m normal. The visual inspection of the main body is basically over 200. It would be better if it could be less.

But this is indeed a very good software. Thank you for your hard work.

Describe the bug A clear and concise description of what the bug is.

To Reproduce Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior A clear and concise description of what you expect to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Smartphone (please complete the following information):

Additional context Add any other context about the problem here.

BryceWG commented 1 day ago

设置有topk和score阈值设置,你可以自己改一下


There are topk and score threshold settings, you can change them yourself

LiangWei88 commented 1 day ago

设置有topk和score阈值设置,你可以自己改一下

There are topk and score threshold settings, you can change them yourself

感谢回复,经测试的确发挥了作用,现在已经能够顺利搜索到内容了。

我尝试使用了千问 2.5 14b 和 google gemma 27b 模型,在此过程中主要遇到了两个虽有些纠结但能使用的问题:

我对代码进行了克隆并查看,发现这些问题似乎都是在 prompt 层面注入的。我在想,如果能够提供选择使用默认 prompt 或者自定义 prompt 的功能就更好了。另外,想了解一下目前是否有第三方插件的功能或者相关的预期计划呢?这样或许就能够按照自身需求进行改动了。

image image image image

BryceWG commented 1 day ago

我觉得你可以试试更好的问答模型,embedding模型也可以更换,比如bge-m3


I think you can try a better question and answer model, and the embedding model can also be changed, such as bge-m3