-
Is there a feature in the pipeline to support web scraping functionality - similar to what the LangChain library has to offer (https://python.langchain.com/v0.1/docs/use_cases/web_scraping/).
It is…
-
### Is your feature request related to a problem? Please describe.
A big part of good rag is the quality of the input data. I would want to specifically prepare chunks with text and metadata for the…
-
### 📦 部署环境
Vercel
### 📌 软件版本
1.12.3
### 💻 系统环境
Windows
### 🌐 浏览器
Chrome
### 🐛 问题描述
某些pdf文件上传后无法分块,出现如图错误
![屏幕截图 2024-08-22 165740](https://github.com/user-attachments/assets/c1b45582-b30b-4a…
-
**Describe the bug**
It was mentioned in the docstrings as well that the `tokenize_and_concatenate` function doesn't work properly with small datasets. I wanted to figure out is there a workaround …
-
In OpenSearch 2.13, we released [**text chunking processor**](https://opensearch.org/docs/latest/ingest-pipelines/processors/text-chunking/). This processor enables users to chunk documents to avoid i…
-
## 🐞Describing the bug
with reference to this issue https://github.com/apple/ml-stable-diffusion/issues/353, i used the bisect_model() function to split a quantized model into 2 chunks, i tried with…
-
The **JSON** file that I'm `/upsert`'ing contains data like the following:
```
{
"id": "Series",
"text": " Series[f,x,Subscript[x, 0],n] generates a power series expansion for f a…
-
I noticed that when the number of characters per line is very short in a list block in a Markdown document, the list is identified as a `Title` instead of a `NarrativeText`.
It prevents the chunkin…
-
Hi, it seems to be a loss of words/sentence when shunning text into paragraphs, any suggestion how to solve it?
-
**Is your feature request related to a problem?**
In current implementation we only supports neural sparse tool and vectorDB tool, which build the search request by filling a fixed template. However,…