-
Use-Case:
A user has a small chunk of text and wants to find longer text that contain this chunk or a similar chunk.
Proposed solution draft:
Apply shift-invariant text-chunking (for example ~100…
-
Separate workers enriching in parallel to the web app. Priority queue for chunking OERs (Wikichunkify).
- speed
- security (replace API routes with direct access to database?)
For the future: …
-
Comparing different lengths for chunking websearch articles:
* 512 chars (70-130 words) (current implementation)
* 1024 chars (140-260 words)
From the tests below, that you can see current implem…
-
### Feature request / Suggestion
Currently, we have set `celery`'s concurrency to 1 process with several threads, in order to get around race conditions and OutOfMemory issues with the deep learning …
JeS24 updated
5 months ago
-
In https://github.com/mhkarimi1383/simple-store/blob/fd4c211a2dc05fd24fbe043758741d0580c6ef36/internal/filemanager/filemanager.go#L34 we are chunking files and saving them is File System using `os` pa…
-
* xradar version: 0.6.4
* xarray version: 2024.7.0
* Python version: 3.12.4
* Operating System: Linux
### Description
I have found a puzzling bug that only comes up in certain situations with…
-
Currently the user only gets the hour-glass, he does not know if the revision has failed him or not and could be 'doomed' to wait up to minutes for a complete verification.
Solution approach: displ…
-
Can you provide options while creating chunks based on Sentences too, which will help on better answer from the knowledge base.
-
## Issue: `xbeam.open_zarr()` fails to open stores that `xarray.open_zarr()` handles fine
### Description
I am encountering an issue where `xbeam.open_zarr()` is unable to open Zarr stores that ar…
-
Hi! Thank you for working on this. I was giving Attic a try but on some uploads (notably, this one is several hundred MBs) it's failing to push.
I'm getting this error:
```
Feb 09 17:05:16 ip-1…