-
Currently, if a single kv in a batch loses last write wins or had an unexpected previous value, the whole batch is retried, where each row (i.e. pk kv + secondary index kvs) is committed in their own…
-
POST /api/v1/entries/import/nightscout?token=abc123
`{ "url": "https://my.nightscout.server", "token": "abc123" }`
or
`{ "url": "https://my.nightscout.server", "api_secret": "ABC123" }`
will t…
-
## Description
At present, I have 68k queued bundles, of which 172.20.0.9:5672):
2024-10-31T11:54:23.632025790Z 2024-10-31 11:54:23.631087+00:00 [error] missed heartbeats from client, timeout:…
-
This ticket has been raised in relation to this Slack [thread](https://mojdt.slack.com/archives/C04M8224WCV/p1727266436552359).
The purpose of this piece of work is to examine the current ingestio…
-
**Steps to reproduce the problem:**
1. Create an agent with knowledge from onedrive location - Corps Docs (600+ files)
2. Have New Files Ingestion Policy set to Automatic
Wait for Syncing of files …
-
Trying to ingest knowledge files(from onedrive location in my case) which have audio and video files > 100 MB large results in 100% cpu consumption making the server unresponsive.
The files get stu…
-
The end2end tests should utilize the ingestion service in order to fully reflect the entire production flow of messages. This will also make sure our end2end tests capture message manipulation that is…
-
Issue is to track efforts to improve the web scraping pipeline.
- [ ] Implement Pycookie
- [ ] Implement checks for custom scraper integration (if URL matches a predefined list, use the scraper fo…
-
-
When we just define ingestion spec file at one place start a spark ingestion job getting spec file not found exception. The reason is the spec file is not is getting distributing as like other depende…