-
When trying to quit quickwit, it occasionally hangs at decommissioning ingester. Only `kill -9` works
```
^C2024-06-03T09:35:15.935Z INFO quickwit_ingest::ingest_v2::ingester: decommissioning inges…
-
The captive core backend invokes `stellar-core offline-info`:
https://github.com/stellar/go/blob/b589529f102f0b92c106e1015a80531f52623036/ingest/ledgerbackend/run_from.go#L42-L58
However:
1…
-
**Is your feature request related to a problem? Please describe.**
We got plenty of stored procedures in greenplum and db2 database, we want to ingest those procedures to generate lineage.
**Descr…
-
## Instructions
### Hypothesis Statement
- Funnel Entry Date: **The date that the epic entered the [funnel](https://www.scaledagileframework.com/program-and-solution-kanbans/)**
- Epic Name: **A…
-
### Problem
The importer needs to support the new transaction types in HIP-869.
### Solution
* Add new transaction handlers for the three new node transactions
* Always populate `transaction…
-
Stephan noticed that our ingestion rate from Kafka (100 req/s) is significantly lower than our processing speed of invocations (1000 req/s once buffered). This could be caused by some inefficiencies o…
-
We need to ensure that the new ClinGen ClinVar ingest is producing the same volume of data as the current DSP ClinVar ingest. This should be done by verifying the record counts in the the BQ tables:
…
-
**Describe the bug**
Superset ingestor shall have better efficiency to handle large amount of data or access_token could expire before ingestion completes.
**To Reproduce**
Ingestion context:
- …
-
https://docs.lakefs.io/integrations/kafka.html
-
Create script to pull Lyft bike data on the bike stations and ridership for all three cities. This should be staright forward across cities because all owned by Lyft.