-
### User Story
As a Analytical Platform Product Engineering
I expect to be alerted on available signals from the ingestion service
So that we have a clear picture of how the service is performing
##…
-
Still type unstable but should be a more straightforward implementation. Good performance on 1.10.4.
-
We need to ensure that the new ClinGen ClinVar ingest is producing the same volume of data as the current DSP ClinVar ingest. This should be done by verifying the record counts in the the BQ tables:
…
-
### Description
In Elastic Integrations, there has been an extensive need to validate certain values to ensure correct data is being ingested. Moreover, in the current stage, if there are any chang…
-
Discovered by @317brian - the batch ingestion notebook fails to complete in the System Fields ingestion on Druid 30.
-
We have some issue wrt Go that needs to purl library updates.
-
**Describe the bug**
Superset ingestor shall have better efficiency to handle large amount of data or access_token could expire before ingestion completes.
**To Reproduce**
Ingestion context:
- …
-
Stephan noticed that our ingestion rate from Kafka (100 req/s) is significantly lower than our processing speed of invocations (1000 req/s once buffered). This could be caused by some inefficiencies o…
-
The captive core backend invokes `stellar-core offline-info`:
https://github.com/stellar/go/blob/b589529f102f0b92c106e1015a80531f52623036/ingest/ledgerbackend/run_from.go#L42-L58
However:
1…
-
**Is your feature request related to a problem? Please describe.**
We got plenty of stored procedures in greenplum and db2 database, we want to ingest those procedures to generate lineage.
**Descr…