-
## Use case
When opening the ingestion UI, I am usually going there to check the status of a connector. However, since this is the bottom option, this usually requires extra 'mouse mileage' and a c…
-
From April'23 to Jun'23 plan in [FY23 Q2 Mar'23 quarterly update](https://lsst-uk.atlassian.net/wiki/download/attachments/2114584615/IKC-S10-QU-FY23-Q2-Mar23.pdf?api=v2).
> ...begin development of a …
-
**Describe the bug**
After doing some tests with the “default” setup of datahub for k8s, all installed with helm chart. We have observed some issues with BigQuery ingestion from the UI, All these tes…
-
I could not find any way of generating the api key for the ingestion api. I checked the database and there were no api keys in the api_key table.
I ended up having to manually generate the api_key …
-
Some data may contain human curation errors, or may result in data that we're unhappy with. We should have some sort of manually-maintained blocklist or allowlist to define tweaks to certain concepts.…
-
### Is your feature request related to a problem? Please describe
It's frustrating that we can't use S3 directly in ingestion pipelines. We must first load a file from S3-compatible storage, base e…
-
Setup OpenMetadata in order to integrate with our DBT pipelines (as code, contained in the data product). List of integrations to be tested:
https://docs.open-metadata.org/v1.4.x/connectors/ingestion/…
-
## Description
NO2 (#89) and Geoglam (#167, #173) datasets requires monthly ingestion as new assets are created. This is currently a manual process however should be automated. `veda-data-airflow` ha…
-
**Affected module**
Ingestion Framework
**Describe the bug**
Upgrading from 1.4.3 to 1.5.1, I get the following error even with Profiler Ingestions without filter conditions.
“databaseFilterPatt…
-
I have one piece of software that manages ingestion of my library and I rely on Beets for proper tagging and naming. I'm having Beets hardlink the files to its own view of the library which works grea…