-
### User Story
Reduce the CaDeT ingestion time to < 1h so that we are able to run it multiple times a day if we need to (e.g. for debugging).
### Value / Purpose
The cadet ingestion workflow …
-
Let us say we have some Relational data.
Making a simple example for a retail store chain:
* Dataset 1 --> Store_id, Daily_sales
* Dataset 2 --> Customer_id, store_id, Time in, Time out
Let us …
-
### Description
Introduce a decorator that exposes an attribute on an Actor class to the dashboard. This attribute will appear in a new column on the dashboard.
### Use case
This will provide great…
-
This strategy will allow smooth out any spikes on metrics ingestion pipeline.
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I am trying to add a Query Pipeline as an Agent. It will be used as a tool to another Op…
-
The description of the field in the ECS documentation is
```
event.created contains the date/time when the event was first read by an agent, or by your pipeline.
This field is distinct from @timesta…
-
1. Modify scripts inside the helpers folder:
- **cubes_to_db**: automate the process of ingesting cubes & their embeddings into the database by using the tables.json file
- **drilldowns_to_db**: aut…
-
Identifier validation failed for the dataset [MFS-Flores - Herbário Profª. Drª. Marlene Freitas da Silva - Coleção de Flores](https://registry.gbif.org/dataset/d40307f5-55e0-4e9e-a42a-5f3612c56f31):
-…
-
We have two issues currently with secret management for AWS S3 buckets:
- The first one is for ingestion purpose, we have some public sources which we can all make accessible through one set of sec…
-
Currently, each timely worker in the source ingestion pipeline periodically queries the external system to discover new "partitions" (the term is heavily influence by Kafka, but other systems, such as…