-
### Expected Behavior
I have a SQS trigger and when a new message flows into the queue, it will convert into `.jsonl` and pass the file uri as `inputFiles` to `kubernetes.PodCreate`. The file will …
-
# User story
As a developer, I want each of the packages in the metadata-mapper to have a JobSettings.
# Acceptance criteria
- [ ] Create a module for models in the open_ephys package
- [ ] Cre…
-
# Hadoop 의 YARN 과 Eco System
## YARN
- Yet Another Resource Negotiator
- **빅데이터의 지휘자** 와 같은 역할
- 리소스를 분석해서 적절한 Job 에게 적절하게 할당함
- 하둡 클러스터에 데이터 처리를 동시에 담당
- Demon 을 통해 자원 관리 역할을 수행
- 태초의 리소스 매…
-
### Kyverno Version
1.8.5
### Kubernetes Version
1.28.x
### Kubernetes Platform
GKE
### Kyverno Rule Type
Mutate
### Description
When running a deploy github action followin…
-
Integration of class code into `main.py` script
The following classes need to be integrated into `main.py`
`DataFrameManipulation` , `S3DataProcessing` and `DatabaseOperations`
For `S3DataProces…
-
Discussed with @JanssenBrm: we want to introduce an "organization" concept in the ETL API resource reporting, so that users that are part of multiple organizations/projects can explicitly specify the …
-
## There is Strong Demand to Map TypeDB Input/Output to other databases
Every user must import and export data from TypeDB to/from other data types. Data interchange and ETL are a large portion of an…
-
Idea taken from @boblannon's post here: http://sunlightfoundation.com/blog/2014/03/21/data-plumbers/
Since Bob calls out the [UnitedStates repos](https://github.com/unitedstates/) as representing som…
-
See https://github.com/Open-EO/FuseTS/issues/118 and #565
-
**Is your feature request related to a problem? Please describe.**
Currently our ETL job runs every 30 minutes and inserts a file into S3, triggering OpenSearch ingestion pipeline. Due to varying ETL…