-
At some point during the 4.0 release, we attempted to switch the data pipeline to fully-locked dependencies with poetry. I think (?) for various reasons this caused some grief with getting things inst…
sjahl updated
4 months ago
-
https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-era5-single-levels?tab=form
Mougk updated
1 month ago
-
- [x] Run Basler-derived videos through calibration pipline
- [?] Run Basler-derived videos through mediapipe pipelines (e.g. the 'move your hand around in the capture volume' task)
- [ ] Visualized B…
-
AS AN Architect
I WANT to have MVP to `v2` data migration pipeline
SO THAT implementing `v2` could be done in parallel with MVP without affecting each other
### Acceptance Criteria
- [ ] MVP uses it…
-
I am not getting error but after running q&a generation it took 20 minutes and got empty datasets
please let me know what can be the cause.
(granite1) sankar@Sankars-MacBook-Pro test1 % ilab dat…
-
**TO DOs for our data pipeline and software design:**
- sketch of the overall architecture of the software
- what database to use // do we need to re-do our database?
- implement the databases: m…
-
At one point the 30-second raw data pipeline was tightly coupled with the config table uploads. This meant that an incident in one pipeline could affect the others. As an example, in June there was an…
-
## Description
I'm trying to update a pipeline to use the new ibis.FileDataset. My pipeline reads in csv files, but writes them to duckdb for all data engineering operations. My current catalog is:
…
-
Our cellbrowser Snakemake pipeline `snakemake/wrappers/cellbrowser/wrapper.py` uses `cbImportScanpy` to create the cellbrowser input. After the cellbrowser input (tar file) is created, we manually mov…
-
### Apache Iceberg version
1.7.0 (latest release)
### Query engine
Kafka Connect
### Please describe the bug 🐞
I've been using the Tabular connector for some time and have transitioned over to th…