-
-
-
On Ubuntu 18.04, running ETL with the usual command line:
mvn exec:java -Dexec.mainClass="org.heigit.bigspatialdata.oshdb.tool.importer.extract.Extract" -Dexec.args="--pbf /home/ertert/oshdb-new/os…
-
# Discussion issue
Input files for _disease_ ETL step are located at ```ontology-inputs``` folder.
When having a look at the file _ontology-efo.jsonl_, collected by PIS from [here](https://github.…
-
Utils to autogenerate input jsons for each capsule, will also manipulate data (formatting) for capsules
Purpose is - Formatting, data manipulation for what each capsule needs
-
Syncing from kakfa and doing ETL should run as a continuous service so we don't need to poll and recompute progress state on each run.
Step 1 is to get `from-kafka` to provide a continuous service wh…
-
### Run Information
Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [2af0051c894aac4d1a9d6479ad6dd7547a688363](https://github.com/dotnet/runtime/commit/2af…
-
# 改善詳細 / Details of Improvement
ETLを定期実行にして差分取得するための設計とCDKの実装を行う。
基本的にはCommunityNotesの更新頻度に合わせておこなう。更新日時が日によって違ったりするので、スクリプト自体は4時間に1回回すような方法でもいいかもしれない。ただ、Twitterのデータが1分に1件しか取れないので、例えば素直に4時間ごとに実行した…
-
Is there a way to use other db connector except EFCore and SQLClient to access databases? As we have issue using any of the implemented due to the issue, that database we are targeting is SQL 2000.
-
# Tutorial Koneksi BigQuery dengan Python dan Pandas - Part 1 - BustoDev
Bagaimana cara menghubungkan BigQuery dengan Python dan Pandas? Cara mudah dan lengkap untuk melakukan ETL dengan Python dan B…