-
ETL pipelining is important for Desigining Database for Datamining purpose.Good ETL pipeline design helps developers to solve query and solve up data related task's accurately.
-
Hacer:
- [x] leer el archivo
- [x] buscar nulos
- [ ] buscar duplicados
- [ ] cargar archivo limpio
-
### Discussed in https://github.com/apache/airflow/discussions/33556
Originally posted by **ntnhaatj** August 20, 2023
### Description
Hi, as [my issue was raised here](https://github.com/a…
-
We currently upload files to both local (Vast) storage and cloud (S3) storage. There is a limited amount of storage on the Vast and as we continue to upload files we are quickly reaching this ceiling.…
-
(Sorry if any inconsistencies show up, but I have to put this down from memory)
# Background
- Exasol as remote database, not LOCAL.
- EXA2EXA transfer mode (JDBC seems to work, so it is not dire…
exaSR updated
2 weeks ago
-
## Question
我的conf/es/test.yml内容如下：
> dataSourceKey: defaultDS
destination: example1
groupId: g1
esMapping:
_index: test6-subaccount_history
_type: _doc
_id: _id
upsert: true
#pk: …
-
### Run Information
Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [357b09da5abffaeb67d64c928e15293ca2a2de5e](https://github.com/dotnet/runtime/commit/357…
-
データ取得→解析→返却、というETLっぽいことをしたい。
それぞれが得意なライブラリを調査する。
下記基本的操作ができるスクレイピングライブラリを調査する
- 取得したリンクへアクセスする
- サイトから、特定のタグに囲まれたテキストを取得する
- サイトから、特定のリンクを取得する
- jacascriptイベントが必要なサイトから完全なHTMLを取得する
Docs：htt…
-
Possibly include removing www. from final URL website field, and making the final URL same website field then compare those two and maybe be more useful.
then, circulate this to list of people wh…
-
Currently we are working off of a static set of projects in the `mapping.json` file. Once OSO has streamlined the way they add projects we will be able to use this to add new projects to our app. This…