-
### Overview
We need to audit all calendar events for a given project to match the Zoom Setup and Zoom Audit Spreadsheet so that we can optimize the availability of the Zoom rooms and have the most c…
-
# 쏘카 데이터 그룹 - Airflow와 함께한 데이터 환경 구축기(feat. Airflow on Kubernetes)
https://tech.socarcorp.kr/data/2021/06/01/data-engineering-with-airflow.html
-
I've seen the list of parameters:
https://vocab.nerc.ac.uk/collection/OG1/current/
I'm wondering about engineering data other than those parameters defined in the above link (pitch, roll, etc.).…
-
#### Description
To improve the performance and accuracy of the Bitcoin price prediction model, the following enhancements are proposed for the data preprocessing step:
1. **Use More Features**:
…
-
-
Some ideas:
- [x] Update the scripts in dev_utils to work on Central Store and from e.g. telservN, rather than assuming it's being ran on some local Mac (with paths to /tmp that don't work on Linux…
-
Last month we have announced our Data Collection project. Read more about this: https://dev.to/emailmarkup/collecting-data-1gdb
This project is led by @avigoldman. He is looking for someone (prefer…
-
Project summary
## Problems
DCP Borough offices, City Council staff, and City Hall staff can't find information about capital projects in their geographic areas of interest.
These groups of…
-
## TL;DR
### Article Link
https://towardsdatascience.com/data-transformation-and-feature-engineering-e3c7dfbb4899
### Author
Destin Gong
## Key Takeaways
Why need data transformation?
- …
-
* with dbt there's some interesting testing that can be added
* https://medium.com/@samzamany/unit-testing-in-data-engineering-a-practical-guide-91196afdf32a
* https://laredoute.io/blog/test-driven…