-
task; https://n-abledev.atlassian.net/browse/DA-2724?atlOrigin=eyJpIjoiNWQ4NDhmYzIwNGViNDJlOWIxYjhiZmJlMzgwYjMwZTMiLCJwIjoiaiJ9
-
# Intro and context
Kedro describes itself in its README as a tool for data science and data engineering pipelines (emphasis mine):
> Kedro is a toolbox for production-ready data science. It u…
-
Today you can analyze AKS Cost Analysis data via UI or through manual download.
Support for scheduled exports will allow you to export cost data for further analysis and processing. This will allow y…
-
Enhance the ETL process to include a concept of handlers.
These handlers will take data from the source and allow the developer to manipulate the incoming data before sending it on to the destination…
-
## User Story
In order to incorporate updates to the datagov-harvesting-logic API, and feedback from the most recent design sessions, changes need to be made to the Airflow ETL pipeline DAG in order …
-
- [ ] [Análisis de Datos Deportivos de Fútbol con Power BI](https://www.udemy.com/course/experto-en-analisis-de-datos-del-futbol-soccer-con-power-bi/)
- [ ] [Growing Object-Oriented Software, Guided …
-
### Describe the bug
Running the following CDK construct:
`new aws_lambda_nodejs.NodejsFunction(this, 'RollbarNotifierLambda', {
projectRoot: path.join(__dirname, '../assets/RollbarNotifier…
-
### 요청 내용
네이버 API를 활용하여 검색(뉴스) 여행 키워드 수집
- [x] 1/ 네이버 개발자 계정 생성
https://developers.naver.com/main/
- [x] 2/ 일일 토큰량 확인
25000 requests per a day
- [x] 3/ 네이버 API 데이터 수집 확인(test)
- [ ] 수집…
-
Create one complete pipeline to run the scraping and preprocessing - getting the news articles, calculating the before and after days, getting the stock prices - and set it up as a scheduled cron task…
-
I reckon it'll take about 8 hours to process the whole staging database.
The trade data only takes 10 minutes at the moment which is manageable. This data is being worked-on at the minute with lots…