issues
search
ken-10
/
poketcgdata-workflows
0
stars
0
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Create db_cleanup.py to clean up db metadata every 15 days
#50
ken-10
closed
3 months ago
0
Load card details
#49
ken-10
opened
3 months ago
0
Add airflow db cleanup dag
#48
ken-10
closed
3 months ago
0
Issue 46 modify sets schedule and retries
#47
ken-10
closed
3 months ago
0
Reduce pokemon sets dag schedule to every 12 hours and add retries
#46
ken-10
closed
3 months ago
0
add log cleanup dag
#45
ken-10
closed
3 months ago
0
Add DAG to delete task and scheduler logs after 3 days
#44
ken-10
closed
3 months ago
0
Add xcom clean up at end of every dag run
#43
ken-10
opened
3 months ago
0
Issue 41 add terraform
#42
ken-10
closed
3 months ago
0
Add terraform for iaas
#41
ken-10
closed
3 months ago
0
Issue 39 Archive postgresql related DAGs, functions, and dbt projects
#40
ken-10
closed
3 months ago
0
Sunset postgresql pipelines
#39
ken-10
closed
3 months ago
0
fix pokemon_tcg_sets_elt_v2.py to bulkc copy to correct landing table
#38
ken-10
closed
3 months ago
0
Ingest Japanese Pokemon card sets
#37
ken-10
opened
3 months ago
0
pokemon_tcg_sets_elt_v2 isn't loading into card set tables
#36
ken-10
closed
3 months ago
0
Create DAG to get sealed product prices
#35
ken-10
opened
3 months ago
1
Update pokemon_tcg_sets_elt_v2.py to use its own processing folder
#34
ken-10
closed
3 months ago
0
Give pokemon_tcg_sets_elt_v2.py its own processing folder
#33
ken-10
closed
3 months ago
0
Issue 26 azure db dags
#32
ken-10
closed
3 months ago
0
Modify Airflow's executor from Celery Executor to Local Executor and removed components needed for Celery Executor
#31
ken-10
closed
3 months ago
0
Change Airflow executor from Celery to Local
#30
ken-10
closed
3 months ago
0
Update readme with diagram
#29
ken-10
closed
3 months ago
0
Issue 27 reduce airflow resource usage
#28
ken-10
closed
4 months ago
0
Reduce airflow resource usage
#27
ken-10
closed
3 months ago
0
Create DAGs to ingest to Azure SQL DB (DB migration)
#26
ken-10
closed
3 months ago
0
fix tcg player created datetime and set dag import timeout to 60s
#25
ken-10
closed
4 months ago
0
Issue 23 card price dag
#24
ken-10
closed
4 months ago
0
Create DAG to load daily market prices
#23
ken-10
closed
3 months ago
0
Issue 21 Card sets DAG
#22
ken-10
closed
4 months ago
0
Create DAG to ingest Sets
#21
ken-10
closed
4 months ago
0
Issue 19 bulk copy json
#20
ken-10
closed
7 months ago
0
Create bulk copy json functionality
#19
ken-10
closed
7 months ago
0
Added line to verify valid parameter
#18
eyang246
opened
8 months ago
0
Create JSON to CSV function/class
#17
ken-10
opened
8 months ago
0
get_all() in api_helper.py not throwing TypeError when non-enum datatype is provided as resource parameter
#16
ken-10
opened
8 months ago
0
Issue 14 Create get all function for api calls
#15
ken-10
closed
8 months ago
0
Create function to get all resource in api helper
#14
ken-10
closed
8 months ago
0
Issue 12 create rest client
#13
ken-10
closed
8 months ago
0
Create Rest API Client
#12
ken-10
closed
8 months ago
0
Convert setup.sh to makefile
#11
ken-10
opened
8 months ago
0
Design card set DAG
#10
ken-10
opened
8 months ago
0
add postgresql client installation in dockerfile, fix dags_data volum…
#9
ken-10
closed
8 months ago
0
Install psql cli in airflow image
#8
ken-10
closed
8 months ago
1
Local Backend Secrets
#7
eyang246
opened
8 months ago
0
Set up Pokemon TCG Dev Account
#6
ken-10
closed
8 months ago
0
Fix setup
#5
ken-10
closed
9 months ago
0
Research infrastructure to host DB
#4
ken-10
opened
9 months ago
0
Set up DB
#3
ken-10
closed
3 months ago
0
Research infrastructure to host Airflow
#2
ken-10
opened
9 months ago
0
Set up Airflow (Local)
#1
ken-10
closed
8 months ago
1
Next