search

TimScholtens / thesis-etl

0 stars 0 forks source link

Data not being stored in database #13

Closed TimScholtens closed 4 years ago

TimScholtens commented 4 years ago

SQL

2020-05-27 07:27:43,521 INFO sqlalchemy.engine.base.Engine BEGIN (implicit) 2020-05-27 07:27:43,615 INFO sqlalchemy.engine.base.Engine INSERT INTO bioclim_1 (township, year, temperature_avg_year) VALUES (%(township)s, %(year)s, %(temperature_avg_year)s) 2020-05-27 07:27:43,615 INFO sqlalchemy.engine.base.Engine ({'township': 'Aa en Hunze', 'year': '2000', 'temperature_avg_year': Decimal('12.291410458283783')}, {'township': 'Assen', 'year': '2000', 'temperature_avg_year': Decimal('12.279661705381535')}, {'township': 'Borger-Odoorn', 'year': '2000', 'temperature_avg_year': Decimal('12.309722933363647')}, {'township': 'Coevorden', 'year': '2000', 'temperature_avg_year': Decimal('12.347798264750699')}, {'township': 'De Wolden', 'year': '2000', 'temperature_avg_year': Decimal('12.412102070802565')}, {'township': 'Emmen', 'year': '2000', 'temperature_avg_year': Decimal('12.35917508598894')}, {'township': 'Hoogeveen', 'year': '2000', 'temperature_avg_year': Decimal('12.368561112467395')}, {'township': 'Meppel', 'year': '2000', 'temperature_avg_year': Decimal('12.381119547549613')} ... displaying 10 of 8274 total bound parameter sets ... {'township': 'Zuidplas', 'year': '2020', 'temperature_avg_year': Decimal('7.879059071919838')}, {'township': 'Zwijndrecht', 'year': '2020', 'temperature_avg_year': Decimal('7.870312825997053')}) 2020-05-27 07:27:43,841 INFO sqlalchemy.engine.base.Engine COMMIT

TimScholtens commented 4 years ago

Not empty when bioclim etlconfig item not set

Empty when bioclim etlconfig item set

TimScholtens commented 4 years ago

Seems to occur randomly, might has something to do with SQLAlchemy statement within for-loop. Within for loop Outside for loop

TimScholtens commented 4 years ago

Seems to be a datagrip related issue