search

teksi / wastewater

[DEV] Future TEKSI wastewater module, adapted data model to fit VSA-DSS 2020 new standard
https://teksi.github.io/wastewater
GNU General Public License v3.0
0 stars 5 forks source link

Import with 4585 Nodes takes > 4h #144

Closed TriformMoritz closed 2 months ago

TriformMoritz commented 5 months ago

An xtf with 4585 Nodes and 3108 reaches took over 4h to import. Is there a way to shorten the time? Why does it take so much time? With Stefan Computer over 10h.

Used: Qgis 3.28.15 Plugin: TEKSI Wastewater 0.0.0 VSA-DSS 2020

cymed commented 5 months ago

@3nids would it help to defer all relations?

3nids commented 5 months ago

I think that the slowness is rather coming from the triggers.

sjib commented 5 months ago

@3nids

  1. Then could we turn off the symbology triggers before starting the import e.g. ALTER TABLE tww_od.wastewater_networkelement DISABLE TRIGGER tr_symb_ws_label_update_by_wastewater_networkelement;
  1. and run the following functions with the option _all instead of with each element imported

Question - is the order correct?

  1. and turn the triggers on again at the end?

ALTER TABLE tww_od.wastewater_networkelement ENABLE TRIGGER tr_symb_ws_label_update_by_wastewater_networkelement;

Anything missing in this approach?

sjib commented 5 months ago

Maybe the function tww_app.update_depth could also be called at the end instead (I have not checked in which triggers it is called)

ponceta commented 4 months ago

Suggested behaviour : (as we used to do for pum upgrade)

  1. Disable symbology triggers
  2. Import data
  3. Enable and recalculate all symbology

I'm not sure this is great to have on one plugin button (maybe several buttons and the docs could explain how to import large datasets)

sjib commented 3 months ago

@TriformMoritz New version of datamodel brings BIG improvement: Only 35 minutes instead of more than 24 hours on my laptop

2024-03-12T16:32:32 teksi_wastewater:TEKSI Wastewater plugin version 0.0.0 started 2024-03-12T16:32:32 teksi_wastewater.utils.translation:Using system default locale: de_CH 2024-03-12T16:39:10 teksi_wastewater.interlis.utils:VALIDATING XTF DATA... 2024-03-12T16:39:10 teksi_wastewater.interlis.utils:EXECUTING: "C:\Program Files\Eclipse Foundation\jre-11.0.12.7-hotspot\bin\java" -jar "C:\Users/Stefan/AppData/Roaming/QGIS/QGIS3\profiles\tww_testing/python/plugins\teksi_wastewater\interlis\bin\ilivalidator-1.11.9\ilivalidator-1.11.9.jar" --log "C:\Users\Stefan\AppData\Local\Temp\tww2ili\240312163910.ilivalidator.log" "C:/Daten/Firma/3_Mandate_Beratung/32_Firmen/Triform/CHECKVSA2/c2_export_monthey_231103_sia405_abwasser_lv95mod8_2020_convert2020_1_output/dss2020/1_EXPORT_MONTHEY_231103_SIA405_ABWASSER_LV95mod8_2020_converted2020_1_org.xtf" 2024-03-12T16:39:20 teksi_wastewater.interlis.utils:GET XTF MODELS from C:/Daten/Firma/3_Mandate_Beratung/32_Firmen/Triform/CHECKVSA2/c2_export_monthey_231103_sia405_abwasser_lv95mod8_2020_convert2020_1_output/dss2020/1_EXPORT_MONTHEY_231103_SIA405_ABWASSER_LV95mod8_2020_converted2020_1_org.xtf... 2024-03-12T16:39:20 teksi_wastewater.interlis.utils:Model 'SIA405_ABWASSER_2020_1_LV95' was choosen for import among found models '['SIA405_Base_Abwasser_1_LV95']' 2024-03-12T16:39:20 teksi_wastewater.interlis.utils:CONNECTING TO DATABASE... 2024-03-12T16:39:20 teksi_wastewater.interlis.utils:DROPPING THE SCHEMA pg2ili_abwasser... 2024-03-12T16:39:20 teksi_wastewater.interlis.utils:CREATING THE SCHEMA pg2ili_abwasser... 2024-03-12T16:39:20 teksi_wastewater.interlis.utils:ILIDB SCHEMAIMPORT INTO pg2ili_abwasser... 2024-03-12T16:39:20 teksi_wastewater.interlis.utils:EXECUTING: "C:\Program Files\Eclipse Foundation\jre-11.0.12.7-hotspot\bin\java" -jar "C:\Users\Stefan\AppData\Roaming\QGIS\QGIS3\profiles\tww_testing\python\plugins\teksi_wastewater\libs\modelbaker\iliwrapper\bin\ili2pg-5.0.1\ili2pg-5.0.1.jar" --schemaimport --dbhost "localhost" --dbport "5432" --dbusr "postgres" --dbpwd "sjib" --dbdatabase "teksi_monthey2" --dbschema pg2ili_abwasser --setupPgExt --createGeomIdx --sqlExtRefCols --createFk --createFkIdx --createTidCol --importTid --createBasketCol --noSmartMapping --defaultSrsCode 2056 --log "C:\Users\Stefan\AppData\Local\Temp\tww2ili\240312163920.ili2pg-schemaimport.log" --nameLang de --models "SIA405_ABWASSER_2020_1_LV95" 2024-03-12T16:39:23 teksi_wastewater.interlis.utils:IMPORTING XTF DATA... 2024-03-12T16:39:23 teksi_wastewater.interlis.utils:EXECUTING: "C:\Program Files\Eclipse Foundation\jre-11.0.12.7-hotspot\bin\java" -jar "C:\Users\Stefan\AppData\Roaming\QGIS\QGIS3\profiles\tww_testing\python\plugins\teksi_wastewater\libs\modelbaker\iliwrapper\bin\ili2pg-5.0.1\ili2pg-5.0.1.jar" --import --deleteData --dbhost "localhost" --dbport "5432" --dbusr "postgres" --dbpwd "sjib" --dbdatabase "teksi_monthey2" --dbschema "pg2ili_abwasser" --disableValidation --skipReferenceErrors --createTidCol --noSmartMapping --defaultSrsCode 2056 --log "C:\Users\Stefan\AppData\Local\Temp\tww2ili\240312163923.ili2pg-import.log" "C:/Daten/Firma/3_Mandate_Beratung/32_Firmen/Triform/CHECKVSA2/c2_export_monthey_231103_sia405_abwasser_lv95mod8_2020_convert2020_1_output/dss2020/1_EXPORT_MONTHEY_231103_SIA405_ABWASSER_LV95mod8_2020_converted2020_1_org.xtf" 2024-03-12T16:39:29 teksi_wastewater.interlis.utils:Importing ABWASSER.organisation -> TWW.organisation 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.kanal -> TWW.channel 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.normschacht -> TWW.manhole 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.einleitstelle -> TWW.discharge_point 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.spezialbauwerk -> TWW.special_structure 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.versickerungsanlage -> TWW.infiltration_installation 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.rohrprofil -> TWW.pipe_profile 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.abwasserknoten -> TWW.wastewater_node 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.haltung -> TWW.reach 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.haltung_alternativverlauf -> TWW.reach_progression_alternative 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.haltungspunkt -> TWW.reach_point 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.trockenwetterfallrohr -> TWW.dryweather_downspout 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.einstiegshilfe -> TWW.access_aid 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.trockenwetterrinne -> TWW.dryweather_flume 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.deckel -> TWW.cover 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.bankett -> TWW.benching 2024-03-12T16:39:30 teksi_wastewater.interlis.utils:Importing ABWASSER.Spuelstutzen -> TWW.flushing_nozzle 2024-03-12T16:40:18 teksi_wastewater.interlis.utils:Update wastewater structure fk_main_cover 2024-03-12T16:40:18 teksi_wastewater.interlis.utils:Update wastewater structure fk_main_wastewater_node 2024-03-12T16:40:18 teksi_wastewater.interlis.utils:Refresh materialized views 2024-03-12T16:40:56 teksi_wastewater.interlis.utils:VALIDATING XTF DATA... 2024-03-12T16:40:56 teksi_wastewater.interlis.utils:EXECUTING: "C:\Program Files\Eclipse Foundation\jre-11.0.12.7-hotspot\bin\java" -jar "C:\Users/Stefan/AppData/Roaming/QGIS/QGIS3\profiles\tww_testing/python/plugins\teksi_wastewater\interlis\bin\ilivalidator-1.11.9\ilivalidator-1.11.9.jar" --log "C:\Users\Stefan\AppData\Local\Temp\tww2ili\240312164056.ilivalidator.log" "C:/Users/Stefan/Downloads/vsa_organisationen_2020_1.xtf" 2024-03-12T16:41:05 teksi_wastewater.interlis.utils:GET XTF MODELS from C:/Users/Stefan/Downloads/vsa_organisationen_2020_1.xtf... 2024-03-12T16:41:05 teksi_wastewater.interlis.utils:Model 'SIA405_ABWASSER_2020_1_LV95' was choosen for import among found models '['SIA405_Base_Abwasser_1_LV95']' 2024-03-12T16:41:05 teksi_wastewater.interlis.utils:CONNECTING TO DATABASE... 2024-03-12T16:41:05 teksi_wastewater.interlis.utils:DROPPING THE SCHEMA pg2ili_abwasser... 2024-03-12T16:41:05 teksi_wastewater.interlis.utils:CREATING THE SCHEMA pg2ili_abwasser... 2024-03-12T16:41:05 teksi_wastewater.interlis.utils:ILIDB SCHEMAIMPORT INTO pg2ili_abwasser... 2024-03-12T16:41:05 teksi_wastewater.interlis.utils:EXECUTING: "C:\Program Files\Eclipse Foundation\jre-11.0.12.7-hotspot\bin\java" -jar "C:\Users\Stefan\AppData\Roaming\QGIS\QGIS3\profiles\tww_testing\python\plugins\teksi_wastewater\libs\modelbaker\iliwrapper\bin\ili2pg-5.0.1\ili2pg-5.0.1.jar" --schemaimport --dbhost "localhost" --dbport "5432" --dbusr "postgres" --dbpwd "sjib" --dbdatabase "teksi_monthey2" --dbschema pg2ili_abwasser --setupPgExt --createGeomIdx --sqlExtRefCols --createFk --createFkIdx --createTidCol --importTid --createBasketCol --noSmartMapping --defaultSrsCode 2056 --log "C:\Users\Stefan\AppData\Local\Temp\tww2ili\240312164105.ili2pg-schemaimport.log" --nameLang de --models "SIA405_ABWASSER_2020_1_LV95" 2024-03-12T16:41:08 teksi_wastewater.interlis.utils:IMPORTING XTF DATA... 2024-03-12T16:41:08 teksi_wastewater.interlis.utils:EXECUTING: "C:\Program Files\Eclipse Foundation\jre-11.0.12.7-hotspot\bin\java" -jar "C:\Users\Stefan\AppData\Roaming\QGIS\QGIS3\profiles\tww_testing\python\plugins\teksi_wastewater\libs\modelbaker\iliwrapper\bin\ili2pg-5.0.1\ili2pg-5.0.1.jar" --import --deleteData --dbhost "localhost" --dbport "5432" --dbusr "postgres" --dbpwd "sjib" --dbdatabase "teksi_monthey2" --dbschema "pg2ili_abwasser" --disableValidation --skipReferenceErrors --createTidCol --noSmartMapping --defaultSrsCode 2056 --log "C:\Users\Stefan\AppData\Local\Temp\tww2ili\240312164108.ili2pg-import.log" "C:/Users/Stefan/Downloads/vsa_organisationen_2020_1.xtf" 2024-03-12T16:41:13 teksi_wastewater.interlis.utils:Importing ABWASSER.organisation -> TWW.organisation 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.kanal -> TWW.channel 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.normschacht -> TWW.manhole 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.einleitstelle -> TWW.discharge_point 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.spezialbauwerk -> TWW.special_structure 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.versickerungsanlage -> TWW.infiltration_installation 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.rohrprofil -> TWW.pipe_profile 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.abwasserknoten -> TWW.wastewater_node 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.haltung -> TWW.reach 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.haltung_alternativverlauf -> TWW.reach_progression_alternative 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.haltungspunkt -> TWW.reach_point 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.trockenwetterfallrohr -> TWW.dryweather_downspout 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.einstiegshilfe -> TWW.access_aid 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.trockenwetterrinne -> TWW.dryweather_flume 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.deckel -> TWW.cover 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.bankett -> TWW.benching 2024-03-12T16:41:20 teksi_wastewater.interlis.utils:Importing ABWASSER.Spuelstutzen -> TWW.flushing_nozzle 2024-03-12T16:41:43 teksi_wastewater.interlis.utils:Update wastewater structure fk_main_cover 2024-03-12T16:41:43 teksi_wastewater.interlis.utils:Update wastewater structure fk_main_wastewater_node 2024-03-12T16:41:43 teksi_wastewater.interlis.utils:Refresh materialized views 2024-03-12T16:42:46 teksi_wastewater.interlis.utils:VALIDATING XTF DATA... 2024-03-12T16:42:46 teksi_wastewater.interlis.utils:EXECUTING: "C:\Program Files\Eclipse Foundation\jre-11.0.12.7-hotspot\bin\java" -jar "C:\Users/Stefan/AppData/Roaming/QGIS/QGIS3\profiles\tww_testing/python/plugins\teksi_wastewater\interlis\bin\ilivalidator-1.11.9\ilivalidator-1.11.9.jar" --log "C:\Users\Stefan\AppData\Local\Temp\tww2ili\240312164246.ilivalidator.log" "C:/Daten/Firma/3_Mandate_Beratung/32_Firmen/Triform/CHECKVSA2/c2_export_monthey_231103_sia405_abwasser_lv95mod8_2020_convert2020_1_output/dss2020/3_EXPORT_MONTHEY_231103_SIA405_ABWASSER_LV95mod8_2020_converted2020_1_korr.xtf" 2024-03-12T16:43:14 teksi_wastewater.interlis.utils:GET XTF MODELS from C:/Daten/Firma/3_Mandate_Beratung/32_Firmen/Triform/CHECKVSA2/c2_export_monthey_231103_sia405_abwasser_lv95mod8_2020_convert2020_1_output/dss2020/3_EXPORT_MONTHEY_231103_SIA405_ABWASSER_LV95mod8_2020_converted2020_1_korr.xtf... 2024-03-12T16:43:15 teksi_wastewater.interlis.utils:Model 'DSS_2020_1_LV95' was choosen for import among found models '['DSS_2020_1_LV95']' 2024-03-12T16:43:15 teksi_wastewater.interlis.utils:CONNECTING TO DATABASE... 2024-03-12T16:43:15 teksi_wastewater.interlis.utils:DROPPING THE SCHEMA pg2ili_abwasser... 2024-03-12T16:43:16 teksi_wastewater.interlis.utils:CREATING THE SCHEMA pg2ili_abwasser... 2024-03-12T16:43:16 teksi_wastewater.interlis.utils:ILIDB SCHEMAIMPORT INTO pg2ili_abwasser... 2024-03-12T16:43:16 teksi_wastewater.interlis.utils:EXECUTING: "C:\Program Files\Eclipse Foundation\jre-11.0.12.7-hotspot\bin\java" -jar "C:\Users\Stefan\AppData\Roaming\QGIS\QGIS3\profiles\tww_testing\python\plugins\teksi_wastewater\libs\modelbaker\iliwrapper\bin\ili2pg-5.0.1\ili2pg-5.0.1.jar" --schemaimport --dbhost "localhost" --dbport "5432" --dbusr "postgres" --dbpwd "sjib" --dbdatabase "teksi_monthey2" --dbschema pg2ili_abwasser --setupPgExt --createGeomIdx --sqlExtRefCols --createFk --createFkIdx --createTidCol --importTid --createBasketCol --noSmartMapping --defaultSrsCode 2056 --log "C:\Users\Stefan\AppData\Local\Temp\tww2ili\240312164316.ili2pg-schemaimport.log" --nameLang de --models "DSS_2020_1_LV95" 2024-03-12T16:43:21 teksi_wastewater.interlis.utils:IMPORTING XTF DATA... 2024-03-12T16:43:21 teksi_wastewater.interlis.utils:EXECUTING: "C:\Program Files\Eclipse Foundation\jre-11.0.12.7-hotspot\bin\java" -jar "C:\Users\Stefan\AppData\Roaming\QGIS\QGIS3\profiles\tww_testing\python\plugins\teksi_wastewater\libs\modelbaker\iliwrapper\bin\ili2pg-5.0.1\ili2pg-5.0.1.jar" --import --deleteData --dbhost "localhost" --dbport "5432" --dbusr "postgres" --dbpwd "sjib" --dbdatabase "teksi_monthey2" --dbschema "pg2ili_abwasser" --disableValidation --skipReferenceErrors --createTidCol --noSmartMapping --defaultSrsCode 2056 --log "C:\Users\Stefan\AppData\Local\Temp\tww2ili\240312164321.ili2pg-import.log" "C:/Daten/Firma/3_Mandate_Beratung/32_Firmen/Triform/CHECKVSA2/c2_export_monthey_231103_sia405_abwasser_lv95mod8_2020_convert2020_1_output/dss2020/3_EXPORT_MONTHEY_231103_SIA405_ABWASSER_LV95mod8_2020_converted2020_1_korr.xtf" 2024-03-12T16:43:56 teksi_wastewater.interlis.utils:Importing ABWASSER.organisation -> TWW.organisation 2024-03-12T16:43:57 teksi_wastewater.interlis.utils:Importing ABWASSER.kanal -> TWW.channel 2024-03-12T16:44:28 teksi_wastewater.interlis.utils:Importing ABWASSER.normschacht -> TWW.manhole 2024-03-12T16:44:48 teksi_wastewater.interlis.utils:Importing ABWASSER.einleitstelle -> TWW.discharge_point 2024-03-12T16:44:48 teksi_wastewater.interlis.utils:Importing ABWASSER.spezialbauwerk -> TWW.special_structure 2024-03-12T16:44:49 teksi_wastewater.interlis.utils:Importing ABWASSER.versickerungsanlage -> TWW.infiltration_installation 2024-03-12T16:44:49 teksi_wastewater.interlis.utils:Importing ABWASSER.rohrprofil -> TWW.pipe_profile 2024-03-12T16:44:49 teksi_wastewater.interlis.utils:Importing ABWASSER.abwasserknoten -> TWW.wastewater_node 2024-03-12T16:45:03 teksi_wastewater.interlis.utils:Importing ABWASSER.haltung -> TWW.reach 2024-03-12T16:45:30 teksi_wastewater.interlis.utils:Importing ABWASSER.haltung_alternativverlauf -> TWW.reach_progression_alternative 2024-03-12T16:45:30 teksi_wastewater.interlis.utils:Importing ABWASSER.haltungspunkt -> TWW.reach_point 2024-03-12T16:45:47 teksi_wastewater.interlis.utils:Importing ABWASSER.trockenwetterfallrohr -> TWW.dryweather_downspout 2024-03-12T16:45:47 teksi_wastewater.interlis.utils:Importing ABWASSER.einstiegshilfe -> TWW.access_aid 2024-03-12T16:45:47 teksi_wastewater.interlis.utils:Importing ABWASSER.trockenwetterrinne -> TWW.dryweather_flume 2024-03-12T16:45:47 teksi_wastewater.interlis.utils:Importing ABWASSER.deckel -> TWW.cover 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.bankett -> TWW.benching 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.Spuelstutzen -> TWW.flushing_nozzle 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.abwasserreinigungsanlage -> TWW.waste_water_treatment_plant 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.araenergienutzung -> TWW.wwtp_energy_use 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.abwasserbehandlung -> TWW.waste_water_treatment 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.schlammbehandlung -> TWW.sludge_treatment 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.arabauwerk -> TWW.wwtp_structure 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.steuerungszentrale -> TWW.control_center 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.Abflusslose_Toilette -> TWW.drainless_toilet 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.Absperr_Drosselorgan -> TWW.throttle_shut_off_unit 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.Beckenentleerung -> TWW.tank_emptying 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.Beckenreinigung -> TWW.tank_cleaning 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.Biol_oekol_Gesamtbeurteilung -> TWW.bio_ecol_assessment 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.Brunnen -> TWW.fountain 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.EZG_PARAMETER_ALLG -> TWW.param_ca_general 2024-03-12T16:46:10 teksi_wastewater.interlis.utils:Importing ABWASSER.EZG_PARAMETER_MOUSE1 -> TWW.param_ca_mouse1 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Einzelflaeche -> TWW.individual_surface 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Einzugsgebiet -> TWW.catchment_area 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.ElektrischeEinrichtung -> TWW.electric_equipment 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.ElektromechanischeAusruestung -> TWW.electromechanical_equipment 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Entsorgung -> TWW.disposal 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Entwaesserungssystem -> TWW.drainage_system 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Feststoffrueckhalt -> TWW.solids_retention 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.FoerderAggregat -> TWW. 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Gebaeude -> TWW.building 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Gebaeudegruppe -> TWW.building_group 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Gebaeudegruppe_BAUGWR -> TWW.building_group_baugwr 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Gesamteinzugsgebiet -> TWW.catchment_area_totals 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.HQ_Relation -> TWW.hq_relation 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Hydr_GeomRelation -> TWW.hydr_geom_relation 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Hydr_Geometrie -> TWW.hydr_geometry 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Hydr_Kennwerte -> TWW.hydraulic_char_data 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.KLARA -> TWW.small_treatment_plant 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Landwirtschaftsbetrieb -> TWW.farm 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Leapingwehr -> TWW.leapingweir 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Massnahme -> TWW.measure 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.MechanischeVorreinigung -> TWW.mechanical_pretreatment 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Messgeraet -> TWW.measuring_device 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Messreihe -> TWW.measurement_series 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Messresultat -> TWW.measurement_result 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Messstelle -> TWW.measuring_point 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Mutation -> TWW.mutation 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Reservoir -> TWW.reservoir 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Retentionskoerper -> TWW.retention_body 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Rohrprofil_Geometrie -> TWW.profile_geometry 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Rueckstausicherung -> TWW.backflow_prevention 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Stammkarte -> TWW.log_card 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Streichwehr -> TWW.prank_weir 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Ueberlaufcharakteristik -> TWW.overflow_char 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Unterhalt -> TWW.maintenance 2024-03-12T16:46:11 teksi_wastewater.interlis.utils:Importing ABWASSER.Versickerungsbereich -> TWW.infiltration_zone 2024-03-12T17:12:43 teksi_wastewater.interlis.utils:Update wastewater structure fk_main_cover 2024-03-12T17:12:43 teksi_wastewater.interlis.utils:Update wastewater structure fk_main_wastewater_node 2024-03-12T17:12:43 teksi_wastewater.interlis.utils:Refresh materialized views

domi4484 commented 2 months ago

Possible improvement to be tested by using sqlalchemy bulk inserts: https://docs.sqlalchemy.org/en/20/orm/queryguide/dml.html#orm-queryguide-bulk-insert

ponceta commented 2 months ago

@TriformMoritz latest plugin should do the job even better and faster!

You can give it a try : teksi_wastewater.0.0.0.zip

Please reopen if it doesn't suits your need!