search

minus34 / gnaf-loader

A quick way to get started with Geoscape's open GNAF & Admin Boundaries
Apache License 2.0
182 stars 66 forks source link

SQL FAILED errors during load #59

Closed UnverifiedContact closed 2 years ago

UnverifiedContact commented 2 years ago

I'm trying to run an import with load.gnaf.py on the latest master with commit dc2be64c61970e99a1217cf4a5f36910438f81b2 and encountering these errors each time which cause the script to eventually fail completely.

Kind of at a loss about what to do... Any suggestions?

Full log here - https://pastebin.com/kRHkfXTq (or see excerpt below)

root        : INFO
root        : INFO     Start gnaf-loader
root        : INFO      - running Python 3.6.4 with Psycopg2 2.7.1
root        : INFO      - on Linux #136-Ubuntu SMP Tue Feb 16 22:44:38 UTC 2021
root        : INFO      - using Postgres 10.1 on x86_64-pc-linux-gnu and PostGIS 2.4.3 (with GEOS 3.6.1-CAPI-1.10.1)
root        : INFO
root        : INFO     Arguments
root        : INFO      - prevacuum : False
root        : INFO      - raw_fk : False
root        : INFO      - raw_unlogged : True
root        : INFO      - max_processes : 6
root        : INFO      - no_boundary_tag : False
root        : INFO      - pghost : localhost
root        : INFO      - pgport : 5469
root        : INFO      - pgdb :
root        : INFO      - pguser : ubuntu
root        : INFO      - psma_version : 201802
root        : INFO      - raw_gnaf_schema : raw_gnaf
root        : INFO      - raw_admin_schema : raw_admin_bdys
root        : INFO      - gnaf_schema : gnaf
root        : INFO      - admin_schema : admin_bdys
root        : INFO      - gnaf_tables_path : /home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021
root        : INFO      - admin_bdys_path : /home/ubuntu/GEO_21_AUG/FILES/AUG21_Admin_Boundaries_ESRIShapefileorDBFfile
root        : INFO      - states : ['ACT', 'NSW', 'NT', 'OT', 'QLD', 'SA', 'TAS', 'VIC', 'WA']
root        : INFO
root        : INFO     Part 1 of 6 : Create schemas : 2021-10-05 02:30:59.216284
root        : INFO     Part 1 of 6 : Schemas created! : 0:00:00.003572
root        : INFO
root        : INFO     Part 2 of 6 : Start raw GNAF load : 2021-10-05 02:30:59.220131
root        : INFO      - Step 1 of 7 : tables dropped : 0:00:00.004193
root        : INFO      - Step 2 of 7 : database NOT vacuumed
root        : INFO      - Step 3 of 7 : UNLOGGED tables created : 0:00:00.085270
root        : INFO              - Loading state ACT
root        : INFO              - Loading state NSW
root        : INFO              - Loading state NT
root        : INFO              - Loading state OT
root        : INFO              - Loading state QLD
root        : INFO              - Loading state SA
root        : INFO              - Loading state TAS
root        : INFO              - Loading state VIC
root        : INFO              - Loading state WA
root        : INFO     SQL FAILED! : COPY raw_gnaf.mb_2021 FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/ACT_MB_2021_psv.psv' DELIMITER '|' CSV HEADER; : relation "raw_gnaf.mb_2021" does not exist

root        : INFO     SQL FAILED! : COPY raw_gnaf.locality_pid_linkage.psv FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/act_locality_pid_linkage.psv' DELIMITER '|' CSV HEADER; : cross-database references are not implemented: "raw_gnaf.locality_pi
d_linkage.psv"

root        : INFO     SQL FAILED! : COPY raw_gnaf.address_mesh_block_2021 FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/ACT_ADDRESS_MESH_BLOCK_2021_psv.psv' DELIMITER '|' CSV HEADER; : relation "raw_gnaf.address_mesh_block_2021" does not exist

root        : INFO     SQL FAILED! : COPY raw_gnaf.mb_2021 FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/NSW_MB_2021_psv.psv' DELIMITER '|' CSV HEADER; : relation "raw_gnaf.mb_2021" does not exist

root        : INFO     SQL FAILED! : COPY raw_gnaf.locality_pid_linkage.psv FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/nsw_locality_pid_linkage.psv' DELIMITER '|' CSV HEADER; : cross-database references are not implemented: "raw_gnaf.locality_pi
d_linkage.psv"

root        : INFO     SQL FAILED! : COPY raw_gnaf.address_mesh_block_2021 FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/NSW_ADDRESS_MESH_BLOCK_2021_psv.psv' DELIMITER '|' CSV HEADER; : relation "raw_gnaf.address_mesh_block_2021" does not exist

root        : INFO     SQL FAILED! : COPY raw_gnaf.address_mesh_block_2021 FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/NT_ADDRESS_MESH_BLOCK_2021_psv.psv' DELIMITER '|' CSV HEADER; : relation "raw_gnaf.address_mesh_block_2021" does not exist

root        : INFO     SQL FAILED! : COPY raw_gnaf.locality_pid_linkage.psv FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/nt_locality_pid_linkage.psv' DELIMITER '|' CSV HEADER; : cross-database references are not implemented: "raw_gnaf.locality_pid
_linkage.psv"

root        : INFO     SQL FAILED! : COPY raw_gnaf.mb_2021 FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/NT_MB_2021_psv.psv' DELIMITER '|' CSV HEADER; : relation "raw_gnaf.mb_2021" does not exist
minus34 commented 2 years ago

Setting --raw-gnaf-schema to _rawgnaf has triggered a bug in the code.

The quick workaround is to not set these flags when running load-gnaf.py: --raw-gnaf-schema --raw-admin-schema --gnaf-schema --admin-schema

This will set the schema names to their defaults (e.g. raw_gnaf_202108). The names can be changed after running the script if needed.

A quick look at the code doesn't identify the issue, so it'll need some testing at my end. It's related to how Postgres uses search paths.

Can you please check if those tables were actually created in the _rawgnaf schema; and if not - are they in the public schema?

UnverifiedContact commented 2 years ago

Hi thanks for the reply,

It appears in my case that the same errors are still encountered without those flags.

I am only using a few flags now, like this:

python -u $SCRIPTDIR/load-gnaf.py \
  --pghost "$DBHOST" \
  --pgport "$DBPORT" \
  --pgdb "$DBNAME" \
  --pguser "$DBUSER" \
  --gnaf-tables-path "$DATADIR_GNAF" \
  --admin-bdys-path "$DATADIR_ADMINBOUNDS" \
  --raw-unlogged

New truncated output:

root        : INFO
root        : INFO     Start gnaf-loader
root        : INFO      - running Python 3.6.4 with Psycopg2 2.7.1
root        : INFO      - on Linux #136-Ubuntu SMP Tue Feb 16 22:44:38 UTC 2021
root        : INFO      - using Postgres 10.1 on x86_64-pc-linux-gnu and PostGIS 2.4.3 (with GEOS 3.6.1-CAPI-1.10.1)
root        : INFO
root        : INFO     Arguments
root        : INFO      - prevacuum : False
root        : INFO      - raw_fk : False
root        : INFO      - raw_unlogged : True
root        : INFO      - max_processes : 6
root        : INFO      - no_boundary_tag : False
root        : INFO      - pghost : localhost
root        : INFO      - pgport : 5469
root        : INFO      - pgdb :
root        : INFO      - pguser : ubuntu
root        : INFO      - psma_version : 202108
root        : INFO      - raw_gnaf_schema : raw_gnaf_202108
root        : INFO      - raw_admin_schema : raw_admin_bdys_202108
root        : INFO      - gnaf_schema : gnaf_202108
root        : INFO      - admin_schema : admin_bdys_202108
root        : INFO      - gnaf_tables_path : /home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021
root        : INFO      - admin_bdys_path : /home/ubuntu/GEO_21_AUG/FILES/AUG21_Admin_Boundaries_ESRIShapefileorDBFfile
root        : INFO      - states : ['ACT', 'NSW', 'NT', 'OT', 'QLD', 'SA', 'TAS', 'VIC', 'WA']
root        : INFO
root        : INFO     Part 1 of 6 : Create schemas : 2021-10-06 08:15:14.068558
root        : INFO     Part 1 of 6 : Schemas created! : 0:00:00.003428
root        : INFO
root        : INFO     Part 2 of 6 : Start raw GNAF load : 2021-10-06 08:15:14.072742
root        : INFO      - Step 1 of 7 : tables dropped : 0:00:00.006715
root        : INFO      - Step 2 of 7 : database NOT vacuumed
root        : INFO      - Step 3 of 7 : UNLOGGED tables created : 0:00:00.077329
root        : INFO              - Loading state ACT
root        : INFO              - Loading state NSW
root        : INFO              - Loading state NT
root        : INFO              - Loading state OT
root        : INFO              - Loading state QLD
root        : INFO              - Loading state SA
root        : INFO              - Loading state TAS
root        : INFO              - Loading state VIC
root        : INFO              - Loading state WA
root        : INFO     SQL FAILED! : COPY raw_gnaf_202108.mb_2021 FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/ACT_MB_2021_psv.psv' DELIMITER '|' CSV HEADER; : relation "raw_gnaf_202108.mb_2021" does not exist

root        : INFO     SQL FAILED! : COPY raw_gnaf_202108.locality_pid_linkage.psv FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/act_locality_pid_linkage.psv' DELIMITER '|' CSV HEADER; : cross-database references are not implemented: "raw_gnaf_202$
08.locality_pid_linkage.psv"

root        : INFO     SQL FAILED! : COPY raw_gnaf_202108.address_mesh_block_2021 FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/ACT_ADDRESS_MESH_BLOCK_2021_psv.psv' DELIMITER '|' CSV HEADER; : relation "raw_gnaf_202108.address_mesh_block_2021" doe$
 not exist

root        : INFO     SQL FAILED! : COPY raw_gnaf_202108.locality_pid_linkage.psv FROM '/home/ubuntu/GEO_21_AUG/FILES/G-NAF/G-NAF AUGUST 2021/Standard/nsw_locality_pid_linkage.psv' DELIMITER '|' CSV HEADER; : cross-database references are not implemented: "raw_gnaf_202$
08.locality_pid_linkage.psv"

Also, regarding your question about which tables are being created and where, here is a list of the state after the crash at the end:

                              List of relations
       Schema       |                  Name                  | Type  | Owner
--------------------+----------------------------------------+-------+--------
 admin_bdys         | abs_2011_gccsa                         | table | ubuntu
 admin_bdys         | abs_2011_mb                            | table | ubuntu
 admin_bdys         | abs_2011_sa1                           | table | ubuntu
 admin_bdys         | abs_2011_sa2                           | table | ubuntu
 admin_bdys         | abs_2011_sa3                           | table | ubuntu
 admin_bdys         | abs_2011_sa4                           | table | ubuntu
 admin_bdys         | abs_2016_gccsa                         | table | ubuntu
 admin_bdys         | abs_2016_mb                            | table | ubuntu
 admin_bdys         | abs_2016_sa1                           | table | ubuntu
 admin_bdys         | abs_2016_sa2                           | table | ubuntu
 admin_bdys         | abs_2016_sa3                           | table | ubuntu
 admin_bdys         | abs_2016_sa4                           | table | ubuntu
 admin_bdys         | commonwealth_electorates               | table | ubuntu
 admin_bdys         | commonwealth_electorates_analysis      | table | ubuntu
 admin_bdys         | postcode_bdys                          | table | ubuntu
 admin_bdys         | state_bdys                             | table | ubuntu
 admin_bdys         | state_bdys_analysis                    | table | ubuntu
 admin_bdys         | state_lower_house_electorates          | table | ubuntu
 admin_bdys         | state_lower_house_electorates_analysis | table | ubuntu
 admin_bdys         | state_upper_house_electorates          | table | ubuntu
 admin_bdys         | state_upper_house_electorates_analysis | table | ubuntu
 gnaf               | address_alias_lookup                   | table | ubuntu
 gnaf               | address_aliases                        | table | ubuntu
 gnaf               | address_principals                     | table | ubuntu
 gnaf               | address_secondary_lookup               | table | ubuntu
 gnaf               | localities                             | table | ubuntu
 gnaf               | locality_aliases                       | table | ubuntu
 gnaf               | locality_neighbour_lookup              | table | ubuntu
 gnaf               | street_aliases                         | table | ubuntu
 gnaf               | streets                                | table | ubuntu
 gnaf               | temp_addresses                         | table | ubuntu
 information_schema | sql_features                           | table | ubuntu
 information_schema | sql_implementation_info                | table | ubuntu
 information_schema | sql_languages                          | table | ubuntu
 information_schema | sql_packages                           | table | ubuntu
 information_schema | sql_parts                              | table | ubuntu
 information_schema | sql_sizing                             | table | ubuntu
 information_schema | sql_sizing_profiles                    | table | ubuntu
 pg_catalog         | pg_aggregate                           | table | ubuntu
 pg_catalog         | pg_am                                  | table | ubuntu
 pg_catalog         | pg_amop                                | table | ubuntu
 pg_catalog         | pg_amproc                              | table | ubuntu
 pg_catalog         | pg_attrdef                             | table | ubuntu
 pg_catalog         | pg_attribute                           | table | ubuntu
 pg_catalog         | pg_auth_members                        | table | ubuntu
 pg_catalog         | pg_authid                              | table | ubuntu
 pg_catalog         | pg_cast                                | table | ubuntu
 pg_catalog         | pg_class                               | table | ubuntu
 pg_catalog         | pg_collation                           | table | ubuntu
 pg_catalog         | pg_constraint                          | table | ubuntu
 pg_catalog         | pg_conversion                          | table | ubuntu
 pg_catalog         | pg_database                            | table | ubuntu
 pg_catalog         | pg_db_role_setting                     | table | ubuntu
 pg_catalog         | pg_default_acl                         | table | ubuntu
 pg_catalog         | pg_depend                              | table | ubuntu
 pg_catalog         | pg_description                         | table | ubuntu
 pg_catalog         | pg_enum                                | table | ubuntu
 pg_catalog         | pg_event_trigger                       | table | ubuntu
 pg_catalog         | pg_extension                           | table | ubuntu
 pg_catalog         | pg_foreign_data_wrapper                | table | ubuntu
 pg_catalog         | pg_foreign_server                      | table | ubuntu
 pg_catalog         | pg_foreign_table                       | table | ubuntu
 pg_catalog         | pg_index                               | table | ubuntu
 pg_catalog         | pg_inherits                            | table | ubuntu
 pg_catalog         | pg_init_privs                          | table | ubuntu
 pg_catalog         | pg_language                            | table | ubuntu
 pg_catalog         | pg_largeobject                         | table | ubuntu
 pg_catalog         | pg_largeobject_metadata                | table | ubuntu
 pg_catalog         | pg_namespace                           | table | ubuntu
 pg_catalog         | pg_opclass                             | table | ubuntu
 pg_catalog         | pg_operator                            | table | ubuntu
 pg_catalog         | pg_opfamily                            | table | ubuntu
 pg_catalog         | pg_partitioned_table                   | table | ubuntu
 pg_catalog         | pg_pltemplate                          | table | ubuntu
 pg_catalog         | pg_policy                              | table | ubuntu
 pg_catalog         | pg_proc                                | table | ubuntu
 pg_catalog         | pg_publication                         | table | ubuntu
 pg_catalog         | pg_publication_rel                     | table | ubuntu
 pg_catalog         | pg_range                               | table | ubuntu
 pg_catalog         | pg_replication_origin                  | table | ubuntu
 pg_catalog         | pg_rewrite                             | table | ubuntu
 pg_catalog         | pg_seclabel                            | table | ubuntu
 pg_catalog         | pg_sequence                            | table | ubuntu
 pg_catalog         | pg_shdepend                            | table | ubuntu
 pg_catalog         | pg_shdescription                       | table | ubuntu
 pg_catalog         | pg_shseclabel                          | table | ubuntu
 pg_catalog         | pg_statistic                           | table | ubuntu
 pg_catalog         | pg_statistic_ext                       | table | ubuntu
 pg_catalog         | pg_subscription                        | table | ubuntu
 pg_catalog         | pg_subscription_rel                    | table | ubuntu
 pg_catalog         | pg_tablespace                          | table | ubuntu
 pg_catalog         | pg_transform                           | table | ubuntu
 pg_catalog         | pg_trigger                             | table | ubuntu
 pg_catalog         | pg_ts_config                           | table | ubuntu
 pg_catalog         | pg_ts_config_map                       | table | ubuntu
 pg_catalog         | pg_ts_dict                             | table | ubuntu
 pg_catalog         | pg_ts_parser                           | table | ubuntu
 pg_catalog         | pg_ts_template                         | table | ubuntu
 pg_catalog         | pg_type                                | table | ubuntu
 pg_catalog         | pg_user_mapping                        | table | ubuntu
 public             | spatial_ref_sys                        | table | ubuntu
 raw_admin_bdys     | aus_comm_electoral                     | table | ubuntu
 raw_admin_bdys     | aus_comm_electoral_polygon             | table | ubuntu
 raw_admin_bdys     | aus_gccsa_2011                         | table | ubuntu
 raw_admin_bdys     | aus_gccsa_2011_polygon                 | table | ubuntu
 raw_admin_bdys     | aus_gccsa_2016                         | table | ubuntu
 raw_admin_bdys     | aus_gccsa_2016_polygon                 | table | ubuntu
 raw_admin_bdys     | aus_iare_2011                          | table | ubuntu
 raw_admin_bdys     | aus_iare_2011_polygon                  | table | ubuntu
 raw_admin_bdys     | aus_iare_2016                          | table | ubuntu
 raw_admin_bdys     | aus_iare_2016_polygon                  | table | ubuntu
 raw_admin_bdys     | aus_iloc_2011                          | table | ubuntu
 raw_admin_bdys     | aus_iloc_2011_polygon                  | table | ubuntu
 raw_admin_bdys     | aus_iloc_2016                          | table | ubuntu
 raw_admin_bdys     | aus_iloc_2016_polygon                  | table | ubuntu
 raw_admin_bdys     | aus_ireg_2011                          | table | ubuntu
 raw_admin_bdys     | aus_ireg_2011_polygon                  | table | ubuntu
 raw_admin_bdys     | aus_ireg_2016                          | table | ubuntu
 raw_admin_bdys     | aus_ireg_2016_polygon                  | table | ubuntu
 raw_admin_bdys     | aus_locality_town                      | table | ubuntu
 raw_admin_bdys     | aus_mb_2011                            | table | ubuntu
 raw_admin_bdys     | aus_mb_2011_polygon                    | table | ubuntu
 raw_admin_bdys     | aus_mb_2016                            | table | ubuntu
 raw_admin_bdys     | aus_mb_2016_polygon                    | table | ubuntu
 raw_admin_bdys     | aus_mb_category_class_aut              | table | ubuntu
 raw_admin_bdys     | aus_remoteness_2011                    | table | ubuntu
 raw_admin_bdys     | aus_remoteness_2011_polygon            | table | ubuntu
 raw_admin_bdys     | aus_remoteness_2016                    | table | ubuntu
 raw_admin_bdys     | aus_remoteness_2016_polygon            | table | ubuntu
 raw_admin_bdys     | aus_remoteness_category_aut            | table | ubuntu
 raw_admin_bdys     | aus_sa1_2011                           | table | ubuntu
 raw_admin_bdys     | aus_sa1_2011_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_sa1_2016                           | table | ubuntu
 raw_admin_bdys     | aus_sa1_2016_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_sa2_2011                           | table | ubuntu
 raw_admin_bdys     | aus_sa2_2011_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_sa2_2016                           | table | ubuntu
 raw_admin_bdys     | aus_sa2_2016_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_sa3_2011                           | table | ubuntu
 raw_admin_bdys     | aus_sa3_2011_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_sa3_2016                           | table | ubuntu
 raw_admin_bdys     | aus_sa3_2016_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_sa4_2011                           | table | ubuntu
 raw_admin_bdys     | aus_sa4_2011_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_sa4_2016                           | table | ubuntu
 raw_admin_bdys     | aus_sa4_2016_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_seifa_2011                         | table | ubuntu
 raw_admin_bdys     | aus_seifa_2016                         | table | ubuntu
 raw_admin_bdys     | aus_sos_2011                           | table | ubuntu
 raw_admin_bdys     | aus_sos_2011_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_sos_2016                           | table | ubuntu
 raw_admin_bdys     | aus_sos_2016_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_sosr_2011                          | table | ubuntu
 raw_admin_bdys     | aus_sosr_2011_polygon                  | table | ubuntu
 raw_admin_bdys     | aus_sosr_2016                          | table | ubuntu
 raw_admin_bdys     | aus_sosr_2016_polygon                  | table | ubuntu
 raw_admin_bdys     | aus_state                              | table | ubuntu
 raw_admin_bdys     | aus_state_electoral                    | table | ubuntu
 raw_admin_bdys     | aus_state_electoral_class_aut          | table | ubuntu
 raw_admin_bdys     | aus_state_electoral_polygon            | table | ubuntu
 raw_admin_bdys     | aus_state_polygon                      | table | ubuntu
 raw_admin_bdys     | aus_sua_2011                           | table | ubuntu
 raw_admin_bdys     | aus_sua_2011_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_sua_2016                           | table | ubuntu
 raw_admin_bdys     | aus_sua_2016_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_town                               | table | ubuntu
 raw_admin_bdys     | aus_town_class_aut                     | table | ubuntu
 raw_admin_bdys     | aus_town_point                         | table | ubuntu
 raw_admin_bdys     | aus_ucl_2011                           | table | ubuntu
 raw_admin_bdys     | aus_ucl_2011_polygon                   | table | ubuntu
 raw_admin_bdys     | aus_ucl_2016                           | table | ubuntu
 raw_admin_bdys     | aus_ucl_2016_polygon                   | table | ubuntu
 raw_gnaf           | address_alias                          | table | ubuntu
 raw_gnaf           | address_alias_type_aut                 | table | ubuntu
 raw_gnaf           | address_change_type_aut                | table | ubuntu
 raw_gnaf           | address_default_geocode                | table | ubuntu
 raw_gnaf           | address_detail                         | table | ubuntu
 raw_gnaf           | address_feature                        | table | ubuntu
 raw_gnaf           | address_mesh_block_2011                | table | ubuntu
 raw_gnaf           | address_mesh_block_2016                | table | ubuntu
 raw_gnaf           | address_site                           | table | ubuntu
 raw_gnaf           | address_site_geocode                   | table | ubuntu
 raw_gnaf           | address_type_aut                       | table | ubuntu
 raw_gnaf           | flat_type_aut                          | table | ubuntu
 raw_gnaf           | geocode_reliability_aut                | table | ubuntu
 raw_gnaf           | geocode_type_aut                       | table | ubuntu
 raw_gnaf           | geocoded_level_type_aut                | table | ubuntu
 raw_gnaf           | level_type_aut                         | table | ubuntu
 raw_gnaf           | locality                               | table | ubuntu
 raw_gnaf           | locality_alias                         | table | ubuntu
 raw_gnaf           | locality_alias_type_aut                | table | ubuntu
 raw_gnaf           | locality_class_aut                     | table | ubuntu
 raw_gnaf           | locality_neighbour                     | table | ubuntu
 raw_gnaf           | locality_point                         | table | ubuntu
 raw_gnaf           | mb_2011                                | table | ubuntu
 raw_gnaf           | mb_2016                                | table | ubuntu
 raw_gnaf           | mb_match_code_aut                      | table | ubuntu
 raw_gnaf           | primary_secondary                      | table | ubuntu
 raw_gnaf           | ps_join_type_aut                       | table | ubuntu
 raw_gnaf           | state                                  | table | ubuntu
 raw_gnaf           | street_class_aut                       | table | ubuntu
 raw_gnaf           | street_locality                        | table | ubuntu
 raw_gnaf           | street_locality_alias                  | table | ubuntu
 raw_gnaf           | street_locality_alias_type_aut         | table | ubuntu
 raw_gnaf           | street_locality_point                  | table | ubuntu
 raw_gnaf           | street_suffix_aut                      | table | ubuntu
 raw_gnaf           | street_type_aut                        | table | ubuntu
(207 rows)
minus34 commented 2 years ago

GIven all the new tables are missing - can you please check you've got the latest code.

This file should have CREATE TABLE mb_2021 in it:

.../gnaf-loader/postgres-scripts/01-03-raw-gnaf-create-tables.sql

UnverifiedContact commented 2 years ago

Hi, thanks very much!

The nix utility I was using to automate the fetching of the latest version of gnaf-loader was failing to get the latest version.

I can confirm this doesn't occur when I run the correct code.

Thanks again. Could you please close this when you're able?

minus34 commented 2 years ago

No problem, good to hear it's working.