eureka-network / rs-eureka

Eureka sink
0 stars 0 forks source link

20230306 schemas tablenames and packages #71

Closed benjaminbollen closed 1 year ago

benjaminbollen commented 1 year ago

superceding #67 (because I had a bunch of messy commits locally on that branch; restarted from latest develop)

on the good side:

all tables and columns found: [TableMetadata { table_name: "eth_block_headers", column_name: "at", column_type: "text" }, TableMetadata { table_name: "eth_block_headers", column_name: "hash", column_type: "text" }, TableMetadata { table_name: "eth_block_headers", column_name: "id", column_type: "text" }, TableMetadata { table_name: "eth_block_headers", column_name: "number", column_type: "integer" }, TableMetadata { table_name: "eth_block_headers", column_name: "parent_hash", column_type: "text" }, TableMetadata { table_name: "eth_block_headers", column_name: "timestamp", column_type: "text" }]
all tables found: {"eth_block_headers"}

these tables are returned

but then we still error on the later query:

thread 'main' panicked at 'Failed to load tables: DieselError(DatabaseError(Unknown, "schema \"$1\" does not exist"))', bin/node/cli/src/main.rs:111:29

postgres-ssp  | 2023-03-06 14:33:58.427 UTC [105] ERROR:  schema "$1" does not exist at character 221
postgres-ssp  | 2023-03-06 14:33:58.427 UTC [105] STATEMENT:  
postgres-ssp  |                     SELECT a.attname as pk
postgres-ssp  |                     FROM   pg_index i
postgres-ssp  |                     JOIN   pg_attribute a ON a.attrelid = i.indrelid
postgres-ssp  |                                         AND a.attnum = ANY(i.indkey)
postgres-ssp  |                     WHERE  i.indrelid = '$1.$2'::regclass
postgres-ssp  |                     AND    i.indisprimary;
postgres-ssp  |    
benjaminbollen commented 1 year ago

@jorgeantonio21 we are now failing on flush: primary key "id" is not part of the insert operation

thread 'main' panicked at 'Failed to execute query: FailedToExecuteQuery { query: "INSERT INTO ethereummainnet.eth_blockheaders (hash,number,parent_hash,timestamp) VALUES ('dfe2e70d6c116a541101cecbb256d7402d62125f6ddc9b607d49edc989825c64',100,'db10afd3efa45327eb284c83cc925bd9bd7966aea53067c1eebe0724d124ec1e','2015-07-30T15:34:03Z')", error: "null value in column \"id\" of relation \"eth_blockheaders\" violates not-null constraint" }', eureka-sink-postgres/db/src/flush.rs:31:30