search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.83k stars 4.06k forks source link

Normalization: pipedrive connector failed when apply basic normalization #5440

Closed marcosmarxm closed 3 years ago

marcosmarxm commented 3 years ago
## Enviroment - **Airbyte version**: 0.29.7-alpha - **OS Version / Instance**: MacOS 11 - **Deployment**: docker - **Source Connector and version**: Pipedrive 0.1.2 - **Destination Connector and version**: Postgres 0.3.9 - **Severity**: Very Low / Low / Medium / **High** / Critical - **Step where error happened**: Sync job ## Current Behavior Try to run a pipedrive connector using Integration account, normalization failed. ``` 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - Database Error in model pipedrive_deals (models/generated/airbyte_tables/public/pipedrive_deals.sql) 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - invalid input syntax for type timestamp with time zone: "15:15:00" 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_tables/public/pipedrive_deals.sql 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - ``` Complete logs below ## Expected Behavior Sync should work without problem. ## Logs
LOG ``` 2021-08-16 18:43:25 INFO () WorkerRun(call):62 - Executing worker wrapper. Airbyte version: 0.29.7-alpha 2021-08-16 18:43:27 INFO () TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.29.7-alpha 2021-08-16 18:43:27 INFO () DefaultReplicationWorker(run):102 - start sync worker. job id: 6 attempt id: 2 2021-08-16 18:43:27 INFO () DefaultReplicationWorker(run):111 - configured sync modes: {null.stages=full_refresh - overwrite, null.activities=full_refresh - overwrite, null.deals=full_refresh - overwrite, null.activity_fields=full_refresh - overwrite, null.leads=full_refresh - overwrite, null.pipelines=full_refresh - overwrite, null.users=full_refresh - overwrite, null.persons=full_refresh - overwrite} 2021-08-16 18:43:27 INFO () DefaultAirbyteDestination(start):78 - Running destination... 2021-08-16 18:43:30 INFO () LineGobbler(voidCall):85 - Checking if airbyte/destination-postgres:0.3.9 exists... 2021-08-16 18:43:32 INFO () LineGobbler(voidCall):85 - airbyte/destination-postgres:0.3.9 was found locally. 2021-08-16 18:43:32 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/6/2 --network host --log-driver none airbyte/destination-postgres:0.3.9 write --config destination_config.json --catalog destination_catalog.json 2021-08-16 18:43:32 INFO () LineGobbler(voidCall):85 - Checking if airbyte/source-pipedrive:0.1.2 exists... 2021-08-16 18:43:33 INFO () LineGobbler(voidCall):85 - airbyte/source-pipedrive:0.1.2 was found locally. 2021-08-16 18:43:33 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/6/2 --network host --log-driver none airbyte/source-pipedrive:0.1.2 read --config source_config.json --catalog source_catalog.json --state input_state.json 2021-08-16 18:43:33 INFO () DefaultReplicationWorker(run):139 - Waiting for source thread to join. 2021-08-16 18:43:33 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):210 - Replication thread started. 2021-08-16 18:43:33 INFO () DefaultReplicationWorker(lambda$getDestinationOutputRunnable$3):246 - Destination output thread started. 2021-08-16 18:43:56 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Starting syncing SourcePipedrive 2021-08-16 18:43:56 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: activities 2021-08-16 18:43:56 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 3 records from activities stream 2021-08-16 18:43:56 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: activity_fields 2021-08-16 18:43:56 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 31 records from activity_fields stream 2021-08-16 18:43:56 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: deals 2021-08-16 18:43:57 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:57 INFO i.a.i.d.p.PostgresDestination(main):83 - {} - starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2021-08-16 18:43:58 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:58 INFO i.a.i.b.IntegrationRunner(run):96 - {} - Running integration: io.airbyte.integrations.destination.postgres.PostgresDestination 2021-08-16 18:43:58 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:58 INFO i.a.i.b.IntegrationCliParser(parseOptions):135 - {} - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2021-08-16 18:43:58 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:58 INFO i.a.i.b.IntegrationRunner(run):100 - {} - Command: WRITE 2021-08-16 18:43:58 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:58 INFO i.a.i.b.IntegrationRunner(run):101 - {} - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2021-08-16 18:43:58 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 10 records from deals stream 2021-08-16 18:43:58 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: leads 2021-08-16 18:43:58 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 2 records from leads stream 2021-08-16 18:43:58 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: persons 2021-08-16 18:43:58 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:58 WARN c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2021-08-16 18:43:58 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:58 WARN c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2021-08-16 18:43:58 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:58 WARN c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=pipedrive_activities, namespace=null, outputSchemaName=public, tmpTableName=_airbyte_tmp_yyc_pipedrive_activities, outputTableName=_airbyte_raw_pipedrive_activities, syncMode=overwrite} 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=pipedrive_activity_fields, namespace=null, outputSchemaName=public, tmpTableName=_airbyte_tmp_aoa_pipedrive_activity_fields, outputTableName=_airbyte_raw_pipedrive_activity_fields, syncMode=overwrite} 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=pipedrive_deals, namespace=null, outputSchemaName=public, tmpTableName=_airbyte_tmp_kfi_pipedrive_deals, outputTableName=_airbyte_raw_pipedrive_deals, syncMode=overwrite} 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=pipedrive_leads, namespace=null, outputSchemaName=public, tmpTableName=_airbyte_tmp_kaz_pipedrive_leads, outputTableName=_airbyte_raw_pipedrive_leads, syncMode=overwrite} 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=pipedrive_persons, namespace=null, outputSchemaName=public, tmpTableName=_airbyte_tmp_dhl_pipedrive_persons, outputTableName=_airbyte_raw_pipedrive_persons, syncMode=overwrite} 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=pipedrive_pipelines, namespace=null, outputSchemaName=public, tmpTableName=_airbyte_tmp_zpm_pipedrive_pipelines, outputTableName=_airbyte_raw_pipedrive_pipelines, syncMode=overwrite} 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=pipedrive_stages, namespace=null, outputSchemaName=public, tmpTableName=_airbyte_tmp_jmk_pipedrive_stages, outputTableName=_airbyte_raw_pipedrive_stages, syncMode=overwrite} 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=pipedrive_users, namespace=null, outputSchemaName=public, tmpTableName=_airbyte_tmp_uag_pipedrive_users, outputTableName=_airbyte_raw_pipedrive_users, syncMode=overwrite} 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:59 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):142 - {} - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):139 - {} - Preparing tmp tables in destination started for 8 streams 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream pipedrive_activities. schema: public, tmp table name: _airbyte_tmp_yyc_pipedrive_activities 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 3 records from persons stream 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: pipelines 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 1 records from pipelines stream 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: stages 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 5 records from stages stream 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: users 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 1 records from users stream 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Finished syncing SourcePipedrive 2021-08-16 18:43:59 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:43:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream pipedrive_activity_fields. schema: public, tmp table name: _airbyte_tmp_aoa_pipedrive_activity_fields 2021-08-16 18:44:00 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:00 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream pipedrive_deals. schema: public, tmp table name: _airbyte_tmp_kfi_pipedrive_deals 2021-08-16 18:44:01 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:01 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream pipedrive_leads. schema: public, tmp table name: _airbyte_tmp_kaz_pipedrive_leads 2021-08-16 18:44:02 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream pipedrive_persons. schema: public, tmp table name: _airbyte_tmp_dhl_pipedrive_persons 2021-08-16 18:44:02 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream pipedrive_pipelines. schema: public, tmp table name: _airbyte_tmp_zpm_pipedrive_pipelines 2021-08-16 18:44:02 INFO () DefaultReplicationWorker(run):141 - Source thread complete. 2021-08-16 18:44:02 INFO () DefaultReplicationWorker(run):142 - Waiting for destination thread to join. 2021-08-16 18:44:03 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:03 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream pipedrive_stages. schema: public, tmp table name: _airbyte_tmp_jmk_pipedrive_stages 2021-08-16 18:44:03 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:03 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream pipedrive_users. schema: public, tmp table name: _airbyte_tmp_uag_pipedrive_users 2021-08-16 18:44:04 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:04 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):149 - {} - Preparing tables in destination completed. 2021-08-16 18:44:04 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:04 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 - {} - Airbyte message consumer: succeeded. 2021-08-16 18:44:04 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:04 INFO i.a.i.d.b.BufferedStreamConsumer(close):212 - {} - executing on success close procedure. 2021-08-16 18:44:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:05 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):176 - {} - Finalizing tables in destination started for 8 streams 2021-08-16 18:44:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:05 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream pipedrive_activities. schema public, tmp table _airbyte_tmp_yyc_pipedrive_activities, final table _airbyte_raw_pipedrive_activities 2021-08-16 18:44:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:05 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream pipedrive_activity_fields. schema public, tmp table _airbyte_tmp_aoa_pipedrive_activity_fields, final table _airbyte_raw_pipedrive_activity_fields 2021-08-16 18:44:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:05 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream pipedrive_deals. schema public, tmp table _airbyte_tmp_kfi_pipedrive_deals, final table _airbyte_raw_pipedrive_deals 2021-08-16 18:44:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:05 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream pipedrive_leads. schema public, tmp table _airbyte_tmp_kaz_pipedrive_leads, final table _airbyte_raw_pipedrive_leads 2021-08-16 18:44:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:05 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream pipedrive_persons. schema public, tmp table _airbyte_tmp_dhl_pipedrive_persons, final table _airbyte_raw_pipedrive_persons 2021-08-16 18:44:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:05 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream pipedrive_pipelines. schema public, tmp table _airbyte_tmp_zpm_pipedrive_pipelines, final table _airbyte_raw_pipedrive_pipelines 2021-08-16 18:44:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:05 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream pipedrive_stages. schema public, tmp table _airbyte_tmp_jmk_pipedrive_stages, final table _airbyte_raw_pipedrive_stages 2021-08-16 18:44:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:05 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream pipedrive_users. schema public, tmp table _airbyte_tmp_uag_pipedrive_users, final table _airbyte_raw_pipedrive_users 2021-08-16 18:44:05 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:05 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):194 - {} - Executing finalization of tables. 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):196 - {} - Finalizing tables in destination completed. 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):199 - {} - Cleaning tmp tables in destination started for 8 streams 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream pipedrive_activities. schema public, tmp table name: _airbyte_tmp_yyc_pipedrive_activities 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream pipedrive_activity_fields. schema public, tmp table name: _airbyte_tmp_aoa_pipedrive_activity_fields 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream pipedrive_deals. schema public, tmp table name: _airbyte_tmp_kfi_pipedrive_deals 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream pipedrive_leads. schema public, tmp table name: _airbyte_tmp_kaz_pipedrive_leads 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream pipedrive_persons. schema public, tmp table name: _airbyte_tmp_dhl_pipedrive_persons 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream pipedrive_pipelines. schema public, tmp table name: _airbyte_tmp_zpm_pipedrive_pipelines 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream pipedrive_stages. schema public, tmp table name: _airbyte_tmp_jmk_pipedrive_stages 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream pipedrive_users. schema public, tmp table name: _airbyte_tmp_uag_pipedrive_users 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):208 - {} - Cleaning tmp tables in destination completed. 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.b.IntegrationRunner(run):153 - {} - Completed integration: io.airbyte.integrations.destination.postgres.PostgresDestination 2021-08-16 18:44:08 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-16 18:44:08 INFO i.a.i.d.p.PostgresDestination(main):85 - {} - completed destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2021-08-16 18:44:11 INFO () DefaultReplicationWorker(run):144 - Destination thread complete. 2021-08-16 18:44:11 INFO () DefaultReplicationWorker(run):172 - sync summary: io.airbyte.config.ReplicationAttemptSummary@4241b1e7[status=completed,recordsSynced=56,bytesSynced=37243,startTime=1629139407524,endTime=1629139451127] 2021-08-16 18:44:11 INFO () DefaultReplicationWorker(run):181 - Source did not output any state messages 2021-08-16 18:44:11 WARN () DefaultReplicationWorker(run):189 - State capture: No new state, falling back on input state: io.airbyte.config.State@52c5d2a8[state={}] 2021-08-16 18:44:11 INFO () TemporalAttemptExecution(get):133 - Stopping cancellation check scheduling... 2021-08-16 18:44:11 INFO () RetryingTemporalAttemptExecution(get):118 - Last output present: true. Should attempt again: false 2021-08-16 18:44:11 INFO () SyncWorkflow$ReplicationActivityImpl(replicate):203 - attempt summaries: [io.airbyte.config.ReplicationOutput@3146f103[replicationAttemptSummary=io.airbyte.config.ReplicationAttemptSummary@4241b1e7[status=completed,recordsSynced=56,bytesSynced=37243,startTime=1629139407524,endTime=1629139451127],state=io.airbyte.config.State@52c5d2a8[state={}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@5e381234[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@5785f02a[stream=io.airbyte.protocol.models.AirbyteStream@33d1b515[name=pipedrive_activities,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"done":{"type":["null","boolean"]},"file":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"url":{"type":["null","string"]},"clean_name":{"type":["null","string"]}}},"note":{"type":["null","string"]},"type":{"type":["null","string"]},"org_id":{"type":["null","integer"]},"series":{"type":["null","string"]},"deal_id":{"type":["null","integer"]},"lead_id":{"type":["null","integer"]},"subject":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"add_time":{"type":["null","string"]},"due_date":{"type":["null","string"]},"due_time":{"type":["null","string"]},"duration":{"type":["null","string"]},"location":{"type":["null","string"]},"org_name":{"type":["null","string"]},"rec_rule":{"type":["null","string"]},"attendees":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"name":{"type":["null","string"]},"status":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"person_id":{"type":["null","integer"]},"is_organizer":{"type":["null","integer"]},"email_address":{"type":["null","string"]}}}},"busy_flag":{"type":["null","boolean"]},"person_id":{"type":["null","integer"]},"company_id":{"type":["null","integer"]},"deal_title":{"type":["null","string"]},"owner_name":{"type":["null","string"]},"active_flag":{"type":["null","boolean"]},"person_name":{"type":["null","string"]},"update_time":{"type":["null","string"]},"location_lat":{"type":["null","number"]},"participants":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"person_id":{"type":["null","integer"]},"primary_flag":{"type":["null","boolean"]}}}},"reference_id":{"type":["null","integer"]},"gcal_event_id":{"type":["null","string"]},"location_long":{"type":["null","number"]},"location_route":{"type":["null","string"]},"reference_type":{"type":["null","string"]},"update_user_id":{"type":["null","integer"]},"source_timezone":{"type":["null","string"]},"deal_dropbox_bcc":{"type":["null","string"]},"location_country":{"type":["null","string"]},"location_locality":{"type":["null","string"]},"created_by_user_id":{"type":["null","integer"]},"google_calendar_id":{"type":["null","string"]},"person_dropbox_bcc":{"type":["null","string"]},"public_description":{"type":["null","string"]},"rec_rule_extension":{"type":["null","string"]},"assigned_to_user_id":{"type":["null","integer"]},"location_subpremise":{"type":["null","string"]},"marked_as_done_time":{"type":["null","string"]},"google_calendar_etag":{"type":["null","string"]},"location_postal_code":{"type":["null","string"]},"location_sublocality":{"type":["null","string"]},"conference_meeting_id":{"type":["null","string"]},"conference_meeting_url":{"type":["null","string"]},"last_notification_time":{"type":["null","string"]},"location_street_number":{"type":["null","string"]},"rec_master_activity_id":{"type":["null","integer"]},"notification_language_id":{"type":["null","integer"]},"conference_meeting_client":{"type":["null","string"]},"last_notification_user_id":{"type":["null","integer"]},"location_formatted_address":{"type":["null","string"]},"location_admin_area_level_1":{"type":["null","string"]},"location_admin_area_level_2":{"type":["null","string"]},"calendar_sync_include_context":{"type":["null","boolean"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[update_time],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[update_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@35199485[stream=io.airbyte.protocol.models.AirbyteStream@2b2e89a0[name=pipedrive_activity_fields,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"key":{"type":["null","string"]},"name":{"type":["null","string"]},"options":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"id":{"type":["null","integer","string","boolean"]},"label":{"type":["null","string"]}}}},"add_time":{"type":["null","string"],"format":"date-time"},"order_nr":{"type":["null","integer"]},"edit_flag":{"type":["null","boolean"]},"field_type":{"type":["null","string"]},"active_flag":{"type":["null","boolean"]},"update_time":{"type":["null","string"],"format":"date-time"},"sortable_flag":{"type":["null","boolean"]},"important_flag":{"type":["null","boolean"]},"mandatory_flag":{"type":["null","boolean"]},"searchable_flag":{"type":["null","boolean"]},"add_visible_flag":{"type":["null","boolean"]},"bulk_edit_allowed":{"type":["null","boolean"]},"filtering_allowed":{"type":["null","boolean"]},"index_visible_flag":{"type":["null","boolean"]},"details_visible_flag":{"type":["null","boolean"]},"last_updated_by_user_id":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5352384f[stream=io.airbyte.protocol.models.AirbyteStream@6d95462d[name=pipedrive_deals,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"label":{"type":["null","string"]},"title":{"type":["null","string"]},"value":{"type":["null","number"]},"active":{"type":["null","boolean"]},"org_id":{"type":["null","integer"]},"status":{"type":["null","string"]},"deleted":{"type":["null","boolean"]},"user_id":{"type":["null","integer"]},"add_time":{"type":["null","string"],"format":"date-time"},"cc_email":{"type":["null","string"]},"currency":{"type":["null","string"]},"org_name":{"type":["null","string"]},"stage_id":{"type":["null","integer"]},"won_time":{"type":["null","string"],"format":"date-time"},"lost_time":{"type":["null","string"],"format":"date-time"},"person_id":{"type":["null","integer"]},"close_time":{"type":["null","string"],"format":"date-time"},"org_hidden":{"type":["null","boolean"]},"owner_name":{"type":["null","string"]},"visible_to":{"type":["null","string"]},"files_count":{"type":["null","integer"]},"lost_reason":{"type":["null","string"]},"notes_count":{"type":["null","integer"]},"person_name":{"type":["null","string"]},"pipeline_id":{"type":["null","integer"]},"probability":{"type":["null","number"]},"rotten_time":{"type":["null","string"],"format":"date-time"},"update_time":{"type":["null","string"],"format":"date-time"},"person_hidden":{"type":["null","boolean"]},"first_won_time":{"type":["null","string"],"format":"date-time"},"products_count":{"type":["null","integer"]},"stage_order_nr":{"type":["null","integer"]},"weighted_value":{"type":["null","number"]},"creator_user_id":{"type":["null","integer"]},"followers_count":{"type":["null","integer"]},"formatted_value":{"type":["null","string"]},"activities_count":{"type":["null","integer"]},"last_activity_id":{"type":["null","integer"]},"next_activity_id":{"type":["null","integer"]},"stage_change_time":{"type":["null","string"],"format":"date-time"},"last_activity_date":{"type":["null","string"],"format":"date-time"},"next_activity_date":{"type":["null","string"],"format":"date-time"},"next_activity_note":{"type":["null","string"]},"next_activity_time":{"type":["null","string"],"format":"date-time"},"next_activity_type":{"type":["null","string"]},"participants_count":{"type":["null","integer"]},"expected_close_date":{"type":["null","string"],"format":"date-time"},"email_messages_count":{"type":["null","integer"]},"done_activities_count":{"type":["null","integer"]},"next_activity_subject":{"type":["null","string"]},"next_activity_duration":{"type":["null","string"],"format":"date-time"},"last_incoming_mail_time":{"type":["null","string"],"format":"date-time"},"last_outgoing_mail_time":{"type":["null","string"],"format":"date-time"},"undone_activities_count":{"type":["null","integer"]},"weighted_value_currency":{"type":["null","string"]},"formatted_weighted_value":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[update_time],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[update_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@14d14aa6[stream=io.airbyte.protocol.models.AirbyteStream@4b6db215[name=pipedrive_leads,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","string"]},"title":{"type":["null","string"]},"value":{"type":["null","object"],"properties":{"amount":{"type":["null","integer"]},"currency":{"type":["null","string"]}}},"add_time":{"type":["null","string"],"format":"date-time"},"owner_id":{"type":["null","integer"]},"was_seen":{"type":["null","boolean"]},"label_ids":{"type":["null","array"]},"person_id":{"type":["null","integer"]},"creator_id":{"type":["null","integer"]},"is_archived":{"type":["null","boolean"]},"source_name":{"type":["null","string"]},"update_time":{"type":["null","string"],"format":"date-time"},"organization_id":{"type":["null","integer"]},"next_activity_id":{"type":["null","integer"]},"expected_close_date":{"type":["null","string"],"format":"date-time"}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@9bf6b77[stream=io.airbyte.protocol.models.AirbyteStream@4edce043[name=pipedrive_persons,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"name":{"type":["null","string"]},"email":{"type":["null","array"]},"label":{"type":["null","integer"]},"phone":{"type":["null","array"]},"org_id":{"type":["null","integer"]},"add_time":{"type":["null","string"],"format":"date-time"},"cc_email":{"type":["null","string"]},"org_name":{"type":["null","string"]},"owner_id":{"type":["null","integer"]},"last_name":{"type":["null","string"]},"company_id":{"type":["null","integer"]},"first_char":{"type":["null","string"]},"first_name":{"type":["null","string"]},"owner_name":{"type":["null","string"]},"picture_id":{"type":["null","object"],"properties":{"value":{"type":["null","integer"]},"item_id":{"type":["null","integer"]},"add_time":{"type":["null","string"],"format":"date-time"},"pictures":{"type":["null","object"],"properties":{"128":{"type":["null","string"]},"512":{"type":["null","string"]}}},"item_type":{"type":["null","string"]},"active_flag":{"type":["null","boolean"]},"update_time":{"type":["null","string"]},"added_by_user_id":{"type":["null","integer"]}}},"visible_to":{"type":["null","string"]},"active_flag":{"type":["null","boolean"]},"files_count":{"type":["null","integer"]},"notes_count":{"type":["null","integer"]},"update_time":{"type":["null","string"],"format":"date-time"},"followers_count":{"type":["null","integer"]},"won_deals_count":{"type":["null","integer"]},"activities_count":{"type":["null","integer"]},"last_activity_id":{"type":["null","integer"]},"lost_deals_count":{"type":["null","integer"]},"next_activity_id":{"type":["null","integer"]},"open_deals_count":{"type":["null","integer"]},"closed_deals_count":{"type":["null","integer"]},"last_activity_date":{"type":["null","string"],"format":"date-time"},"next_activity_date":{"type":["null","string"],"format":"date-time"},"next_activity_time":{"type":["null","string"],"format":"date-time"},"email_messages_count":{"type":["null","integer"]},"done_activities_count":{"type":["null","integer"]},"last_incoming_mail_time":{"type":["null","string"],"format":"date-time"},"last_outgoing_mail_time":{"type":["null","string"],"format":"date-time"},"related_won_deals_count":{"type":["null","integer"]},"undone_activities_count":{"type":["null","integer"]},"related_lost_deals_count":{"type":["null","integer"]},"related_open_deals_count":{"type":["null","integer"]},"related_closed_deals_count":{"type":["null","integer"]},"participant_open_deals_count":{"type":["null","integer"]},"participant_closed_deals_count":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[update_time],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[update_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@50460744[stream=io.airbyte.protocol.models.AirbyteStream@769dfa43[name=pipedrive_pipelines,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"name":{"type":["null","string"]},"active":{"type":["null","boolean"]},"add_time":{"type":["null","string"],"format":"date-time"},"order_nr":{"type":["null","integer"]},"selected":{"type":["null","boolean"]},"url_title":{"type":["null","string"]},"update_time":{"type":["null","string"],"format":"date-time"},"deal_probability":{"type":["null","boolean"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[update_time],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[update_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@48bd334[stream=io.airbyte.protocol.models.AirbyteStream@2d7cf51e[name=pipedrive_stages,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"name":{"type":["null","string"]},"add_time":{"type":["null","string"],"format":"date-time"},"order_nr":{"type":["null","integer"]},"active_flag":{"type":["null","boolean"]},"pipeline_id":{"type":["null","integer"]},"rotten_days":{"type":["null","integer"]},"rotten_flag":{"type":["null","boolean"]},"update_time":{"type":["null","string"],"format":"date-time"},"pipeline_name":{"type":["null","string"]},"deal_probability":{"type":["null","integer"]},"pipeline_deal_probability":{"type":["null","boolean"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[update_time],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[update_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4de0abd2[stream=io.airbyte.protocol.models.AirbyteStream@54b61fcf[name=pipedrive_users,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"lang":{"type":["null","integer"]},"name":{"type":["null","string"]},"email":{"type":["null","string"]},"phone":{"type":["null","string"]},"is_you":{"type":["null","boolean"]},"locale":{"type":["null","string"]},"created":{"type":["null","string"],"format":"date-time"},"role_id":{"type":["null","integer"]},"icon_url":{"type":["null","string"]},"is_admin":{"type":["null","integer"]},"modified":{"type":["null","string"],"format":"date-time"},"activated":{"type":["null","boolean"]},"last_login":{"type":["null","string"],"format":"date-time"},"active_flag":{"type":["null","boolean"]},"timezone_name":{"type":["null","string"]},"timezone_offset":{"type":["null","string"]},"default_currency":{"type":["null","string"]},"has_created_company":{"type":["null","boolean"]},"signup_flow_variation":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[modified],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[modified],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}]]] 2021-08-16 18:44:11 INFO () SyncWorkflow$ReplicationActivityImpl(replicate):204 - sync summary: io.airbyte.config.StandardSyncOutput@c9629af[standardSyncSummary=io.airbyte.config.StandardSyncSummary@68ba1795[status=completed,recordsSynced=56,bytesSynced=37243,startTime=1629139407524,endTime=1629139451127],state=io.airbyte.config.State@52c5d2a8[state={}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@5e381234[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@5785f02a[stream=io.airbyte.protocol.models.AirbyteStream@33d1b515[name=pipedrive_activities,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"done":{"type":["null","boolean"]},"file":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"url":{"type":["null","string"]},"clean_name":{"type":["null","string"]}}},"note":{"type":["null","string"]},"type":{"type":["null","string"]},"org_id":{"type":["null","integer"]},"series":{"type":["null","string"]},"deal_id":{"type":["null","integer"]},"lead_id":{"type":["null","integer"]},"subject":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"add_time":{"type":["null","string"]},"due_date":{"type":["null","string"]},"due_time":{"type":["null","string"]},"duration":{"type":["null","string"]},"location":{"type":["null","string"]},"org_name":{"type":["null","string"]},"rec_rule":{"type":["null","string"]},"attendees":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"name":{"type":["null","string"]},"status":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"person_id":{"type":["null","integer"]},"is_organizer":{"type":["null","integer"]},"email_address":{"type":["null","string"]}}}},"busy_flag":{"type":["null","boolean"]},"person_id":{"type":["null","integer"]},"company_id":{"type":["null","integer"]},"deal_title":{"type":["null","string"]},"owner_name":{"type":["null","string"]},"active_flag":{"type":["null","boolean"]},"person_name":{"type":["null","string"]},"update_time":{"type":["null","string"]},"location_lat":{"type":["null","number"]},"participants":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"person_id":{"type":["null","integer"]},"primary_flag":{"type":["null","boolean"]}}}},"reference_id":{"type":["null","integer"]},"gcal_event_id":{"type":["null","string"]},"location_long":{"type":["null","number"]},"location_route":{"type":["null","string"]},"reference_type":{"type":["null","string"]},"update_user_id":{"type":["null","integer"]},"source_timezone":{"type":["null","string"]},"deal_dropbox_bcc":{"type":["null","string"]},"location_country":{"type":["null","string"]},"location_locality":{"type":["null","string"]},"created_by_user_id":{"type":["null","integer"]},"google_calendar_id":{"type":["null","string"]},"person_dropbox_bcc":{"type":["null","string"]},"public_description":{"type":["null","string"]},"rec_rule_extension":{"type":["null","string"]},"assigned_to_user_id":{"type":["null","integer"]},"location_subpremise":{"type":["null","string"]},"marked_as_done_time":{"type":["null","string"]},"google_calendar_etag":{"type":["null","string"]},"location_postal_code":{"type":["null","string"]},"location_sublocality":{"type":["null","string"]},"conference_meeting_id":{"type":["null","string"]},"conference_meeting_url":{"type":["null","string"]},"last_notification_time":{"type":["null","string"]},"location_street_number":{"type":["null","string"]},"rec_master_activity_id":{"type":["null","integer"]},"notification_language_id":{"type":["null","integer"]},"conference_meeting_client":{"type":["null","string"]},"last_notification_user_id":{"type":["null","integer"]},"location_formatted_address":{"type":["null","string"]},"location_admin_area_level_1":{"type":["null","string"]},"location_admin_area_level_2":{"type":["null","string"]},"calendar_sync_include_context":{"type":["null","boolean"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[update_time],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[update_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@35199485[stream=io.airbyte.protocol.models.AirbyteStream@2b2e89a0[name=pipedrive_activity_fields,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"key":{"type":["null","string"]},"name":{"type":["null","string"]},"options":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"id":{"type":["null","integer","string","boolean"]},"label":{"type":["null","string"]}}}},"add_time":{"type":["null","string"],"format":"date-time"},"order_nr":{"type":["null","integer"]},"edit_flag":{"type":["null","boolean"]},"field_type":{"type":["null","string"]},"active_flag":{"type":["null","boolean"]},"update_time":{"type":["null","string"],"format":"date-time"},"sortable_flag":{"type":["null","boolean"]},"important_flag":{"type":["null","boolean"]},"mandatory_flag":{"type":["null","boolean"]},"searchable_flag":{"type":["null","boolean"]},"add_visible_flag":{"type":["null","boolean"]},"bulk_edit_allowed":{"type":["null","boolean"]},"filtering_allowed":{"type":["null","boolean"]},"index_visible_flag":{"type":["null","boolean"]},"details_visible_flag":{"type":["null","boolean"]},"last_updated_by_user_id":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5352384f[stream=io.airbyte.protocol.models.AirbyteStream@6d95462d[name=pipedrive_deals,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"label":{"type":["null","string"]},"title":{"type":["null","string"]},"value":{"type":["null","number"]},"active":{"type":["null","boolean"]},"org_id":{"type":["null","integer"]},"status":{"type":["null","string"]},"deleted":{"type":["null","boolean"]},"user_id":{"type":["null","integer"]},"add_time":{"type":["null","string"],"format":"date-time"},"cc_email":{"type":["null","string"]},"currency":{"type":["null","string"]},"org_name":{"type":["null","string"]},"stage_id":{"type":["null","integer"]},"won_time":{"type":["null","string"],"format":"date-time"},"lost_time":{"type":["null","string"],"format":"date-time"},"person_id":{"type":["null","integer"]},"close_time":{"type":["null","string"],"format":"date-time"},"org_hidden":{"type":["null","boolean"]},"owner_name":{"type":["null","string"]},"visible_to":{"type":["null","string"]},"files_count":{"type":["null","integer"]},"lost_reason":{"type":["null","string"]},"notes_count":{"type":["null","integer"]},"person_name":{"type":["null","string"]},"pipeline_id":{"type":["null","integer"]},"probability":{"type":["null","number"]},"rotten_time":{"type":["null","string"],"format":"date-time"},"update_time":{"type":["null","string"],"format":"date-time"},"person_hidden":{"type":["null","boolean"]},"first_won_time":{"type":["null","string"],"format":"date-time"},"products_count":{"type":["null","integer"]},"stage_order_nr":{"type":["null","integer"]},"weighted_value":{"type":["null","number"]},"creator_user_id":{"type":["null","integer"]},"followers_count":{"type":["null","integer"]},"formatted_value":{"type":["null","string"]},"activities_count":{"type":["null","integer"]},"last_activity_id":{"type":["null","integer"]},"next_activity_id":{"type":["null","integer"]},"stage_change_time":{"type":["null","string"],"format":"date-time"},"last_activity_date":{"type":["null","string"],"format":"date-time"},"next_activity_date":{"type":["null","string"],"format":"date-time"},"next_activity_note":{"type":["null","string"]},"next_activity_time":{"type":["null","string"],"format":"date-time"},"next_activity_type":{"type":["null","string"]},"participants_count":{"type":["null","integer"]},"expected_close_date":{"type":["null","string"],"format":"date-time"},"email_messages_count":{"type":["null","integer"]},"done_activities_count":{"type":["null","integer"]},"next_activity_subject":{"type":["null","string"]},"next_activity_duration":{"type":["null","string"],"format":"date-time"},"last_incoming_mail_time":{"type":["null","string"],"format":"date-time"},"last_outgoing_mail_time":{"type":["null","string"],"format":"date-time"},"undone_activities_count":{"type":["null","integer"]},"weighted_value_currency":{"type":["null","string"]},"formatted_weighted_value":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[update_time],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[update_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@14d14aa6[stream=io.airbyte.protocol.models.AirbyteStream@4b6db215[name=pipedrive_leads,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","string"]},"title":{"type":["null","string"]},"value":{"type":["null","object"],"properties":{"amount":{"type":["null","integer"]},"currency":{"type":["null","string"]}}},"add_time":{"type":["null","string"],"format":"date-time"},"owner_id":{"type":["null","integer"]},"was_seen":{"type":["null","boolean"]},"label_ids":{"type":["null","array"]},"person_id":{"type":["null","integer"]},"creator_id":{"type":["null","integer"]},"is_archived":{"type":["null","boolean"]},"source_name":{"type":["null","string"]},"update_time":{"type":["null","string"],"format":"date-time"},"organization_id":{"type":["null","integer"]},"next_activity_id":{"type":["null","integer"]},"expected_close_date":{"type":["null","string"],"format":"date-time"}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@9bf6b77[stream=io.airbyte.protocol.models.AirbyteStream@4edce043[name=pipedrive_persons,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"name":{"type":["null","string"]},"email":{"type":["null","array"]},"label":{"type":["null","integer"]},"phone":{"type":["null","array"]},"org_id":{"type":["null","integer"]},"add_time":{"type":["null","string"],"format":"date-time"},"cc_email":{"type":["null","string"]},"org_name":{"type":["null","string"]},"owner_id":{"type":["null","integer"]},"last_name":{"type":["null","string"]},"company_id":{"type":["null","integer"]},"first_char":{"type":["null","string"]},"first_name":{"type":["null","string"]},"owner_name":{"type":["null","string"]},"picture_id":{"type":["null","object"],"properties":{"value":{"type":["null","integer"]},"item_id":{"type":["null","integer"]},"add_time":{"type":["null","string"],"format":"date-time"},"pictures":{"type":["null","object"],"properties":{"128":{"type":["null","string"]},"512":{"type":["null","string"]}}},"item_type":{"type":["null","string"]},"active_flag":{"type":["null","boolean"]},"update_time":{"type":["null","string"]},"added_by_user_id":{"type":["null","integer"]}}},"visible_to":{"type":["null","string"]},"active_flag":{"type":["null","boolean"]},"files_count":{"type":["null","integer"]},"notes_count":{"type":["null","integer"]},"update_time":{"type":["null","string"],"format":"date-time"},"followers_count":{"type":["null","integer"]},"won_deals_count":{"type":["null","integer"]},"activities_count":{"type":["null","integer"]},"last_activity_id":{"type":["null","integer"]},"lost_deals_count":{"type":["null","integer"]},"next_activity_id":{"type":["null","integer"]},"open_deals_count":{"type":["null","integer"]},"closed_deals_count":{"type":["null","integer"]},"last_activity_date":{"type":["null","string"],"format":"date-time"},"next_activity_date":{"type":["null","string"],"format":"date-time"},"next_activity_time":{"type":["null","string"],"format":"date-time"},"email_messages_count":{"type":["null","integer"]},"done_activities_count":{"type":["null","integer"]},"last_incoming_mail_time":{"type":["null","string"],"format":"date-time"},"last_outgoing_mail_time":{"type":["null","string"],"format":"date-time"},"related_won_deals_count":{"type":["null","integer"]},"undone_activities_count":{"type":["null","integer"]},"related_lost_deals_count":{"type":["null","integer"]},"related_open_deals_count":{"type":["null","integer"]},"related_closed_deals_count":{"type":["null","integer"]},"participant_open_deals_count":{"type":["null","integer"]},"participant_closed_deals_count":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[update_time],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[update_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@50460744[stream=io.airbyte.protocol.models.AirbyteStream@769dfa43[name=pipedrive_pipelines,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"name":{"type":["null","string"]},"active":{"type":["null","boolean"]},"add_time":{"type":["null","string"],"format":"date-time"},"order_nr":{"type":["null","integer"]},"selected":{"type":["null","boolean"]},"url_title":{"type":["null","string"]},"update_time":{"type":["null","string"],"format":"date-time"},"deal_probability":{"type":["null","boolean"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[update_time],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[update_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@48bd334[stream=io.airbyte.protocol.models.AirbyteStream@2d7cf51e[name=pipedrive_stages,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"name":{"type":["null","string"]},"add_time":{"type":["null","string"],"format":"date-time"},"order_nr":{"type":["null","integer"]},"active_flag":{"type":["null","boolean"]},"pipeline_id":{"type":["null","integer"]},"rotten_days":{"type":["null","integer"]},"rotten_flag":{"type":["null","boolean"]},"update_time":{"type":["null","string"],"format":"date-time"},"pipeline_name":{"type":["null","string"]},"deal_probability":{"type":["null","integer"]},"pipeline_deal_probability":{"type":["null","boolean"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[update_time],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[update_time],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4de0abd2[stream=io.airbyte.protocol.models.AirbyteStream@54b61fcf[name=pipedrive_users,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"lang":{"type":["null","integer"]},"name":{"type":["null","string"]},"email":{"type":["null","string"]},"phone":{"type":["null","string"]},"is_you":{"type":["null","boolean"]},"locale":{"type":["null","string"]},"created":{"type":["null","string"],"format":"date-time"},"role_id":{"type":["null","integer"]},"icon_url":{"type":["null","string"]},"is_admin":{"type":["null","integer"]},"modified":{"type":["null","string"],"format":"date-time"},"activated":{"type":["null","boolean"]},"last_login":{"type":["null","string"],"format":"date-time"},"active_flag":{"type":["null","boolean"]},"timezone_name":{"type":["null","string"]},"timezone_offset":{"type":["null","string"]},"default_currency":{"type":["null","string"]},"has_created_company":{"type":["null","boolean"]},"signup_flow_variation":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[modified],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[modified],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}]] 2021-08-16 18:44:11 INFO () TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.29.7-alpha 2021-08-16 18:44:11 INFO () DefaultNormalizationWorker(run):61 - Running normalization. 2021-08-16 18:44:11 INFO () LineGobbler(voidCall):85 - Checking if airbyte/normalization:0.1.39 exists... 2021-08-16 18:44:12 INFO () LineGobbler(voidCall):85 - airbyte/normalization:0.1.39 was found locally. 2021-08-16 18:44:12 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/6/2/normalize --network host --log-driver none airbyte/normalization:0.1.39 run --integration-type postgres --config destination_config.json --catalog destination_catalog.json 2021-08-16 18:44:16 INFO () LineGobbler(voidCall):85 - Running: transform-config --config destination_config.json --integration-type postgres --out /data/6/2/normalize 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Namespace(config='destination_config.json', integration_type=, out='/data/6/2/normalize') 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - transform_postgres 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Running: transform-catalog --integration-type postgres --profile-config-dir /data/6/2/normalize --catalog destination_catalog.json --out /data/6/2/normalize/models/generated/ --json-column _airbyte_data 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Processing destination_catalog.json... 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activities_ab1.sql from pipedrive_activities 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activities_ab2.sql from pipedrive_activities 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activities_ab3.sql from pipedrive_activities 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_activities.sql from pipedrive_activities 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activity_fields_ab1.sql from pipedrive_activity_fields 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activity_fields_ab2.sql from pipedrive_activity_fields 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activity_fields_ab3.sql from pipedrive_activity_fields 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_activity_fields.sql from pipedrive_activity_fields 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_deals_ab1.sql from pipedrive_deals 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_deals_ab2.sql from pipedrive_deals 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_deals_ab3.sql from pipedrive_deals 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_deals.sql from pipedrive_deals 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_leads_ab1.sql from pipedrive_leads 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_leads_ab2.sql from pipedrive_leads 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_leads_ab3.sql from pipedrive_leads 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_leads.sql from pipedrive_leads 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_persons_ab1.sql from pipedrive_persons 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_persons_ab2.sql from pipedrive_persons 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_persons_ab3.sql from pipedrive_persons 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_persons.sql from pipedrive_persons 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_pipelines_ab1.sql from pipedrive_pipelines 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_pipelines_ab2.sql from pipedrive_pipelines 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_pipelines_ab3.sql from pipedrive_pipelines 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_pipelines.sql from pipedrive_pipelines 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_stages_ab1.sql from pipedrive_stages 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_stages_ab2.sql from pipedrive_stages 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_stages_ab3.sql from pipedrive_stages 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_stages.sql from pipedrive_stages 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_users_ab1.sql from pipedrive_users 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_users_ab2.sql from pipedrive_users 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_users_ab3.sql from pipedrive_users 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_users.sql from pipedrive_users 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activities_file_ab1.sql from pipedrive_activities/file 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activities_file_ab2.sql from pipedrive_activities/file 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activities_file_ab3.sql from pipedrive_activities/file 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_activities_file.sql from pipedrive_activities/file 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activities_attendees_ab1.sql from pipedrive_activities/attendees 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activities_attendees_ab2.sql from pipedrive_activities/attendees 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activities_attendees_ab3.sql from pipedrive_activities/attendees 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_activities_attendees.sql from pipedrive_activities/attendees 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activities_participants_ab1.sql from pipedrive_activities/participants 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activities_participants_ab2.sql from pipedrive_activities/participants 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activities_participants_ab3.sql from pipedrive_activities/participants 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_activities_participants.sql from pipedrive_activities/participants 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activity_fields_options_ab1.sql from pipedrive_activity_fields/options 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activity_fields_options_ab2.sql from pipedrive_activity_fields/options 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_activity_fields_options_ab3.sql from pipedrive_activity_fields/options 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_activity_fields_options.sql from pipedrive_activity_fields/options 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_leads_value_ab1.sql from pipedrive_leads/value 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_leads_value_ab2.sql from pipedrive_leads/value 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_leads_value_ab3.sql from pipedrive_leads/value 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_leads_value.sql from pipedrive_leads/value 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_persons_picture_id_ab1.sql from pipedrive_persons/picture_id 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_persons_picture_id_ab2.sql from pipedrive_persons/picture_id 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_persons_picture_id_ab3.sql from pipedrive_persons/picture_id 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_persons_picture_id.sql from pipedrive_persons/picture_id 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_persons_picture_id_pictures_ab1.sql from pipedrive_persons/picture_id/pictures 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_persons_picture_id_pictures_ab2.sql from pipedrive_persons/picture_id/pictures 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/public/pipedrive_persons_picture_id_pictures_ab3.sql from pipedrive_persons/picture_id/pictures 2021-08-16 18:44:18 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/public/pipedrive_persons_picture_id_pictures.sql from pipedrive_persons/picture_id/pictures 2021-08-16 18:44:23 INFO () LineGobbler(voidCall):85 - Running with dbt=0.19.0 2021-08-16 18:44:26 INFO () LineGobbler(voidCall):85 - [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2021-08-16 18:44:26 INFO () LineGobbler(voidCall):85 - There are 1 unused configuration paths: 2021-08-16 18:44:26 INFO () LineGobbler(voidCall):85 - - models.airbyte_utils.generated.airbyte_views 2021-08-16 18:44:26 INFO () LineGobbler(voidCall):85 - 2021-08-16 18:44:27 INFO () LineGobbler(voidCall):85 - Found 60 models, 0 tests, 0 snapshots, 0 analyses, 387 macros, 0 operations, 0 seed files, 8 sources, 0 exposures 2021-08-16 18:44:27 INFO () LineGobbler(voidCall):85 - 2021-08-16 18:44:29 INFO () LineGobbler(voidCall):85 - 18:44:29 | Concurrency: 32 threads (target='prod') 2021-08-16 18:44:29 INFO () LineGobbler(voidCall):85 - 18:44:29 | 2021-08-16 18:44:30 INFO () LineGobbler(voidCall):85 - 18:44:30 | 1 of 15 START table model public.pipedrive_stages............................................................ [RUN] 2021-08-16 18:44:30 INFO () LineGobbler(voidCall):85 - 18:44:30 | 2 of 15 START table model public.pipedrive_activities........................................................ [RUN] 2021-08-16 18:44:30 INFO () LineGobbler(voidCall):85 - 18:44:30 | 3 of 15 START table model public.pipedrive_pipelines......................................................... [RUN] 2021-08-16 18:44:30 INFO () LineGobbler(voidCall):85 - 18:44:30 | 4 of 15 START table model public.pipedrive_persons........................................................... [RUN] 2021-08-16 18:44:30 INFO () LineGobbler(voidCall):85 - 18:44:30 | 5 of 15 START table model public.pipedrive_activity_fields................................................... [RUN] 2021-08-16 18:44:30 INFO () LineGobbler(voidCall):85 - 18:44:30 | 6 of 15 START table model public.pipedrive_leads............................................................. [RUN] 2021-08-16 18:44:30 INFO () LineGobbler(voidCall):85 - 18:44:30 | 7 of 15 START table model public.pipedrive_deals............................................................. [RUN] 2021-08-16 18:44:30 INFO () LineGobbler(voidCall):85 - 18:44:30 | 8 of 15 START table model public.pipedrive_users............................................................. [RUN] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 7 of 15 ERROR creating table model public.pipedrive_deals.................................................... [ERROR in 0.70s] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 1 of 15 OK created table model public.pipedrive_stages....................................................... [SELECT 5 in 0.79s] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 3 of 15 OK created table model public.pipedrive_pipelines.................................................... [SELECT 1 in 0.92s] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 5 of 15 OK created table model public.pipedrive_activity_fields.............................................. [SELECT 31 in 1.03s] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 2 of 15 OK created table model public.pipedrive_activities................................................... [SELECT 3 in 1.04s] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 4 of 15 OK created table model public.pipedrive_persons...................................................... [SELECT 3 in 1.04s] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 8 of 15 OK created table model public.pipedrive_users........................................................ [SELECT 1 in 1.00s] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 6 of 15 OK created table model public.pipedrive_leads........................................................ [SELECT 2 in 1.05s] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 9 of 15 START table model public.pipedrive_activities_file................................................... [RUN] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 10 of 15 START table model public.pipedrive_persons_picture_id............................................... [RUN] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 11 of 15 START table model public.pipedrive_activities_attendees............................................. [RUN] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 12 of 15 START table model public.pipedrive_activities_participants.......................................... [RUN] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 13 of 15 START table model public.pipedrive_activity_fields_options.......................................... [RUN] 2021-08-16 18:44:31 INFO () LineGobbler(voidCall):85 - 18:44:31 | 14 of 15 START table model public.pipedrive_leads_value...................................................... [RUN] 2021-08-16 18:44:32 INFO () LineGobbler(voidCall):85 - 18:44:32 | 9 of 15 OK created table model public.pipedrive_activities_file.............................................. [SELECT 0 in 0.62s] 2021-08-16 18:44:32 INFO () LineGobbler(voidCall):85 - 18:44:32 | 14 of 15 OK created table model public.pipedrive_leads_value................................................. [SELECT 2 in 0.70s] 2021-08-16 18:44:32 INFO () LineGobbler(voidCall):85 - 18:44:32 | 11 of 15 OK created table model public.pipedrive_activities_attendees........................................ [SELECT 0 in 0.76s] 2021-08-16 18:44:32 INFO () LineGobbler(voidCall):85 - 18:44:32 | 13 of 15 OK created table model public.pipedrive_activity_fields_options..................................... [SELECT 10 in 0.80s] 2021-08-16 18:44:32 INFO () LineGobbler(voidCall):85 - 18:44:32 | 10 of 15 OK created table model public.pipedrive_persons_picture_id.......................................... [SELECT 3 in 0.81s] 2021-08-16 18:44:32 INFO () LineGobbler(voidCall):85 - 18:44:32 | 12 of 15 OK created table model public.pipedrive_activities_participants..................................... [SELECT 2 in 0.81s] 2021-08-16 18:44:32 INFO () LineGobbler(voidCall):85 - 18:44:32 | 15 of 15 START table model public.pipedrive_persons_picture_id_pictures...................................... [RUN] 2021-08-16 18:44:32 INFO () LineGobbler(voidCall):85 - 18:44:32 | 15 of 15 OK created table model public.pipedrive_persons_picture_id_pictures................................. [SELECT 0 in 0.29s] 2021-08-16 18:44:32 INFO () LineGobbler(voidCall):85 - 18:44:32 | 2021-08-16 18:44:32 INFO () LineGobbler(voidCall):85 - 18:44:32 | Finished running 15 table models in 5.80s. 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - Completed with 1 error and 0 warnings: 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - Database Error in model pipedrive_deals (models/generated/airbyte_tables/public/pipedrive_deals.sql) 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - invalid input syntax for type timestamp with time zone: "15:15:00" 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_tables/public/pipedrive_deals.sql 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - 2021-08-16 18:44:33 INFO () LineGobbler(voidCall):85 - Done. PASS=14 WARN=0 ERROR=1 SKIP=0 TOTAL=15 2021-08-16 18:44:35 INFO () TemporalAttemptExecution(lambda$getWorkerThread$2):149 - Completing future exceptionally... io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:69) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:36) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:146) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at java.lang.Thread.run(Thread.java:832) [?:?] Caused by: io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:66) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] ... 3 more Suppressed: io.airbyte.workers.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:151) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:36) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:146) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at java.lang.Thread.run(Thread.java:832) [?:?] 2021-08-16 18:44:35 INFO () TemporalAttemptExecution(get):133 - Stopping cancellation check scheduling... 2021-08-16 18:44:35 WARN () POJOActivityTaskHandler$POJOActivityImplementation(execute):243 - Activity failure. ActivityId=87b417a2-4c1a-33e0-8f8f-a7833e5dffd6, activityType=Normalize, attempt=1 java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Normalization Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2063) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:131) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.temporal.SyncWorkflow$NormalizationActivityImpl.normalize(SyncWorkflow.java:322) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:564) ~[?:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:277) ~[temporal-sdk-1.0.4.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:216) ~[temporal-sdk-1.0.4.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:181) ~[temporal-sdk-1.0.4.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:192) ~[temporal-sdk-1.0.4.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:154) ~[temporal-sdk-1.0.4.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:73) ~[temporal-sdk-1.0.4.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?] at java.lang.Thread.run(Thread.java:832) [?:?] Caused by: io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:69) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:36) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:146) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:66) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:36) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:146) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] ... 1 more Suppressed: io.airbyte.workers.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:151) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:36) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:146) ~[io.airbyte-airbyte-workers-0.29.7-alpha.jar:?] at java.lang.Thread.run(Thread.java:832) [?:?] ```
## Steps to Reproduce 1. 2. 3. ## Are you willing to submit a PR?

Remove this with your answer.

sherifnada commented 3 years ago

@subodh1810 relevant to our discussion yesterday. Would this be fixed by the approach we discussed today?

subodh1810 commented 3 years ago

@sherifnada based on the logs it seems like the connector has specified incorrect format. The value 15:15:00 is not a date-time format.

sherifnada commented 3 years ago

Good call. Will fix.