airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.14k stars 4.13k forks source link

Native Github Connector failed to sync #4612

Closed marcosmarxm closed 3 years ago

marcosmarxm commented 3 years ago
## Enviroment - Is this your first time deploying Airbyte: No - OS Version / Instance: ec2 t5.large Memory / Disk: standard - Deployment: Docker - Airbyte Version: 0.27.0-alpha - Source name/version: Github (Native) - Destination name/version: BigQuery - Step: On sync ## Current Behavior Description: I’ve been experimenting with the Github Native connector, v0.1.0 and v0.1.1. I'm getting empty tables for some of the streams, but the results are inconsistent. One possibility is that when the API rate limit gets hit, the connector just moves on and concludes syncing that stream. I base this hypothesis on these observations: Variable outcome when syncing even a single large stream (apache/superset issues). Sometimes you get a populated table, sometimes nothing, sometimes a populated table, but with a different (but similar) number of records. Empty tables seem more likely right after a previous sync fails. I can demonstrate that syncing just the issues stream produces an empty table 100% of the time after running a full sync (which also produces some empty tables). Wait an hour, sync just issues again without changing any configuration -> populated issues table. Syncing all streams for even a small repo fails right after syncing a large repo. I have attached the log from an example run. Connector v0.1.1, all streams, apache/superset repo. This run prouced a mix of populated and empty tables. For example, events had records, but issues is empty. (edited) ## Expected Behavior *Tell us what should happen.* ## Logs *If applicable, please upload the logs from the failing operation. For sync jobs, you can download the full logs from the UI by going to the sync attempt page and clicking the download logs button at the top right of the logs display window.*
LOG ``` 2021-07-07 18:34:39 INFO () WorkerRun(call):62 - Executing worker wrapper. Airbyte version: 0.27.0-alpha 2021-07-07 18:34:39 INFO () TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.27.0-alpha 2021-07-07 18:34:39 INFO () DefaultReplicationWorker(run):102 - start sync worker. job id: 415 attempt id: 0 2021-07-07 18:34:39 INFO () DefaultReplicationWorker(run):111 - configured sync modes: {null.commit_comments=full_refresh - append, null.pull_requests=full_refresh - append, null.comments=full_refresh - append, null.commits=full_refresh - append, null.issue_labels=full_refresh - append, null.assignees=full_refresh - append, null.issue_events=full_refresh - append, null.issues=full_refresh - append, null.teams=full_refresh - append, null.issue_milestones=full_refresh - append, null.reviews=full_refresh - append, null.releases=full_refresh - append, null.projects=full_refresh - append, null.events=full_refresh - append, null.collaborators=full_refresh - append, null.stargazers=full_refresh - append} 2021-07-07 18:34:39 INFO () DefaultAirbyteDestination(start):78 - Running destination... 2021-07-07 18:34:39 INFO () LineGobbler(voidCall):85 - Checking if airbyte/destination-bigquery:0.3.7 exists... 2021-07-07 18:34:39 INFO () LineGobbler(voidCall):85 - airbyte/destination-bigquery:0.3.7 was found locally. 2021-07-07 18:34:39 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/415/0 --network host --log-driver none airbyte/destination-bigquery:0.3.7 write --config destination_config.json --catalog destination_catalog.json 2021-07-07 18:34:39 INFO () LineGobbler(voidCall):85 - Checking if airbyte/source-github:0.1.1 exists... 2021-07-07 18:34:39 INFO () LineGobbler(voidCall):85 - airbyte/source-github:0.1.1 was found locally. 2021-07-07 18:34:39 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/415/0 --network host --log-driver none airbyte/source-github:0.1.1 read --config source_config.json --catalog source_catalog.json 2021-07-07 18:34:39 INFO () DefaultReplicationWorker(lambda$getDestinationOutputRunnable$3):243 - Destination output thread started. 2021-07-07 18:34:39 INFO () DefaultReplicationWorker(run):139 - Waiting for source thread to join. 2021-07-07 18:34:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):207 - Replication thread started. 2021-07-07 18:34:40 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Starting syncing SourceGithub 2021-07-07 18:34:40 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: assignees 2021-07-07 18:34:41 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:41 INFO i.a.i.d.b.BigQueryDestination(main):278 - {} - starting destination: class io.airbyte.integrations.destination.bigquery.BigQueryDestination 2021-07-07 18:34:41 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:41 INFO i.a.i.b.IntegrationRunner(run):78 - {} - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2021-07-07 18:34:41 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:41 INFO i.a.i.b.IntegrationCliParser(parseOptions):135 - {} - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2021-07-07 18:34:41 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:41 INFO i.a.i.b.IntegrationRunner(run):82 - {} - Command: WRITE 2021-07-07 18:34:41 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:41 INFO i.a.i.b.IntegrationRunner(run):83 - {} - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2021-07-07 18:34:43 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:43 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_oyo_github_superset_assignees}} created successfully 2021-07-07 18:34:43 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:43 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_kdt_github_superset_collaborators}} created successfully 2021-07-07 18:34:44 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:44 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_dcb_github_superset_comments}} created successfully 2021-07-07 18:34:44 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:44 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_jig_github_superset_commit_comments}} created successfully 2021-07-07 18:34:45 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:45 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_lca_github_superset_commits}} created successfully 2021-07-07 18:34:45 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:45 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_qdk_github_superset_events}} created successfully 2021-07-07 18:34:46 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:46 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_hff_github_superset_issue_events}} created successfully 2021-07-07 18:34:46 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:46 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_fzh_github_superset_issue_labels}} created successfully 2021-07-07 18:34:47 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:47 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_wqv_github_superset_issue_milestones}} created successfully 2021-07-07 18:34:47 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:47 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_fnl_github_superset_issues}} created successfully 2021-07-07 18:34:48 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:48 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_gha_github_superset_projects}} created successfully 2021-07-07 18:34:48 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:48 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_vnl_github_superset_pull_requests}} created successfully 2021-07-07 18:34:49 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:49 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_wpb_github_superset_releases}} created successfully 2021-07-07 18:34:49 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:49 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_csr_github_superset_reviews}} created successfully 2021-07-07 18:34:50 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:50 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_rbq_github_superset_stargazers}} created successfully 2021-07-07 18:34:50 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:34:50 INFO i.a.i.d.b.BigQueryUtils(createTable):83 - {} - Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_vac_github_superset_teams}} created successfully 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 61 records from assignees stream 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: collaborators 2021-07-07 18:36:47 WARN () DefaultAirbyteStreamFactory(internalLog):109 - 403 Client Error: Forbidden for url: https://api.github.com/repos/apache/superset/collaborators?per_page=100 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 0 records from collaborators stream 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: comments 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Caught retryable error after 1 tries. Waiting 5 seconds then retrying... 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Caught retryable error after 2 tries. Waiting 10 seconds then retrying... 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Caught retryable error after 3 tries. Waiting 20 seconds then retrying... 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Caught retryable error after 4 tries. Waiting 40 seconds then retrying... 2021-07-07 18:36:47 WARN () DefaultAirbyteStreamFactory(internalLog):109 - 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 0 records from comments stream 2021-07-07 18:36:47 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: commit_comments 2021-07-07 18:36:48 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 131 records from commit_comments stream 2021-07-07 18:36:48 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: commits 2021-07-07 18:36:51 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):220 - Records read: 1000 2021-07-07 18:36:55 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):220 - Records read: 2000 2021-07-07 18:37:00 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):220 - Records read: 3000 2021-07-07 18:37:05 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):220 - Records read: 4000 2021-07-07 18:37:08 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):220 - Records read: 5000 2021-07-07 18:37:12 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):220 - Records read: 6000 2021-07-07 18:37:15 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):220 - Records read: 7000 2021-07-07 18:37:18 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):220 - Records read: 8000 2021-07-07 18:37:20 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 7847 records from commits stream 2021-07-07 18:37:20 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: events 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - Traceback (most recent call last): 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - File "/airbyte/integration_code/main.py", line 33, in 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - launch(source, sys.argv[1:]) 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 117, in launch 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - for message in source_entrypoint.run(parsed_args): 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 108, in run 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - for message in generator: 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - raise e 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 110, in read 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - logger=logger, stream_instance=stream_instance, configured_stream=configured_stream, connector_state=connector_state 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 135, in _read_stream 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - for record in record_iterator: 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 181, in _read_full_refresh 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - for record in records: 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - File "/airbyte/integration_code/source_github/streams.py", line 209, in read_records 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - if record.get(self.cursor_field) > start_point: 2021-07-07 18:37:23 ERROR () LineGobbler(voidCall):85 - TypeError: '>' not supported between instances of 'NoneType' and 'str' 2021-07-07 18:37:23 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Read 229 records from events stream 2021-07-07 18:37:23 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: issue_events 2021-07-07 18:37:23 ERROR () DefaultAirbyteStreamFactory(internalLog):108 - Encountered an exception while reading stream SourceGithub Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 110, in read logger=logger, stream_instance=stream_instance, configured_stream=configured_stream, connector_state=connector_state File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 135, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 181, in _read_full_refresh for record in records: File "/airbyte/integration_code/source_github/streams.py", line 209, in read_records if record.get(self.cursor_field) > start_point: TypeError: '>' not supported between instances of 'NoneType' and 'str' 2021-07-07 18:37:24 INFO () DefaultReplicationWorker(run):141 - Source thread complete. 2021-07-07 18:37:24 INFO () DefaultReplicationWorker(run):142 - Waiting for destination thread to join. 2021-07-07 18:37:24 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:24 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 - {} - Airbyte message consumer: succeeded. 2021-07-07 18:37:31 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:31 INFO i.a.i.d.b.BigQueryRecordConsumer(close):132 - {} - executing on success close procedure. 2021-07-07 18:37:32 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:32 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_wqv_github_superset_issue_milestones}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_issue_milestones}} 2021-07-07 18:37:32 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:32 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_kdt_github_superset_collaborators}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_collaborators}} 2021-07-07 18:37:33 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:33 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_hff_github_superset_issue_events}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_issue_events}} 2021-07-07 18:37:34 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:34 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_vnl_github_superset_pull_requests}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_pull_requests}} 2021-07-07 18:37:36 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:36 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_lca_github_superset_commits}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_commits}} 2021-07-07 18:37:37 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:37 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_fzh_github_superset_issue_labels}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_issue_labels}} 2021-07-07 18:37:37 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:37 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_wpb_github_superset_releases}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_releases}} 2021-07-07 18:37:38 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:38 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_rbq_github_superset_stargazers}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_stargazers}} 2021-07-07 18:37:39 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:39 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_oyo_github_superset_assignees}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_assignees}} 2021-07-07 18:37:42 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:42 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_dcb_github_superset_comments}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_comments}} 2021-07-07 18:37:42 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:42 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_gha_github_superset_projects}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_projects}} 2021-07-07 18:37:44 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:44 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_qdk_github_superset_events}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_events}} 2021-07-07 18:37:48 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:48 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_fnl_github_superset_issues}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_issues}} 2021-07-07 18:37:49 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:49 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_vac_github_superset_teams}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_teams}} 2021-07-07 18:37:50 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:50 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_csr_github_superset_reviews}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_reviews}} 2021-07-07 18:37:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:51 INFO i.a.i.d.b.BigQueryRecordConsumer(copyTable):163 - {} - successfully copied tmp table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_tmp_jig_github_superset_commit_comments}} to final table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=base, tableId=_airbyte_raw_github_superset_commit_comments}} 2021-07-07 18:37:51 INFO () JsonSchemaValidator(test):76 - JSON schema validation failed. errors: $: null found, object expected 2021-07-07 18:37:51 ERROR () DefaultAirbyteStreamFactory(lambda$create$1):83 - Validation failed: null 2021-07-07 18:37:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:53 INFO i.a.i.b.IntegrationRunner(run):118 - {} - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2021-07-07 18:37:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-07-07 18:37:53 INFO i.a.i.d.b.BigQueryDestination(main):280 - {} - completed destination: class io.airbyte.integrations.destination.bigquery.BigQueryDestination 2021-07-07 18:37:54 INFO () DefaultReplicationWorker(run):144 - Destination thread complete. 2021-07-07 18:37:54 WARN () DefaultAirbyteSource(close):132 - Source process might not have shut down correctly. source process alive: false, source process exit value: 1. This warning is normal if the job was cancelled. 2021-07-07 18:37:54 INFO () DefaultReplicationWorker(run):169 - sync summary: io.airbyte.config.ReplicationAttemptSummary@99eb20f[status=completed,recordsSynced=8268,bytesSynced=18373722,startTime=1625682879366,endTime=1625683074076] 2021-07-07 18:37:54 INFO () DefaultReplicationWorker(run):178 - Source did not output any state messages 2021-07-07 18:37:54 WARN () DefaultReplicationWorker(run):189 - State capture: No state retained. 2021-07-07 18:37:54 INFO () TemporalAttemptExecution(get):133 - Stopping cancellation check scheduling... 2021-07-07 18:37:54 INFO () RetryingTemporalAttemptExecution(get):118 - Last output present: true. Should attempt again: false 2021-07-07 18:37:54 INFO () SyncWorkflow$ReplicationActivityImpl(replicate):202 - attempt summaries: [io.airbyte.config.ReplicationOutput@209a6696[replicationAttemptSummary=io.airbyte.config.ReplicationAttemptSummary@99eb20f[status=completed,recordsSynced=8268,bytesSynced=18373722,startTime=1625682879366,endTime=1625683074076],state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@52aa51af[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@57fd6166[stream=io.airbyte.protocol.models.AirbyteStream@6f87c4c6[name=github_superset_assignees,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]},"login":{"type":["null","string"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"gists_url":{"type":["null","string"]},"repos_url":{"type":["null","string"]},"avatar_url":{"type":["null","string"]},"events_url":{"type":["null","string"]},"site_admin":{"type":["null","boolean"]},"gravatar_id":{"type":["null","string"]},"starred_url":{"type":["null","string"]},"followers_url":{"type":["null","string"]},"following_url":{"type":["null","string"]},"organizations_url":{"type":["null","string"]},"subscriptions_url":{"type":["null","string"]},"received_events_url":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@1c5aa176[stream=io.airbyte.protocol.models.AirbyteStream@1c7dbc7b[name=github_superset_collaborators,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]},"login":{"type":["null","string"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"gists_url":{"type":["null","string"]},"repos_url":{"type":["null","string"]},"avatar_url":{"type":["null","string"]},"events_url":{"type":["null","string"]},"site_admin":{"type":["null","boolean"]},"gravatar_id":{"type":["null","string"]},"permissions":{"type":["null","object"],"properties":{"pull":{"type":["null","boolean"]},"push":{"type":["null","boolean"]},"admin":{"type":["null","boolean"]}}},"starred_url":{"type":["null","string"]},"followers_url":{"type":["null","string"]},"following_url":{"type":["null","string"]},"organizations_url":{"type":["null","string"]},"subscriptions_url":{"type":["null","string"]},"received_events_url":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@203708c3[stream=io.airbyte.protocol.models.AirbyteStream@714759f7[name=github_superset_comments,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"node_id":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"html_url":{"type":["null","string"]},"issue_url":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"updated_at":{"type":["null","string"],"format":"date-time"},"author_association":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@385f07b8[stream=io.airbyte.protocol.models.AirbyteStream@49b0eaac[name=github_superset_commit_comments,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"line":{"type":["null","integer"]},"path":{"type":["null","string"]},"node_id":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"html_url":{"type":["null","string"]},"position":{"type":["null","integer"]},"commit_id":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"updated_at":{"type":["null","string"],"format":"date-time"},"author_association":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@51599249[stream=io.airbyte.protocol.models.AirbyteStream@1a1af174[name=github_superset_commits,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]},"commit":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"tree":{"type":["null","object"],"properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]}}},"author":{"type":["null","object"],"properties":{"date":{"type":["null","string"],"format":"date-time"},"name":{"type":["null","string"]},"email":{"type":["null","string"]}}},"message":{"type":["null","string"]},"committer":{"type":["null","object"],"properties":{"date":{"type":["null","string"],"format":"date-time"},"name":{"type":["null","string"]},"email":{"type":["null","string"]}}},"verification":{"type":["null","object"],"properties":{"reason":{"type":["null","string"]},"payload":{"type":["null","string"]},"verified":{"type":["null","boolean"]},"signature":{"type":["null","string"]}}},"comment_count":{"type":["null","integer"]}}},"node_id":{"type":["null","string"]},"parents":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]},"html_url":{"type":["null","string"]}}}},"html_url":{"type":["null","string"]},"author_id":{"type":["null","integer"]},"created_at":{"type":["null","string"],"format":"date-time"},"comments_url":{"type":["null","string"]},"committer_id":{"type":["null","integer"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[created_at],sourceDefinedPrimaryKey=[[sha]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[created_at],destinationSyncMode=append,primaryKey=[[sha]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5a384748[stream=io.airbyte.protocol.models.AirbyteStream@14933329[name=github_superset_events,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","string"]},"type":{"type":["null","string"]},"org_id":{"type":["null","integer"]},"public":{"type":["null","boolean"]},"payload":{"type":["null","object"],"properties":{}},"repo_id":{"type":["null","integer"]},"actor_id":{"type":["null","integer"]},"created_at":{"type":["null","string"]},"_ab_github_repository":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[created_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[created_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@9c53028[stream=io.airbyte.protocol.models.AirbyteStream@4419f135[name=github_superset_issue_events,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"event":{"type":["null","string"]},"node_id":{"type":["null","string"]},"actor_id":{"type":["null","integer"]},"issue_id":{"type":["null","integer"]},"commit_id":{"type":["null","string"]},"commit_url":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"_ab_github_repository":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5c03fcf9[stream=io.airbyte.protocol.models.AirbyteStream@5104862b[name=github_superset_issue_labels,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"name":{"type":["null","string"]},"color":{"type":["null","string"]},"default":{"type":["null","boolean"]},"node_id":{"type":["null","string"]},"description":{"type":["null","string"]},"_ab_github_repository":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7160b853[stream=io.airbyte.protocol.models.AirbyteStream@7a7b7f13[name=github_superset_issue_milestones,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"state":{"type":["null","string"]},"title":{"type":["null","string"]},"due_on":{"type":["null","string"],"format":"date-time"},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"closed_at":{"type":["null","string"],"format":"date-time"},"created_at":{"type":["null","string"],"format":"date-time"},"creator_id":{"type":["null","integer"]},"labels_url":{"type":["null","string"]},"updated_at":{"type":["null","string"],"format":"date-time"},"description":{"type":["null","string"]},"open_issues":{"type":["null","integer"]},"closed_issues":{"type":["null","integer"]},"_ab_github_repository":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@39dcb091[stream=io.airbyte.protocol.models.AirbyteStream@4c9c4c5f[name=github_superset_issues,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"state":{"type":["null","string"]},"title":{"type":["null","string"]},"labels":{"type":["null","array"],"items":{"type":["null","integer"]}},"locked":{"type":["null","boolean"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"comments":{"type":["null","integer"]},"html_url":{"type":["null","string"]},"assignees":{"type":["null","array"],"items":{"type":["null","integer"]}},"closed_at":{"type":["null","string"],"format":"date-time"},"created_at":{"type":["null","string"],"format":"date-time"},"events_url":{"type":["null","string"]},"labels_url":{"type":["null","string"]},"updated_at":{"type":["null","string"],"format":"date-time"},"assignee_id":{"type":["null","integer"]},"comments_url":{"type":["null","string"]},"milestone_id":{"type":["null","integer"]},"pull_request":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"diff_url":{"type":["null","string"]},"html_url":{"type":["null","string"]},"patch_url":{"type":["null","string"]}}},"repository_url":{"type":["null","string"]},"active_lock_reason":{"type":["null","string"]},"author_association":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@384ad7bf[stream=io.airbyte.protocol.models.AirbyteStream@19e8a442[name=github_superset_projects,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"name":{"type":["null","string"]},"state":{"type":["null","string"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"owner_url":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"creator_id":{"type":["null","integer"]},"updated_at":{"type":["null","string"],"format":"date-time"},"columns_url":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@45ecd7d6[stream=io.airbyte.protocol.models.AirbyteStream@6b3c8580[name=github_superset_pull_requests,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"base":{"type":["null","object"],"properties":{"ref":{"type":["null","string"]},"sha":{"type":["null","string"]},"label":{"type":["null","string"]},"repo_id":{"type":["null","integer"]},"user_id":{"type":["null","integer"]}}},"body":{"type":["null","string"]},"head":{"type":["null","object"],"properties":{"ref":{"type":["null","string"]},"sha":{"type":["null","string"]},"label":{"type":["null","string"]},"repo_id":{"type":["null","integer"]},"user_id":{"type":["null","integer"]}}},"draft":{"type":["null","boolean"]},"state":{"type":["null","string"]},"title":{"type":["null","string"]},"_links":{"type":["null","object"],"properties":{"html":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"self":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"issue":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"commits":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"comments":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"statuses":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"review_comment":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"review_comments":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}}},"labels":{"type":["null","array"],"items":{"type":["null","integer"]}},"locked":{"type":["null","boolean"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"diff_url":{"type":["null","string"]},"html_url":{"type":["null","string"]},"assignees":{"type":["null","array"],"items":{"type":["null","integer"]}},"closed_at":{"type":["null","string"],"format":"date-time"},"issue_url":{"type":["null","string"]},"merged_at":{"type":["null","string"],"format":"date-time"},"patch_url":{"type":["null","string"]},"auto_merge":{"type":["null","boolean"]},"created_at":{"type":["null","string"],"format":"date-time"},"updated_at":{"type":["null","string"],"format":"date-time"},"assignee_id":{"type":["null","integer"]},"commits_url":{"type":["null","string"]},"comments_url":{"type":["null","string"]},"milestone_id":{"type":["null","integer"]},"statuses_url":{"type":["null","string"]},"requested_teams":{"type":["null","array"],"items":{"type":["null","integer"]}},"merge_commit_sha":{"type":["null","string"]},"active_lock_reason":{"type":["null","string"]},"author_association":{"type":["null","string"]},"review_comment_url":{"type":["null","string"]},"requested_reviewers":{"type":["null","array"],"items":{"type":["null","integer"]}},"review_comments_url":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5254077[stream=io.airbyte.protocol.models.AirbyteStream@59333e25[name=github_superset_releases,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"name":{"type":["null","string"]},"draft":{"type":["null","boolean"]},"assets":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"name":{"type":["null","string"]},"size":{"type":["null","integer"]},"label":{"type":["null","string"]},"state":{"type":["null","string"]},"node_id":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"updated_at":{"type":["null","string"],"format":"date-time"},"uploader_id":{"type":["null","integer"]},"content_type":{"type":["null","string"]},"download_count":{"type":["null","integer"]},"browser_download_url":{"type":["null","string"]}}}},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"tag_name":{"type":["null","string"]},"author_id":{"type":["null","integer"]},"assets_url":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"prerelease":{"type":["null","boolean"]},"upload_url":{"type":["null","string"]},"tarball_url":{"type":["null","string"]},"zipball_url":{"type":["null","string"]},"published_at":{"type":["null","string"],"format":"date-time"},"target_commitish":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[created_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[created_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7ac210b2[stream=io.airbyte.protocol.models.AirbyteStream@75dd8aef[name=github_superset_reviews,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"body":{"type":["null","string"]},"state":{"type":["null","string"]},"_links":{"type":["null","object"],"properties":{"html":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"pull_request":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}}},"node_id":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"html_url":{"type":["null","string"]},"commit_id":{"type":["null","string"]},"submitted_at":{"type":["null","string"],"format":"date-time"},"pull_request_url":{"type":["null","string"]},"author_association":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5ad45adb[stream=io.airbyte.protocol.models.AirbyteStream@1a5685b2[name=github_superset_stargazers,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"user_id":{"type":["null","integer"]},"starred_at":{"type":["null","string"],"format":"date-time"},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[starred_at],sourceDefinedPrimaryKey=[[user_id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[starred_at],destinationSyncMode=append,primaryKey=[[user_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@707b41ca[stream=io.airbyte.protocol.models.AirbyteStream@696837d8[name=github_superset_teams,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"name":{"type":["null","string"]},"slug":{"type":["null","string"]},"parent":{"type":["null","string"]},"node_id":{"type":["null","string"]},"privacy":{"type":["null","string"]},"html_url":{"type":["null","string"]},"permission":{"type":["null","string"]},"description":{"type":["null","string"]},"members_url":{"type":["null","string"]},"repositories_url":{"type":["null","string"]},"_ab_github_repository":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}]]] 2021-07-07 18:37:54 INFO () SyncWorkflow$ReplicationActivityImpl(replicate):203 - sync summary: io.airbyte.config.StandardSyncOutput@1598b50a[standardSyncSummary=io.airbyte.config.StandardSyncSummary@3de69696[status=completed,recordsSynced=8268,bytesSynced=18373722,startTime=1625682879366,endTime=1625683074076],state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@52aa51af[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@57fd6166[stream=io.airbyte.protocol.models.AirbyteStream@6f87c4c6[name=github_superset_assignees,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]},"login":{"type":["null","string"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"gists_url":{"type":["null","string"]},"repos_url":{"type":["null","string"]},"avatar_url":{"type":["null","string"]},"events_url":{"type":["null","string"]},"site_admin":{"type":["null","boolean"]},"gravatar_id":{"type":["null","string"]},"starred_url":{"type":["null","string"]},"followers_url":{"type":["null","string"]},"following_url":{"type":["null","string"]},"organizations_url":{"type":["null","string"]},"subscriptions_url":{"type":["null","string"]},"received_events_url":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@1c5aa176[stream=io.airbyte.protocol.models.AirbyteStream@1c7dbc7b[name=github_superset_collaborators,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]},"login":{"type":["null","string"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"gists_url":{"type":["null","string"]},"repos_url":{"type":["null","string"]},"avatar_url":{"type":["null","string"]},"events_url":{"type":["null","string"]},"site_admin":{"type":["null","boolean"]},"gravatar_id":{"type":["null","string"]},"permissions":{"type":["null","object"],"properties":{"pull":{"type":["null","boolean"]},"push":{"type":["null","boolean"]},"admin":{"type":["null","boolean"]}}},"starred_url":{"type":["null","string"]},"followers_url":{"type":["null","string"]},"following_url":{"type":["null","string"]},"organizations_url":{"type":["null","string"]},"subscriptions_url":{"type":["null","string"]},"received_events_url":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@203708c3[stream=io.airbyte.protocol.models.AirbyteStream@714759f7[name=github_superset_comments,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"node_id":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"html_url":{"type":["null","string"]},"issue_url":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"updated_at":{"type":["null","string"],"format":"date-time"},"author_association":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@385f07b8[stream=io.airbyte.protocol.models.AirbyteStream@49b0eaac[name=github_superset_commit_comments,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"line":{"type":["null","integer"]},"path":{"type":["null","string"]},"node_id":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"html_url":{"type":["null","string"]},"position":{"type":["null","integer"]},"commit_id":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"updated_at":{"type":["null","string"],"format":"date-time"},"author_association":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@51599249[stream=io.airbyte.protocol.models.AirbyteStream@1a1af174[name=github_superset_commits,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]},"commit":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"tree":{"type":["null","object"],"properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]}}},"author":{"type":["null","object"],"properties":{"date":{"type":["null","string"],"format":"date-time"},"name":{"type":["null","string"]},"email":{"type":["null","string"]}}},"message":{"type":["null","string"]},"committer":{"type":["null","object"],"properties":{"date":{"type":["null","string"],"format":"date-time"},"name":{"type":["null","string"]},"email":{"type":["null","string"]}}},"verification":{"type":["null","object"],"properties":{"reason":{"type":["null","string"]},"payload":{"type":["null","string"]},"verified":{"type":["null","boolean"]},"signature":{"type":["null","string"]}}},"comment_count":{"type":["null","integer"]}}},"node_id":{"type":["null","string"]},"parents":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]},"html_url":{"type":["null","string"]}}}},"html_url":{"type":["null","string"]},"author_id":{"type":["null","integer"]},"created_at":{"type":["null","string"],"format":"date-time"},"comments_url":{"type":["null","string"]},"committer_id":{"type":["null","integer"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[created_at],sourceDefinedPrimaryKey=[[sha]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[created_at],destinationSyncMode=append,primaryKey=[[sha]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5a384748[stream=io.airbyte.protocol.models.AirbyteStream@14933329[name=github_superset_events,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","string"]},"type":{"type":["null","string"]},"org_id":{"type":["null","integer"]},"public":{"type":["null","boolean"]},"payload":{"type":["null","object"],"properties":{}},"repo_id":{"type":["null","integer"]},"actor_id":{"type":["null","integer"]},"created_at":{"type":["null","string"]},"_ab_github_repository":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[created_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[created_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@9c53028[stream=io.airbyte.protocol.models.AirbyteStream@4419f135[name=github_superset_issue_events,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"event":{"type":["null","string"]},"node_id":{"type":["null","string"]},"actor_id":{"type":["null","integer"]},"issue_id":{"type":["null","integer"]},"commit_id":{"type":["null","string"]},"commit_url":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"_ab_github_repository":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5c03fcf9[stream=io.airbyte.protocol.models.AirbyteStream@5104862b[name=github_superset_issue_labels,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"name":{"type":["null","string"]},"color":{"type":["null","string"]},"default":{"type":["null","boolean"]},"node_id":{"type":["null","string"]},"description":{"type":["null","string"]},"_ab_github_repository":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7160b853[stream=io.airbyte.protocol.models.AirbyteStream@7a7b7f13[name=github_superset_issue_milestones,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"state":{"type":["null","string"]},"title":{"type":["null","string"]},"due_on":{"type":["null","string"],"format":"date-time"},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"closed_at":{"type":["null","string"],"format":"date-time"},"created_at":{"type":["null","string"],"format":"date-time"},"creator_id":{"type":["null","integer"]},"labels_url":{"type":["null","string"]},"updated_at":{"type":["null","string"],"format":"date-time"},"description":{"type":["null","string"]},"open_issues":{"type":["null","integer"]},"closed_issues":{"type":["null","integer"]},"_ab_github_repository":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@39dcb091[stream=io.airbyte.protocol.models.AirbyteStream@4c9c4c5f[name=github_superset_issues,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"state":{"type":["null","string"]},"title":{"type":["null","string"]},"labels":{"type":["null","array"],"items":{"type":["null","integer"]}},"locked":{"type":["null","boolean"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"comments":{"type":["null","integer"]},"html_url":{"type":["null","string"]},"assignees":{"type":["null","array"],"items":{"type":["null","integer"]}},"closed_at":{"type":["null","string"],"format":"date-time"},"created_at":{"type":["null","string"],"format":"date-time"},"events_url":{"type":["null","string"]},"labels_url":{"type":["null","string"]},"updated_at":{"type":["null","string"],"format":"date-time"},"assignee_id":{"type":["null","integer"]},"comments_url":{"type":["null","string"]},"milestone_id":{"type":["null","integer"]},"pull_request":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"diff_url":{"type":["null","string"]},"html_url":{"type":["null","string"]},"patch_url":{"type":["null","string"]}}},"repository_url":{"type":["null","string"]},"active_lock_reason":{"type":["null","string"]},"author_association":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@384ad7bf[stream=io.airbyte.protocol.models.AirbyteStream@19e8a442[name=github_superset_projects,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"name":{"type":["null","string"]},"state":{"type":["null","string"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"owner_url":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"creator_id":{"type":["null","integer"]},"updated_at":{"type":["null","string"],"format":"date-time"},"columns_url":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@45ecd7d6[stream=io.airbyte.protocol.models.AirbyteStream@6b3c8580[name=github_superset_pull_requests,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"base":{"type":["null","object"],"properties":{"ref":{"type":["null","string"]},"sha":{"type":["null","string"]},"label":{"type":["null","string"]},"repo_id":{"type":["null","integer"]},"user_id":{"type":["null","integer"]}}},"body":{"type":["null","string"]},"head":{"type":["null","object"],"properties":{"ref":{"type":["null","string"]},"sha":{"type":["null","string"]},"label":{"type":["null","string"]},"repo_id":{"type":["null","integer"]},"user_id":{"type":["null","integer"]}}},"draft":{"type":["null","boolean"]},"state":{"type":["null","string"]},"title":{"type":["null","string"]},"_links":{"type":["null","object"],"properties":{"html":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"self":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"issue":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"commits":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"comments":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"statuses":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"review_comment":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"review_comments":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}}},"labels":{"type":["null","array"],"items":{"type":["null","integer"]}},"locked":{"type":["null","boolean"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"diff_url":{"type":["null","string"]},"html_url":{"type":["null","string"]},"assignees":{"type":["null","array"],"items":{"type":["null","integer"]}},"closed_at":{"type":["null","string"],"format":"date-time"},"issue_url":{"type":["null","string"]},"merged_at":{"type":["null","string"],"format":"date-time"},"patch_url":{"type":["null","string"]},"auto_merge":{"type":["null","boolean"]},"created_at":{"type":["null","string"],"format":"date-time"},"updated_at":{"type":["null","string"],"format":"date-time"},"assignee_id":{"type":["null","integer"]},"commits_url":{"type":["null","string"]},"comments_url":{"type":["null","string"]},"milestone_id":{"type":["null","integer"]},"statuses_url":{"type":["null","string"]},"requested_teams":{"type":["null","array"],"items":{"type":["null","integer"]}},"merge_commit_sha":{"type":["null","string"]},"active_lock_reason":{"type":["null","string"]},"author_association":{"type":["null","string"]},"review_comment_url":{"type":["null","string"]},"requested_reviewers":{"type":["null","array"],"items":{"type":["null","integer"]}},"review_comments_url":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5254077[stream=io.airbyte.protocol.models.AirbyteStream@59333e25[name=github_superset_releases,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"name":{"type":["null","string"]},"draft":{"type":["null","boolean"]},"assets":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"name":{"type":["null","string"]},"size":{"type":["null","integer"]},"label":{"type":["null","string"]},"state":{"type":["null","string"]},"node_id":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"updated_at":{"type":["null","string"],"format":"date-time"},"uploader_id":{"type":["null","integer"]},"content_type":{"type":["null","string"]},"download_count":{"type":["null","integer"]},"browser_download_url":{"type":["null","string"]}}}},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"tag_name":{"type":["null","string"]},"author_id":{"type":["null","integer"]},"assets_url":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"prerelease":{"type":["null","boolean"]},"upload_url":{"type":["null","string"]},"tarball_url":{"type":["null","string"]},"zipball_url":{"type":["null","string"]},"published_at":{"type":["null","string"],"format":"date-time"},"target_commitish":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[created_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[created_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7ac210b2[stream=io.airbyte.protocol.models.AirbyteStream@75dd8aef[name=github_superset_reviews,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"body":{"type":["null","string"]},"state":{"type":["null","string"]},"_links":{"type":["null","object"],"properties":{"html":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"pull_request":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}}},"node_id":{"type":["null","string"]},"user_id":{"type":["null","integer"]},"html_url":{"type":["null","string"]},"commit_id":{"type":["null","string"]},"submitted_at":{"type":["null","string"],"format":"date-time"},"pull_request_url":{"type":["null","string"]},"author_association":{"type":["null","string"]},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5ad45adb[stream=io.airbyte.protocol.models.AirbyteStream@1a5685b2[name=github_superset_stargazers,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"user_id":{"type":["null","integer"]},"starred_at":{"type":["null","string"],"format":"date-time"},"_ab_github_repository":{"type":["string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[starred_at],sourceDefinedPrimaryKey=[[user_id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[starred_at],destinationSyncMode=append,primaryKey=[[user_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@707b41ca[stream=io.airbyte.protocol.models.AirbyteStream@696837d8[name=github_superset_teams,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"name":{"type":["null","string"]},"slug":{"type":["null","string"]},"parent":{"type":["null","string"]},"node_id":{"type":["null","string"]},"privacy":{"type":["null","string"]},"html_url":{"type":["null","string"]},"permission":{"type":["null","string"]},"description":{"type":["null","string"]},"members_url":{"type":["null","string"]},"repositories_url":{"type":["null","string"]},"_ab_github_repository":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}]] 2021-07-07 18:37:54 INFO () TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.27.0-alpha 2021-07-07 18:37:54 INFO () DefaultNormalizationWorker(run):61 - Running normalization. 2021-07-07 18:37:54 INFO () LineGobbler(voidCall):85 - Checking if airbyte/normalization:0.1.34 exists... 2021-07-07 18:37:54 INFO () LineGobbler(voidCall):85 - airbyte/normalization:0.1.34 was found locally. 2021-07-07 18:37:54 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/415/0/normalize --network host --log-driver none airbyte/normalization:0.1.34 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2021-07-07 18:37:54 INFO () LineGobbler(voidCall):85 - Running: transform-config --config destination_config.json --integration-type bigquery --out /data/415/0/normalize 2021-07-07 18:37:54 INFO () LineGobbler(voidCall):85 - Namespace(config='destination_config.json', integration_type=, out='/data/415/0/normalize') 2021-07-07 18:37:54 INFO () LineGobbler(voidCall):85 - transform_bigquery 2021-07-07 18:37:54 INFO () LineGobbler(voidCall):85 - Running: transform-catalog --integration-type bigquery --profile-config-dir /data/415/0/normalize --catalog destination_catalog.json --out /data/415/0/normalize/models/generated/ --json-column _airbyte_data 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Processing destination_catalog.json... 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_assignees_ab1.sql from github_superset_assignees 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_assignees_ab2.sql from github_superset_assignees 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_assignees_ab3.sql from github_superset_assignees 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_assignees.sql from github_superset_assignees 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_collaborators_ab1.sql from github_superset_collaborators 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_collaborators_ab2.sql from github_superset_collaborators 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_collaborators_ab3.sql from github_superset_collaborators 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_collaborators.sql from github_superset_collaborators 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_comments_ab1.sql from github_superset_comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_comments_ab2.sql from github_superset_comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_comments_ab3.sql from github_superset_comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_comments.sql from github_superset_comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commit_comments_ab1.sql from github_superset_commit_comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commit_comments_ab2.sql from github_superset_commit_comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commit_comments_ab3.sql from github_superset_commit_comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_commit_comments.sql from github_superset_commit_comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_ab1.sql from github_superset_commits 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_ab2.sql from github_superset_commits 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_ab3.sql from github_superset_commits 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_commits.sql from github_superset_commits 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_events_ab1.sql from github_superset_events 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_events_ab2.sql from github_superset_events 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_events_ab3.sql from github_superset_events 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_events.sql from github_superset_events 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issue_events_ab1.sql from github_superset_issue_events 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issue_events_ab2.sql from github_superset_issue_events 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issue_events_ab3.sql from github_superset_issue_events 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_issue_events.sql from github_superset_issue_events 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issue_labels_ab1.sql from github_superset_issue_labels 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issue_labels_ab2.sql from github_superset_issue_labels 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issue_labels_ab3.sql from github_superset_issue_labels 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_issue_labels.sql from github_superset_issue_labels 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issue_milestones_ab1.sql from github_superset_issue_milestones 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issue_milestones_ab2.sql from github_superset_issue_milestones 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issue_milestones_ab3.sql from github_superset_issue_milestones 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_issue_milestones.sql from github_superset_issue_milestones 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issues_ab1.sql from github_superset_issues 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issues_ab2.sql from github_superset_issues 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issues_ab3.sql from github_superset_issues 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_issues.sql from github_superset_issues 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_projects_ab1.sql from github_superset_projects 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_projects_ab2.sql from github_superset_projects 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_projects_ab3.sql from github_superset_projects 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_projects.sql from github_superset_projects 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests_ab1.sql from github_superset_pull_requests 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests_ab2.sql from github_superset_pull_requests 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests_ab3.sql from github_superset_pull_requests 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_pull_requests.sql from github_superset_pull_requests 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_releases_ab1.sql from github_superset_releases 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_releases_ab2.sql from github_superset_releases 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_releases_ab3.sql from github_superset_releases 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_releases.sql from github_superset_releases 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_reviews_ab1.sql from github_superset_reviews 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_reviews_ab2.sql from github_superset_reviews 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_reviews_ab3.sql from github_superset_reviews 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_reviews.sql from github_superset_reviews 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_stargazers_ab1.sql from github_superset_stargazers 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_stargazers_ab2.sql from github_superset_stargazers 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_stargazers_ab3.sql from github_superset_stargazers 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_stargazers.sql from github_superset_stargazers 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_teams_ab1.sql from github_superset_teams 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_teams_ab2.sql from github_superset_teams 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_teams_ab3.sql from github_superset_teams 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_teams.sql from github_superset_teams 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_collaborators_permissions_ab1.sql from github_superset_collaborators/permissions 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_collaborators_permissions_ab2.sql from github_superset_collaborators/permissions 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_collaborators_permissions_ab3.sql from github_superset_collaborators/permissions 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_collaborators_permissions.sql from github_superset_collaborators/permissions 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_ab1.sql from github_superset_commits/commit 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_ab2.sql from github_superset_commits/commit 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_ab3.sql from github_superset_commits/commit 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_commits_commit.sql from github_superset_commits/commit 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_parents_ab1.sql from github_superset_commits/parents 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_parents_ab2.sql from github_superset_commits/parents 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_parents_ab3.sql from github_superset_commits/parents 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_commits_parents.sql from github_superset_commits/parents 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Ignoring stream 'payload' from github_superset_events/payload because properties list is empty 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Ignoring stream 'labels' from github_superset_issues/labels because properties list is empty 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Ignoring stream 'assignees' from github_superset_issues/assignees because properties list is empty 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issues_pull_request_ab1.sql from github_superset_issues/pull_request 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issues_pull_request_ab2.sql from github_superset_issues/pull_request 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_issues_pull_request_ab3.sql from github_superset_issues/pull_request 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_issues_pull_request.sql from github_superset_issues/pull_request 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests_base_ab1.sql from github_superset_pull_requests/base 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests_base_ab2.sql from github_superset_pull_requests/base 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests_base_ab3.sql from github_superset_pull_requests/base 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_pull_requests_base.sql from github_superset_pull_requests/base 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests_head_ab1.sql from github_superset_pull_requests/head 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests_head_ab2.sql from github_superset_pull_requests/head 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests_head_ab3.sql from github_superset_pull_requests/head 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_pull_requests_head.sql from github_superset_pull_requests/head 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_ab1.sql from github_superset_pull_requests/_links 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_ab2.sql from github_superset_pull_requests/_links 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_ab3.sql from github_superset_pull_requests/_links 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_pull_requests__links.sql from github_superset_pull_requests/_links 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Ignoring stream 'labels' from github_superset_pull_requests/labels because properties list is empty 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Ignoring stream 'assignees' from github_superset_pull_requests/assignees because properties list is empty 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Ignoring stream 'requested_teams' from github_superset_pull_requests/requested_teams because properties list is empty 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Ignoring stream 'requested_reviewers' from github_superset_pull_requests/requested_reviewers because properties list is empty 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_releases_assets_ab1.sql from github_superset_releases/assets 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_releases_assets_ab2.sql from github_superset_releases/assets 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_releases_assets_ab3.sql from github_superset_releases/assets 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_releases_assets.sql from github_superset_releases/assets 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_reviews__links_ab1.sql from github_superset_reviews/_links 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_reviews__links_ab2.sql from github_superset_reviews/_links 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_reviews__links_ab3.sql from github_superset_reviews/_links 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_reviews__links.sql from github_superset_reviews/_links 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_tree_ab1.sql from github_superset_commits/commit/tree 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_tree_ab2.sql from github_superset_commits/commit/tree 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_tree_ab3.sql from github_superset_commits/commit/tree 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_commits_commit_tree.sql from github_superset_commits/commit/tree 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_author_ab1.sql from github_superset_commits/commit/author 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_author_ab2.sql from github_superset_commits/commit/author 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_author_ab3.sql from github_superset_commits/commit/author 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_commits_commit_author.sql from github_superset_commits/commit/author 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_committer_ab1.sql from github_superset_commits/commit/committer 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_committer_ab2.sql from github_superset_commits/commit/committer 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_committer_ab3.sql from github_superset_commits/commit/committer 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_commits_commit_committer.sql from github_superset_commits/commit/committer 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_verification_ab1.sql from github_superset_commits/commit/verification 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_verification_ab2.sql from github_superset_commits/commit/verification 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_commits_commit_verification_ab3.sql from github_superset_commits/commit/verification 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_commits_commit_verification.sql from github_superset_commits/commit/verification 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_html_ab1.sql from github_superset_pull_requests/_links/html 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_html_ab2.sql from github_superset_pull_requests/_links/html 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_html_ab3.sql from github_superset_pull_requests/_links/html 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_pull_requests__links_html.sql from github_superset_pull_requests/_links/html 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_self_ab1.sql from github_superset_pull_requests/_links/self 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_self_ab2.sql from github_superset_pull_requests/_links/self 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_self_ab3.sql from github_superset_pull_requests/_links/self 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_pull_requests__links_self.sql from github_superset_pull_requests/_links/self 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_issue_ab1.sql from github_superset_pull_requests/_links/issue 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_issue_ab2.sql from github_superset_pull_requests/_links/issue 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_issue_ab3.sql from github_superset_pull_requests/_links/issue 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_pull_requests__links_issue.sql from github_superset_pull_requests/_links/issue 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_commits_ab1.sql from github_superset_pull_requests/_links/commits 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_commits_ab2.sql from github_superset_pull_requests/_links/commits 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_commits_ab3.sql from github_superset_pull_requests/_links/commits 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_pull_requests__links_commits.sql from github_superset_pull_requests/_links/commits 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_comments_ab1.sql from github_superset_pull_requests/_links/comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_comments_ab2.sql from github_superset_pull_requests/_links/comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_comments_ab3.sql from github_superset_pull_requests/_links/comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_pull_requests__links_comments.sql from github_superset_pull_requests/_links/comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_statuses_ab1.sql from github_superset_pull_requests/_links/statuses 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_statuses_ab2.sql from github_superset_pull_requests/_links/statuses 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_statuses_ab3.sql from github_superset_pull_requests/_links/statuses 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_pull_requests__links_statuses.sql from github_superset_pull_requests/_links/statuses 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_review_comment_ab1.sql from github_superset_pull_requests/_links/review_comment 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_review_comment_ab2.sql from github_superset_pull_requests/_links/review_comment 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_review_comment_ab3.sql from github_superset_pull_requests/_links/review_comment 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_pull_requests__links_review_comment.sql from github_superset_pull_requests/_links/review_comment 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_review_comments_ab1.sql from github_superset_pull_requests/_links/review_comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_review_comments_ab2.sql from github_superset_pull_requests/_links/review_comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_pull_requests__links_review_comments_ab3.sql from github_superset_pull_requests/_links/review_comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_pull_requests__links_review_comments.sql from github_superset_pull_requests/_links/review_comments 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_reviews__links_html_ab1.sql from github_superset_reviews/_links/html 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_reviews__links_html_ab2.sql from github_superset_reviews/_links/html 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_reviews__links_html_ab3.sql from github_superset_reviews/_links/html 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_reviews__links_html.sql from github_superset_reviews/_links/html 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_reviews__links_pull_request_ab1.sql from github_superset_reviews/_links/pull_request 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_reviews__links_pull_request_ab2.sql from github_superset_reviews/_links/pull_request 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_ctes/base/github_superset_reviews__links_pull_request_ab3.sql from github_superset_reviews/_links/pull_request 2021-07-07 18:37:55 INFO () LineGobbler(voidCall):85 - Generating airbyte_tables/base/github_superset_reviews__links_pull_request.sql from github_superset_reviews/_links/pull_request 2021-07-07 18:37:57 INFO () LineGobbler(voidCall):85 - Running with dbt=0.19.1 2021-07-07 18:38:00 INFO () LineGobbler(voidCall):85 - [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2021-07-07 18:38:00 INFO () LineGobbler(voidCall):85 - There are 1 unused configuration paths: 2021-07-07 18:38:00 INFO () LineGobbler(voidCall):85 - - models.airbyte_utils.generated.airbyte_views 2021-07-07 18:38:00 INFO () LineGobbler(voidCall):85 - 2021-07-07 18:38:00 INFO () LineGobbler(voidCall):85 - Found 156 models, 0 tests, 0 snapshots, 0 analyses, 382 macros, 0 operations, 0 seed files, 16 sources, 0 exposures 2021-07-07 18:38:00 INFO () LineGobbler(voidCall):85 - 2021-07-07 18:38:01 INFO () LineGobbler(voidCall):85 - 18:38:01 | Concurrency: 32 threads (target='prod') 2021-07-07 18:38:01 INFO () LineGobbler(voidCall):85 - 18:38:01 | 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 1 of 39 START table model base.github_superset_issue_events.................................................. [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 3 of 39 START table model base.github_superset_collaborators................................................. [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 4 of 39 START table model base.github_superset_reviews....................................................... [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 7 of 39 START table model base.github_superset_releases...................................................... [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 2 of 39 START table model base.github_superset_issues........................................................ [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 5 of 39 START table model base.github_superset_teams......................................................... [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 6 of 39 START table model base.github_superset_stargazers.................................................... [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 12 of 39 START table model base.github_superset_comments..................................................... [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 9 of 39 START table model base.github_superset_issue_milestones.............................................. [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 10 of 39 START table model base.github_superset_projects..................................................... [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 8 of 39 START table model base.github_superset_issue_labels.................................................. [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 13 of 39 START table model base.github_superset_events....................................................... [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 14 of 39 START table model base.github_superset_commits...................................................... [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 11 of 39 START table model base.github_superset_assignees.................................................... [RUN] 2021-07-07 18:38:02 INFO () LineGobbler(voidCall):85 - 18:38:02 | 15 of 39 START table model base.github_superset_commit_comments.............................................. [RUN] 2021-07-07 18:38:03 INFO () LineGobbler(voidCall):85 - 18:38:03 | 16 of 39 START table model base.github_superset_pull_requests................................................ [RUN] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 3 of 39 OK created table model base.github_superset_collaborators............................................ [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.92s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 17 of 39 START table model base.github_superset_collaborators_permissions.................................... [RUN] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 2 of 39 OK created table model base.github_superset_issues................................................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 3.08s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 15 of 39 OK created table model base.github_superset_commit_comments......................................... [CREATE TABLE (131.0 rows, 90.2 KB processed) in 2.92s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 7 of 39 OK created table model base.github_superset_releases................................................. [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 3.12s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 18 of 39 START table model base.github_superset_issues_pull_request.......................................... [RUN] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 11 of 39 OK created table model base.github_superset_assignees............................................... [CREATE TABLE (61.0 rows, 57.6 KB processed) in 3.10s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 8 of 39 OK created table model base.github_superset_issue_labels............................................. [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 3.19s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 19 of 39 START table model base.github_superset_releases_assets.............................................. [RUN] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 12 of 39 OK created table model base.github_superset_comments................................................ [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 3.29s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 5 of 39 OK created table model base.github_superset_teams.................................................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 3.31s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 10 of 39 OK created table model base.github_superset_projects................................................ [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 3.26s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 13 of 39 OK created table model base.github_superset_events.................................................. [CREATE TABLE (229.0 rows, 1.9 MB processed) in 3.23s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 4 of 39 OK created table model base.github_superset_reviews.................................................. [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 3.35s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 1 of 39 OK created table model base.github_superset_issue_events............................................. [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 3.74s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 6 of 39 OK created table model base.github_superset_stargazers............................................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 3.36s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 9 of 39 OK created table model base.github_superset_issue_milestones......................................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 3.30s] 2021-07-07 18:38:05 INFO () LineGobbler(voidCall):85 - 18:38:05 | 20 of 39 START table model base.github_superset_reviews__links............................................... [RUN] 2021-07-07 18:38:06 INFO () LineGobbler(voidCall):85 - 18:38:06 | 16 of 39 OK created table model base.github_superset_pull_requests........................................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 3.03s] 2021-07-07 18:38:06 INFO () LineGobbler(voidCall):85 - 18:38:06 | 21 of 39 START table model base.github_superset_pull_requests__links......................................... [RUN] 2021-07-07 18:38:06 INFO () LineGobbler(voidCall):85 - 18:38:06 | 22 of 39 START table model base.github_superset_pull_requests_base........................................... [RUN] 2021-07-07 18:38:06 INFO () LineGobbler(voidCall):85 - 18:38:06 | 23 of 39 START table model base.github_superset_pull_requests_head........................................... [RUN] 2021-07-07 18:38:07 INFO () LineGobbler(voidCall):85 - 18:38:07 | 17 of 39 OK created table model base.github_superset_collaborators_permissions............................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.37s] 2021-07-07 18:38:07 INFO () LineGobbler(voidCall):85 - 18:38:07 | 18 of 39 OK created table model base.github_superset_issues_pull_request..................................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.17s] 2021-07-07 18:38:08 INFO () LineGobbler(voidCall):85 - 18:38:08 | 19 of 39 OK created table model base.github_superset_releases_assets......................................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.26s] 2021-07-07 18:38:08 INFO () LineGobbler(voidCall):85 - 18:38:08 | 23 of 39 OK created table model base.github_superset_pull_requests_head...................................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.07s] 2021-07-07 18:38:08 INFO () LineGobbler(voidCall):85 - 18:38:08 | 22 of 39 OK created table model base.github_superset_pull_requests_base...................................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.16s] 2021-07-07 18:38:08 INFO () LineGobbler(voidCall):85 - 18:38:08 | 20 of 39 OK created table model base.github_superset_reviews__links.......................................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.51s] 2021-07-07 18:38:08 INFO () LineGobbler(voidCall):85 - 18:38:08 | 24 of 39 START table model base.github_superset_reviews__links_html.......................................... [RUN] 2021-07-07 18:38:08 INFO () LineGobbler(voidCall):85 - 18:38:08 | 25 of 39 START table model base.github_superset_reviews__links_pull_request.................................. [RUN] 2021-07-07 18:38:08 INFO () LineGobbler(voidCall):85 - 18:38:08 | 21 of 39 OK created table model base.github_superset_pull_requests__links.................................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.52s] 2021-07-07 18:38:08 INFO () LineGobbler(voidCall):85 - 18:38:08 | 26 of 39 START table model base.github_superset_pull_requests__links_comments................................ [RUN] 2021-07-07 18:38:08 INFO () LineGobbler(voidCall):85 - 18:38:08 | 27 of 39 START table model base.github_superset_pull_requests__links_html.................................... [RUN] 2021-07-07 18:38:08 INFO () LineGobbler(voidCall):85 - 18:38:08 | 28 of 39 START table model base.github_superset_pull_requests__links_review_comment.......................... [RUN] 2021-07-07 18:38:09 INFO () LineGobbler(voidCall):85 - 18:38:08 | 29 of 39 START table model base.github_superset_pull_requests__links_issue................................... [RUN] 2021-07-07 18:38:09 INFO () LineGobbler(voidCall):85 - 18:38:08 | 30 of 39 START table model base.github_superset_pull_requests__links_commits................................. [RUN] 2021-07-07 18:38:09 INFO () LineGobbler(voidCall):85 - 18:38:08 | 31 of 39 START table model base.github_superset_pull_requests__links_statuses................................ [RUN] 2021-07-07 18:38:09 INFO () LineGobbler(voidCall):85 - 18:38:09 | 32 of 39 START table model base.github_superset_pull_requests__links_review_comments......................... [RUN] 2021-07-07 18:38:09 INFO () LineGobbler(voidCall):85 - 18:38:09 | 14 of 39 OK created table model base.github_superset_commits................................................. [CREATE TABLE (7.8k rows, 15.5 MB processed) in 6.43s] 2021-07-07 18:38:09 INFO () LineGobbler(voidCall):85 - 18:38:09 | 33 of 39 START table model base.github_superset_pull_requests__links_self.................................... [RUN] 2021-07-07 18:38:09 INFO () LineGobbler(voidCall):85 - 18:38:09 | 34 of 39 START table model base.github_superset_commits_commit............................................... [RUN] 2021-07-07 18:38:09 INFO () LineGobbler(voidCall):85 - 18:38:09 | 35 of 39 START table model base.github_superset_commits_parents.............................................. [RUN] 2021-07-07 18:38:10 INFO () LineGobbler(voidCall):85 - 18:38:10 | 24 of 39 OK created table model base.github_superset_reviews__links_html..................................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.03s] 2021-07-07 18:38:10 INFO () LineGobbler(voidCall):85 - 18:38:10 | 25 of 39 OK created table model base.github_superset_reviews__links_pull_request............................. [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.24s] 2021-07-07 18:38:11 INFO () LineGobbler(voidCall):85 - 18:38:11 | 29 of 39 OK created table model base.github_superset_pull_requests__links_issue.............................. [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.35s] 2021-07-07 18:38:11 INFO () LineGobbler(voidCall):85 - 18:38:11 | 28 of 39 OK created table model base.github_superset_pull_requests__links_review_comment..................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.52s] 2021-07-07 18:38:11 INFO () LineGobbler(voidCall):85 - 18:38:11 | 33 of 39 OK created table model base.github_superset_pull_requests__links_self............................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.50s] 2021-07-07 18:38:11 INFO () LineGobbler(voidCall):85 - 18:38:11 | 26 of 39 OK created table model base.github_superset_pull_requests__links_comments........................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.73s] 2021-07-07 18:38:11 INFO () LineGobbler(voidCall):85 - 18:38:11 | 30 of 39 OK created table model base.github_superset_pull_requests__links_commits............................ [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.69s] 2021-07-07 18:38:11 INFO () LineGobbler(voidCall):85 - 18:38:11 | 31 of 39 OK created table model base.github_superset_pull_requests__links_statuses........................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.74s] 2021-07-07 18:38:11 INFO () LineGobbler(voidCall):85 - 18:38:11 | 32 of 39 OK created table model base.github_superset_pull_requests__links_review_comments.................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 2.94s] 2021-07-07 18:38:12 INFO () LineGobbler(voidCall):85 - 18:38:12 | 35 of 39 OK created table model base.github_superset_commits_parents......................................... [CREATE TABLE (8.0k rows, 2.2 MB processed) in 2.68s] 2021-07-07 18:38:12 INFO () LineGobbler(voidCall):85 - 18:38:12 | 27 of 39 OK created table model base.github_superset_pull_requests__links_html............................... [CREATE TABLE (0.0 rows, 0.0 Bytes processed) in 3.38s] 2021-07-07 18:38:13 INFO () LineGobbler(voidCall):85 - 18:38:13 | 34 of 39 OK created table model base.github_superset_commits_commit.......................................... [CREATE TABLE (7.8k rows, 9.4 MB processed) in 3.64s] 2021-07-07 18:38:13 INFO () LineGobbler(voidCall):85 - 18:38:13 | 36 of 39 START table model base.github_superset_commits_commit_committer..................................... [RUN] 2021-07-07 18:38:13 INFO () LineGobbler(voidCall):85 - 18:38:13 | 38 of 39 START table model base.github_superset_commits_commit_author........................................ [RUN] 2021-07-07 18:38:13 INFO () LineGobbler(voidCall):85 - 18:38:13 | 37 of 39 START table model base.github_superset_commits_commit_tree.......................................... [RUN] 2021-07-07 18:38:13 INFO () LineGobbler(voidCall):85 - 18:38:13 | 39 of 39 START table model base.github_superset_commits_commit_verification.................................. [RUN] 2021-07-07 18:38:15 INFO () LineGobbler(voidCall):85 - 18:38:15 | 36 of 39 OK created table model base.github_superset_commits_commit_committer................................ [CREATE TABLE (7.8k rows, 971.8 KB processed) in 2.18s] 2021-07-07 18:38:15 INFO () LineGobbler(voidCall):85 - 18:38:15 | 38 of 39 OK created table model base.github_superset_commits_commit_author................................... [CREATE TABLE (7.8k rows, 1.0 MB processed) in 2.43s] 2021-07-07 18:38:15 INFO () LineGobbler(voidCall):85 - 18:38:15 | 39 of 39 OK created table model base.github_superset_commits_commit_verification............................. [CREATE TABLE (7.8k rows, 4.3 MB processed) in 2.76s] 2021-07-07 18:38:16 INFO () LineGobbler(voidCall):85 - 18:38:16 | 37 of 39 OK created table model base.github_superset_commits_commit_tree..................................... [CREATE TABLE (7.8k rows, 1.5 MB processed) in 3.09s] 2021-07-07 18:38:16 INFO () LineGobbler(voidCall):85 - 18:38:16 | 2021-07-07 18:38:16 INFO () LineGobbler(voidCall):85 - 18:38:16 | Finished running 39 table models in 15.82s. 2021-07-07 18:38:16 INFO () LineGobbler(voidCall):85 - 2021-07-07 18:38:16 INFO () LineGobbler(voidCall):85 - Completed successfully 2021-07-07 18:38:16 INFO () LineGobbler(voidCall):85 - 2021-07-07 18:38:16 INFO () LineGobbler(voidCall):85 - Done. PASS=39 WARN=0 ERROR=0 SKIP=0 TOTAL=39 2021-07-07 18:38:16 INFO () DefaultNormalizationWorker(run):77 - Normalization executed in 0. 2021-07-07 18:38:16 INFO () TemporalAttemptExecution(get):133 - Stopping cancellation check scheduling... ```
## Steps to Reproduce 1. create native github source using apache/superset to clone 2. postgres as destination 3. sync connection using incremental + dedup when stream allows ## Are you willing to submit a PR?

Not at the moment

marcosmarxm commented 3 years ago

After removing both events streams look the sync is processing. image image

logs-8-0 (1).txt

Zirochkaa commented 3 years ago

Need to implement rate limit handling. An example may be found here. Also IssueEvents stream has wrong cursor_field.

garden-of-delete commented 3 years ago

Any update on this?

Short term work-around has been to disable the events and issue_events streams.

If there is also a problem with rate-limiting, it would be good for that to be confirmed.

marcosmarxm commented 3 years ago

@Zirochkaa can you update the status? The PR is almost finished, as far I saw.

Zirochkaa commented 3 years ago

Hello :) Yes, it's almost done. There were few issues:

All of the above issues are fixed now.

Right now I'm working on optimizing PullRequests stream (the way how we read for the first time and subsequent times). Code should be on code review today.

keu commented 3 years ago

Hi @garden-of-delete , We just released version 0.1.2. You can upgrade your connector from the Admin page. Please let us if the issue was fixed. Thanks

garden-of-delete commented 3 years ago

@keu Thanks so much! Will get into testing and report back tomorrow.