Open dsprayberry opened 3 years ago
@dylan-stitch @cmerrick I have a fix in #4 , I tested the tap locally.
I did notice there were additional fields from the API not in the schema, I added a couple I saw here, but this should probably be audited for field additions to Zoom's API.
I am experiencing the same error. Are there any plans to merge the fix?
This is still an issue, even if you choose not to track the users
table. The integration simply doesn't work at the moment.
@kekoav @jdotjdot @adamluba1: Is this issue still persists?
A Zoom integration running tap-zoom version 0.0.1 encountered schema violations during transformation, seemingly from the report_webinars stream based on the included fields, though the affected stream is unclear from the exception. Selected streams for this connection include:
Full traceback:
2020-09-14 17:01:04,910Z tap - Traceback (most recent call last): 2020-09-14 17:01:04,911Z tap - File "tap-env/bin/tap-zoom", line 33, in
2020-09-14 17:01:04,911Z tap - sys.exit(load_entry_point('tap-zoom==0.0.1', 'console_scripts', 'tap-zoom')())
2020-09-14 17:01:04,911Z tap - File "/code/orchestrator/tap-env/lib/python3.5/site-packages/singer/utils.py", line 229, in wrapped
2020-09-14 17:01:04,911Z tap - return fnc(*args, **kwargs)
2020-09-14 17:01:04,911Z tap - File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_zoom/init.py", line 41, in main
2020-09-14 17:01:04,911Z tap - parsed_args.state)
2020-09-14 17:01:04,911Z tap - File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_zoom/sync.py", line 138, in sync
2020-09-14 17:01:04,911Z tap - {})
2020-09-14 17:01:04,911Z tap - File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_zoom/sync.py", line 89, in sync_endpoint
2020-09-14 17:01:04,911Z tap - child_key_bag)
2020-09-14 17:01:04,911Z tap - File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_zoom/sync.py", line 89, in sync_endpoint
2020-09-14 17:01:04,911Z tap - child_key_bag)
2020-09-14 17:01:04,911Z tap - File "/code/orchestrator/tap-env/lib/python3.5/site-packages/tap_zoom/sync.py", line 72, in sync_endpoint
2020-09-14 17:01:04,911Z tap - mdata)
2020-09-14 17:01:04,912Z tap - File "/code/orchestrator/tap-env/lib/python3.5/site-packages/singer/transform.py", line 140, in transform
2020-09-14 17:01:04,912Z tap - raise SchemaMismatch(self.errors)
2020-09-14 17:01:04,912Z tap - singer.transform.SchemaMismatch: Errors during transform
2020-09-14 17:01:04,912Z tap - dept: data does not match {'type': ['integer', 'null'], 'selected': True, 'inclusion': 'available'}
2020-09-14 17:01:04,912Z tap - : data does not match {'type': 'object', 'selected': True, 'additionalProperties': False, 'properties': {'id': {'type': ['integer'], 'selected': True, 'inclusion': 'available'}, 'user_email': {'type': ['string', 'null'], 'selected': True, 'inclusion': 'available'}, 'dept': {'type': ['integer', 'null'], 'selected': True, 'inclusion': 'available'}, 'tracking_fields': {'type': ['array', 'null'], 'selected': True, 'items': {'type': ['object'], 'additionalProperties': False, 'properties': {'value': {'type': ['null', 'string']}, 'field': {'type': ['null', 'string']}}}, 'inclusion': 'available'}, 'webinar_id': {'type': ['string'], 'selected': True, 'inclusion': 'available'}, 'duration': {'type': ['integer', 'null'], 'selected': True, 'inclusion': 'available'}, 'total_minutes': {'type': ['integer', 'null'], 'selected': True, 'inclusion': 'available'}, 'type': {'type': ['integer', 'null'], 'selected': True, 'inclusion': 'available'}, 'start_time': {'type': ['string', 'null'], 'selected': True, 'inclusion': 'available', 'format': 'date-time'}, 'topic': {'type': ['string', 'null'], 'selected': True, 'inclusion': 'available'}, 'end_time': {'type': ['string', 'null'], 'selected': True, 'inclusion': 'available', 'format': 'date-time'}, 'user_name': {'type': ['string', 'null'], 'selected': True, 'inclusion': 'available'}, 'uuid': {'type': ['string'], 'selected': True, 'inclusion': 'automatic'}, 'participants_count': {'type': ['integer', 'null'], 'selected': True, 'inclusion': 'available'}}}
2020-09-14 17:01:04,912Z tap -
2020-09-14 17:01:04,912Z tap -
2020-09-14 17:01:04,912Z tap - Errors during transform: [dept: data does not match {'type': ['integer', 'null'], 'selected': True, 'inclusion': 'available'}, : data does not match {'type': 'object', 'selected': True, 'additionalProperties': False, 'properties': {'id': {'type': ['integer'], 'selected': True, 'inclusion': 'available'}, 'user_email': {'type': ['string', 'null'], 'selected': True, 'inclusion': 'available'}, 'dept': {'type': ['integer', 'null'], 'selected': True, 'inclusion': 'available'}, 'tracking_fields': {'type': ['array', 'null'], 'selected': True, 'items': {'type': ['object'], 'additionalProperties': False, 'properties': {'value': {'type': ['null', 'string']}, 'field': {'type': ['null', 'string']}}}, 'inclusion': 'available'}, 'webinar_id': {'type': ['string'], 'selected': True, 'inclusion': 'available'}, 'duration': {'type': ['integer', 'null'], 'selected': True, 'inclusion': 'available'}, 'total_minutes': {'type': ['integer', 'null'], 'selected': True, 'inclusion': 'available'}, 'type': {'type': ['integer', 'null'], 'selected': True, 'inclusion': 'available'}, 'start_time': {'type': ['string', 'null'], 'selected': True, 'inclusion': 'available', 'format': 'date-time'}, 'topic': {'type': ['string', 'null'], 'selected': True, 'inclusion': 'available'}, 'end_time': {'type': ['string', 'null'], 'selected': True, 'inclusion': 'available', 'format': 'date-time'}, 'user_name': {'type': ['string', 'null'], 'selected': True, 'inclusion': 'available'}, 'uuid': {'type': ['string'], 'selected': True, 'inclusion': 'automatic'}, 'participants_count': {'type': ['integer', 'null'], 'selected': True, 'inclusion': 'available'}}}]
Full extraction logs in case they're helpful: