Closed BTheunissen closed 11 months ago
Really appreciate you looking into creating a Tap for the Shopify GraphQL API!
Unfortunately I am seeing the following error when running the tap with meltano invoke tap-shopify
meltano invoke tap-shopify
2023-08-02T18:36:40.054415Z [debug ] Invoking: ['/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/bin/tap-shopify', '--config', '/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/run/tap-shopify/tap.b0c88abd-4756-45c7-a3bd-1e2453131ca2.config.json', '--catalog', '/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/run/tap-shopify/tap.properties.json'] {"type": "STATE", "value": {}} 2023-08-02 14:36:40,450 | INFO | tap-shopify | Skipping deselected stream 'customers'. 2023-08-02 14:36:40,451 | INFO | tap-shopify | Skipping deselected stream 'fulfillment_orders'. 2023-08-02 14:36:40,452 | INFO | tap-shopify | Skipping deselected stream 'inventory_items'. 2023-08-02 14:36:40,454 | INFO | tap-shopify | Skipping deselected stream 'orders'. 2023-08-02 14:36:40,454 | INFO | tap-shopify | Beginning incremental sync of 'products'... 2023-08-02 14:36:40,454 | INFO | tap-shopify | Tap has custom mapper. Using 1 provided map(s). {"type": "SCHEMA", "stream": "products", "schema": {"properties": {"id": {"type": ["string", "null"]}, "updatedAt": {"format": "date-time", "type": ["string", "null"]}}, "type": "object"}, "key_properties": ["id"], "bookmark_properties": ["updatedAt"]} 2023-08-02 14:36:40,622 | INFO | singer_sdk.metrics | METRIC: {"type": "timer", "metric": "http_request_duration", "value": 0.162722, "tags": {"stream": "products", "endpoint": "", "http_status_code": 200, "status": "succeeded"}} 2023-08-02 14:36:40,622 | INFO | singer_sdk.metrics | METRIC: {"type": "counter", "metric": "http_request_count", "value": 1, "tags": {"stream": "products", "endpoint": ""}} 2023-08-02 14:36:40,622 | INFO | singer_sdk.metrics | METRIC: {"type": "timer", "metric": "sync_duration", "value": 0.16788911819458008, "tags": {"stream": "products", "context": {}, "status": "failed"}} 2023-08-02 14:36:40,622 | INFO | singer_sdk.metrics | METRIC: {"type": "counter", "metric": "record_count", "value": 0, "tags": {"stream": "products", "context": {}}} 2023-08-02 14:36:40,622 | ERROR | tap-shopify | An unhandled error occurred while syncing 'products' Traceback (most recent call last): File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/singer_sdk/streams/core.py", line 1175, in sync for _ in self._sync_records(context=context): File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/singer_sdk/streams/core.py", line 1070, in _sync_records for record_result in self.get_records(current_context): File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/singer_sdk/streams/rest.py", line 576, in get_records for record in self.request_records(context): File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/singer_sdk/streams/rest.py", line 400, in request_records yield from self.parse_response(resp) File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/tap_shopify/client_gql.py", line 63, in parse_response raise Exception(response["errors"]) Exception: [{'message': 'syntax error, unexpected RCURLY ("}") at [7, 13]', 'locations': [{'line': 7, 'column': 13}]}] Traceback (most recent call last): File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/bin/tap-shopify", line 8, in <module> sys.exit(TapShopify.cli()) File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/click/core.py", line 1157, in __call__ return self.main(*args, **kwargs) File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/click/core.py", line 1078, in main rv = self.invoke(ctx) File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/click/core.py", line 1434, in invoke return ctx.invoke(self.callback, **ctx.params) File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/click/core.py", line 783, in invoke return __callback(*args, **kwargs) File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/singer_sdk/tap_base.py", line 498, in invoke tap.sync_all() File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/singer_sdk/tap_base.py", line 456, in sync_all stream.sync() File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/singer_sdk/streams/core.py", line 1182, in sync raise ex File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/singer_sdk/streams/core.py", line 1175, in sync for _ in self._sync_records(context=context): File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/singer_sdk/streams/core.py", line 1070, in _sync_records for record_result in self.get_records(current_context): File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/singer_sdk/streams/rest.py", line 576, in get_records for record in self.request_records(context): File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/singer_sdk/streams/rest.py", line 400, in request_records yield from self.parse_response(resp) File "/Users/benjamintheunissen/Dev/Shaped/shaped-meltano/.meltano/extractors/tap-shopify/venv/lib/python3.9/site-packages/tap_shopify/client_gql.py", line 63, in parse_response raise Exception(response["errors"]) Exception: [{'message': 'syntax error, unexpected RCURLY ("}") at [7, 13]', 'locations': [{'line': 7, 'column': 13}]}]
My Meltano configuration for the tap is as follows, aiming only to sync the Products stream:
- name: tap-shopify variant: sehnem pip_url: git+https://github.com/sehnem/tap-shopify.git config: store: {SECRET} access_token: {SECRET} select: - products
I can help with any additional information to assist with debugging!
Really appreciate you looking into creating a Tap for the Shopify GraphQL API!
Unfortunately I am seeing the following error when running the tap with
meltano invoke tap-shopifyMy Meltano configuration for the tap is as follows, aiming only to sync the Products stream:
I can help with any additional information to assist with debugging!