singer-io / tap-appsflyer

A Singer.io tap for extracting data from the AppsFlyer API
GNU Affero General Public License v3.0
11 stars 40 forks source link

Android AppsFlyer Events Issue #10

Closed bmmayer closed 6 years ago

bmmayer commented 6 years ago

We're getting this log error every day. Is there any way we can fix the malformed request ASAP?

2018-09-04 13:57:15,555Z   main - INFO Running tap-appsflyer version 0.0.8 and target-stitch version 1.7.4
2018-09-04 13:57:15,724Z   main - DEBUG Getting initial state
2018-09-04 13:57:15,782Z   main - INFO Starting tap: tap-env/bin/tap-appsflyer --config /tmp/tap_config.json --state /tmp/tap_state.json
2018-09-04 13:57:15,802Z   main - INFO Starting target: target-env/bin/target-stitch --config /tmp/target_config.json
2018-09-04 13:57:16,337Z    tap - INFO do_sync()
2018-09-04 13:57:16,341Z    tap - INFO Starting sync. Will sync these streams: ['in_app_events']
2018-09-04 13:57:16,343Z    tap - INFO Syncing in_app_events
2018-09-04 13:57:16,352Z    tap - INFO Syncing data from 2018-09-04 01:56:40 to 2018-09-04 13:57:16.345161
2018-09-04 13:57:16,365Z    tap - INFO GET https://hq.appsflyer.com/export/com.wayup_rn/in_app_events_report/v5?from=2018-09-04+01%3A56&to=2018-09-04+13%3A57&api_token=....................................
2018-09-04 13:57:16,450Z target - INFO Using Stitch import URL https://api.stitchdata.com/v2/import/batch
2018-09-04 13:57:16,946Z    tap - INFO STATS: {"source": "in_app_events", "duration": 0.5804538726806641, "status": "succeeded", "http_status_code": 400}
2018-09-04 13:57:16,947Z    tap - ERROR GET https://hq.appsflyer.com/export/com.wayup_rn/in_app_events_report/v5?from=2018-09-04+01%3A56&to=2018-09-04+13%3A57&api_token=.................................... [400 - b'400 Bad Request\n\nThe server could not comply with the request since it is either malformed or otherwise incorrect.\n\n\nReport timezone: GMT | Max line count: 200K | Oldest available data: 90 Days ago. Max requests 12 per day per app, 60 per account in total.\n\n']
2018-09-04 13:57:16,995Z target - INFO Exiting normally
2018-09-04 13:57:17,090Z   main - INFO Target exited normally with status 0
2018-09-04 13:57:17,099Z   main - INFO Exit status is: Tap failed with code 1. Target succeeded.
nick-mccoy commented 6 years ago

This should be fixed by https://github.com/singer-io/tap-appsflyer/pull/11.

It may take up to a day until you see this resolved since an infinite loop was causing this stream to request the same thing until it hit the daily quota.