singer-io / tap-appsflyer

A Singer.io tap for extracting data from the AppsFlyer API
GNU Affero General Public License v3.0
11 stars 40 forks source link

Missing media source in install report #16

Closed thijsrohof closed 5 years ago

thijsrohof commented 5 years ago

I am only seeing installs from Googleadwords_int in my installs report. Installs from media source: Facebook ads is not showing up. I can see facebook installs in my Appsflyer dashboard. Any clue why this is not showing up in this report?

Extraction logs:

2019-01-02 08:04:10,777Z   main - INFO Running tap-appsflyer version 0.0.11 and target-stitch version 1.8.1
2019-01-02 08:04:10,898Z   main - INFO Starting tap: tap-env/bin/tap-appsflyer --config /tmp/tap_config.json --state /tmp/tap_state.json
2019-01-02 08:04:10,900Z   main - INFO Starting target: target-env/bin/target-stitch --config /tmp/target_config.json
2019-01-02 08:04:11,062Z    tap - INFO do_sync()
2019-01-02 08:04:11,062Z    tap - INFO Starting sync. Will sync these streams: ['installs', 'in_app_events']
2019-01-02 08:04:11,063Z    tap - INFO Syncing installs
2019-01-02 08:04:11,064Z    tap - INFO GET https://hq.appsflyer.com/export/nl.tellow.app/installs_report/v5?api_token=....................................&from=2019-01-02+01%3A59&to=2019-01-02+08%3A04
2019-01-02 08:04:11,139Z target - INFO Using Stitch import URL https://api.stitchdata.com/v2/import/batch
2019-01-02 08:04:25,090Z    tap - INFO STATS: {"status": "succeeded", "source": "installs", "http_status_code": 200, "duration": 14.025520086288452}
2019-01-02 08:04:25,100Z    tap - INFO Syncing in_app_events
2019-01-02 08:04:25,101Z    tap - INFO Syncing data from 2019-01-01 23:50:37 to 2019-01-02 08:04:25.101130
2019-01-02 08:04:25,101Z target - INFO Sending batch with 16 messages for table installs to https://api.stitchdata.com/v2/import/batch
2019-01-02 08:04:25,101Z    tap - INFO GET https://hq.appsflyer.com/export/nl.tellow.app/in_app_events_report/v5?api_token=....................................&from=2019-01-01+23%3A50&to=2019-01-02+08%3A04
2019-01-02 08:04:25,368Z   main - INFO State update: adding in_app_events = "2019-01-01T23:50:37Z"
2019-01-02 08:04:25,368Z   main - INFO State update: adding installs = "2019-01-02T07:02:19Z"
2019-01-02 08:04:25,368Z   main - INFO State update: adding this_stream = "installs"
2019-01-02 08:04:49,985Z    tap - INFO STATS: {"status": "succeeded", "source": "in_app_events", "http_status_code": 200, "duration": 24.883780479431152}
2019-01-02 08:04:49,988Z    tap - INFO Sync completed
2019-01-02 08:04:50,024Z target - INFO Sending batch with 5 messages for table in_app_events to https://api.stitchdata.com/v2/import/batch
2019-01-02 08:04:50,164Z   main - INFO State update: changing in_app_events from "2019-01-01T23:50:37Z" to "2019-01-02T06:49:20Z"
2019-01-02 08:04:50,164Z   main - INFO State update: changing this_stream from "installs" to null
2019-01-02 08:04:50,165Z target - INFO Exiting normally
2019-01-02 08:04:50,219Z   main - INFO Target exited normally with status 0
2019-01-02 08:04:50,222Z   main - INFO Exit status is: Tap succeeded. Target succeeded.
KAllan357 commented 5 years ago

Hi @thijsrohof. I looked through the code and don't see any reason why this data would not be emitted. Is it because those installs are before your initial start_date?

One option is to attempt to use the tap locally using a config file that contains your app_id and api_token. Could you try that and let me know if you see the data you are looking for?

luandy64 commented 5 years ago

I'm closing this for inactivity. @thijsrohof if you get around to the things @KAllan357 asked for, then feel free to reopen this then.