airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.07k stars 4.11k forks source link

New Source: Google Play Reports #2974

Open sherifnada opened 3 years ago

sherifnada commented 3 years ago

Tell us about the new integration you’d like to have

Users want to get their Google Play reports via Airbyte so they can understand their Android app's performance.

reports are available here: https://support.google.com/googleplay/android-developer/answer/6135870

Describe the context around this new integration

Describe the alternative you are considering or using

What are you considering doing if you don’t have this integration through Airbyte?

┆Issue is synchronized with this Asana task by Unito

winzee commented 3 years ago

Hi, this is used by the marketing team and the product team. Data comes in daily, so it should be able to import data daily. We export these files to BigQuery.

Be wary when you implement this as some older files can be overwritten with the same or new data regularly: so it's best practice to check the hash code of the files provided by Google Cloud Storage to watch for change and be ready to process the changes. I don't have notes on this, but I think I noticed this on the Buyers (7 day after install) files (see end of this page). (ps: if I got the wrong file, just check for some files concerning old data that have a recent timestamp, they were really easy to spot once you knew you had to watch out for them.)

Being able to select which tables we import is paramount. There are a lot of them and some contains millions of rows which can be of not interest at all to many users.

Also be mindful that as of this writing, April 2021, they retired some reports and introduced new ones: "The Retained Installers and Buyers reports provides programmatic access to data for the old acquisition report. This export will be turned off on August 1 2021 and a new programmatic export, which includes data for the Store analysis and Conversion analysis pages introduced in the new Play Console, will be made available in March 2021." See the "User Acquisition" section.

sherifnada commented 3 years ago

@winzee thanks for the context!

igrankova commented 3 years ago

@sherifnada, I have three blockers in this task:

  1. We don't have an Application that allows to generate test reports
  2. There's a payment 25$ we need to register developer account on the Play Console, without this registration I can't send an e-mail to google support and even ask for sandbox. To send an e-mail there needed the developer ID to be entered and it's required, this ID can be received only after the registration and one-time payment 25$."
Diana-Vait commented 1 year ago

"Webhook-based? (no/partially/yes) Partially

Available authentication modes (API key/Oauth/other) Basic access: API key and OAuth 2.0 Configure OAuth and Service Accounts

Has Sandbox environment? No predefined sandbox. Created a free account. LastPasss: Google Pay Console Sandbox Account

How to populate the account with data UI, API: https://developers.google.com/android-publisher/api-ref/rest

Available streams for sync applications.deviceTierConfigs edits edits.apks edits.bundles edits.countryavailability edits.details edits.expansionfiles edits.images edits.listings edits.testers edits.tracks generatedapks inappproducts monetization.subscriptions monetization.subscriptions.basePlans.offers purchases.products purchases.subscriptions purchases.subscriptionsv2 purchases.voidedpurchases reviews systemapks.variants users

Integration supports incremental sync? No

Other information/blockers API has a default limit of 200,000 queries per day. https://developers.google.com/android-publisher/quotas "

ysusuk commented 1 year ago

Hello, @Diana-Vait!

I was wondering if there might be any new updates regarding this ticket?

Gordi90 commented 12 months ago

Hi everyone!

If it helps, I'm more than happy to help with a dev account. I'm willing to pay the Google fees if necessary. I can upload a simple app and provide console and API access to the airbyte team.