search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.78k stars 4.04k forks source link

:tada: Source Shopify: add visits data #8618

Open charbelrseif opened 2 years ago

charbelrseif commented 2 years ago

Tell us about the problem you're trying to solve

Shopify provides details on session information and unique visits. This allows you to understand conversion percentage. How many unique visits in a day result in a sale. It is important to understand traffic to a storefront and has been absolutely necessary since iOS 14.

Describe the solution you’d like

I would love to be able to pull this data.

Describe the alternative you’ve considered or used

No one on the market pulls this data

bazarnov commented 2 years ago

Seems like the Visits API has been deprecated for usage using direct API Calls (even with GraphQL), referred to this information: 1) https://community.shopify.com/c/shopify-apis-and-sdks/i-would-like-to-ask-if-there-is-an-api-to-get-the-number-of/td-p/933999 2) https://community.shopify.com/c/shopify-apis-and-sdks/how-to-get-total-sales-and-visitors-of-store/td-p/561932# 3) In GraphGL Explorer, there is no even analytics node nor visits node: https://shopify.dev/graphiql/admin-graphiql

@charbelrseif Could you please give us more information about how do you get the visits data at this moment on your side?

UPDATED: @sherifnada @misteryeo Assuming the Custom Reports could be fetched using Shopify's /admin/<api_version>/reports.json endpoint, we can predefine and fetch the ready-to-go custom report with the "visits and more" data, build once using UI. The blocker here is that this functionality requires Shopify Plus or Advanced plan. At this moment there is no way to test it out on our test-store. For more info check this page: https://shopify.dev/api/admin-rest/2022-01/resources/report#resource_description

misteryeo commented 2 years ago

Let's wait to hear from @charbelrseif on the question you posed first!

sherifnada commented 2 years ago

@bazarnov just to make sure we are aligned, this is not a blocking ticket for Beta certification as it's not required for feature parity w alternative solutions

misteryeo commented 2 years ago

@sherifnada We assigned this last sprint before we came to the agreement on beta :)

bazarnov commented 2 years ago

@bazarnov just to make sure we are aligned, this is not a blocking ticket for Beta certification as it's not required for feature parity w alternative solutions

Got your point, I was wondering what we could get from Shopify data, based on customer's request here.

misteryeo commented 2 years ago

No action required here until we hear from the user.

bazarnov commented 2 years ago

@charbelrseif could you please check this comment? https://github.com/airbytehq/airbyte/issues/8618#issuecomment-1034775763

octavia-squidington-iii commented 2 years ago

Marcos Marx commented: > @bazarnov just to make sure we are aligned, this is not a blocking ticket for Beta certification as it's not required for feature parity w alternative solutions

Got your point, I was wondering what we could get from Shopify data, based on customer's request here.

charbelrseif commented 2 years ago

Hey guys! I don't get the visits data currently, but it would be awesome to get it to be able to report attribution from Shopify. It looks like Shopify doesn't expose he visits API but a workaround would be to go through the /reports endpoint for Shopify plus users.

"At this moment there is no way to test it out on our test-store. For more info check this page: https://shopify.dev/api/admin-rest/2022-01/resources/report#resource_description" Isn't there a way to create a test store on a PLUS plan?

bazarnov commented 2 years ago

Hey guys! I don't get the visits data currently, but it would be awesome to get it to be able to report attribution from Shopify. It looks like Shopify doesn't expose he visits API but a workaround would be to go through the /reports endpoint for Shopify plus users.

"At this moment there is no way to test it out on our test-store. For more info check this page: https://shopify.dev/api/admin-rest/2022-01/resources/report#resource_description" Isn't there a way to create a test store on a PLUS plan?

@sherifnada WDYT about extending our plan coverage for Shopify account to have the possibility to add the reports streams?

sherifnada commented 2 years ago

@bazarnov were getting oauth approval from Shopify at the moment, let's wait to get that first then we'll apply for that access

bazarnov commented 2 years ago

@bazarnov were getting oauth approval from Shopify at the moment, let's wait to get that first then we'll apply for that access

Let's include reports stream enhancement for GA certification.

bazarnov commented 1 year ago

in order not to block the certification process, I'll detach this one from epic: https://github.com/airbytehq/airbyte/issues/10281