airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.53k stars 4k forks source link

New source: Qualtrics #2124

Closed rstuart85 closed 7 months ago

rstuart85 commented 3 years ago

Tell us about the new integration you’d like to have

Which source and which destination? Which frequency?

Qualtrics as the source. Amazon S3 as the destination. 15 minutes frequency.

Describe the context around this new integration

Which team in your company wants this integration, what for? This helps us understand the use case.

Customer Insights / Customer Experience team. They want the survey response data in a warehouse so they can visualise it using standard BI/EI tools.

Describe the alternative you are considering or using

What are you considering doing if you don’t have this integration through Airbyte?

We've used their API directly for now. They also support exporting survey responses via CSV.

┆Issue is synchronized with this Asana task by Unito

michel-tricot commented 3 years ago

Thank you @rstuart85 for creating the issue!

are we talking about this API: https://api.qualtrics.com/api-reference/ ?

are there any models that you deem are higher priority?

wallies commented 3 years ago

@michel-tricot I would say the survey responses probably sits highest. I think it's done via the export api https://api.qualtrics.com/guides/docs/Guides/Common%20Tasks/getting-survey-responses-via-the-new-export-apis.md

michel-tricot commented 3 years ago

Thank you @wallies!

How are you doing it today?

wallies commented 3 years ago

@michel-tricot using the export api for surveys but as we are looking into more integration sources, we are looking into better tooling

vitaliizazmic commented 3 years ago

Integration Vetting

The integration has already been vetted

Webhook-based? (no/partially/yes) No

Available authentication modes (API key/Oauth/other) The Qualtrics API provides an API token based authentication system. To authenticate using a valid token, include your token under the HTTP header X-API-TOKEN.

Creating an account Needs account. Qualtrics REST API is a Paid Feature. The API is an additional feature. If you are unsure if your account has API access, please contact the Qualtrics Administrator at your organization. If you are the Qualtrics Administrator please contact your sales representative at Qualtrics to discuss licensing for API access.

How to populate the account with data? Some streams can be populated via API, but it is needs account to answer this question.

Available streams for sync Event Types Events Directories

Distributions

Subscriptions

Groups

Mailing Lists

Requests SMS Distribution Surveys Tickets Users

WhatsApp Distribution

Integration supports incremental sync? Some

Other information/blockers Singer Tap doesn't exist

kyle-cheung commented 2 years ago

+1!

davelindley commented 2 years ago

+1 - if credentials are needed to unblock/reproduce I can provide a dev environment to the respective devs.

vincentkoc commented 1 year ago

Following

igrankova commented 1 year ago

Hi everyone! need help here. Can't reach the support to ask for API access.

vincentkoc commented 1 year ago

@igrankova DM me on Airbye slack 👍, I'm an enterprise customer

JenniWhitman commented 1 year ago

Hey there! We have a need for this connector as well and i have a working Qualtrics account so I can take on the work to build the connector!

igrankova commented 1 year ago

@YowanR we have a contributor here, @JenniWhitman wants to start this connector development, the sandbox is on the way to be set up.

YowanR commented 1 year ago

Hi all! It's exciting to see so much enthusiasm for this connector! It looks like @koconder claimed this issue first so Vincent, are you planning to work on this connector? If not, then we can assign this one to @JenniWhitman. We're doing our best on our side to get our sandbox account set up so we can test and maintain this connector going forward.

vincentkoc commented 1 year ago

@YowanR I would like to work on this as an Airbyte Contiburor, I have been working with Airbyte and Qualtrics partnership team to secure the API/Sandbox. I would like to finish by developing the connector if this is OK?

JenniWhitman commented 1 year ago

No worries @koconder ! I'll keep watching the issue so we know when it's resolved/if I can help in any way :)

igrankova commented 1 year ago

@koconder hi! thank you very much for help. I received an account, LastPass name: Qualtrics partner account

igrankova commented 1 year ago

LastPass name: Qualtrics partner account API Token: https://airbytepartner.qualtrics.com/Q/QualtricsIdsSection/IdsSection API Docs

YowanR commented 1 year ago

Circling back here @koconder, are you still planning to work on this connector?

vincentkoc commented 1 year ago

@YowanR I have started work on this already, will try to give an ETA :)

seanglynn-thrive commented 1 year ago

@YowanR I have started work on this already, will try to give an ETA :)

Hey @koconder how is the development going? I can assist if needed :)

currents-abhishek commented 1 year ago

hi @koconder - thanks for taking this up! Is there an ETA? Me and my team are eager to contribute if any help is needed.

btkcodedev commented 1 year ago

I would like to work on this issue

btkcodedev commented 10 months ago

Update: Waiting for test credentials from @koconder for resuming work

vincentkoc commented 10 months ago

@btkcodedev i cant share my own credentials, you are best to reach out to @igrankova @YowanR for test credentials if they have a partner account setup

btkcodedev commented 10 months ago

Sure!!, Thanks @koconder

btkcodedev commented 10 months ago

@igrankova Could you please send an email to Qualtrics about API token as its a paid feature. it would be useful for completing this issue