New Source: Salesforce Marketing Cloud

sherifnada commented 3 years ago

Tell us about the new connector you’d like to have

https://www.salesforce.com/products/marketing-cloud/overview/

Describe the context around this new connector

Describe the alternative you are considering or using

igrankova commented 3 years ago

Webhook-based? (no/partially/yes) partially: Webhooks - Read, Write https://developer.salesforce.com/docs/marketing/marketing-cloud/guide/data-access-permissions.html#webhooks

Available authentication modes (API key/Oauth/other) The Marketing Cloud offers a REST and SOAP API that share a common authentication mechanism based on OAuth 2: https://developer.salesforce.com/docs/marketing/marketing-cloud/guide/create-integration-enhanced.html#related-items API : As of August 1, 2019, Marketing Cloud has removed the ability to create legacy packages. All new packages are enhanced packages. You can still use legacy authentication and API requests with existing legacy packages. Marketing Cloud Production Support (sandbox) environment: https://developer.salesforce.com/docs/marketing/marketing-cloud/guide/requestToken.html#example-request-for-testing

Has Sandbox environment? No

How to populate the account with data UI, API: https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/walkthrough_upload_data.htm

Available streams for sync https://docs.google.com/spreadsheets/d/140Ow-EwGhed3Y14fKbzKU5SoH5MQxcjNzi40-beaZx0/edit?usp=sharing This source was developed on Singer. Creds: "source salesforce test creds" in LastPass

Integration supports incremental sync? Yes: https://developer.salesforce.com/docs/atlas.en-us.noversion.mobile_sdk.meta/mobile_sdk/entity_framework_native_inc_sync.htm

Other information/blockers Marketing Cloud Production environment: https://mc.exacttarget.com Rate Limits: https://developer.salesforce.com/docs/marketing/marketing-cloud/guide/rate-limiting-best-practices.html#what-happens-if-you-are-rate-limited

igrankova commented 3 years ago

Blocker: "Developer Edition is a special development license that does not allow the conversion to production. The same is true for Sandbox. You cannot upgrade Sandbox, but you can purchase additional or different types of Sandbox if you have Enterprise, Unlimited or Force.com Edition." Also, one has to purchase licenses for each Sandbox types such as full,partial copy,developer pro and developer. Please refer the below sites: https://developer.salesforce.com/page/An_Introduction_to_Environments https://help.salesforce.com/HTViewHelpDoc?id=create_test_instance.htm&language=en_US (https://help.salesforce.com/HTViewHelpDoc?id=create_test_instance.htm&language=en_US)

sherifnada commented 2 years ago

from #6678:

Tell us about the new connector you’d like to have

Which source and which destination? Salesforce Marketing Cloud
Do you need a specific version of the underlying data source e.g: you specifically need support for an older version of the API or DB?
Nope!

Describe the context around this new connector

Why do you need this integration? How does your team intend to use the data? This helps us understand the use case. Campaign performance evaluation
How often do you want to run syncs? At least daily
If this is an API source connector, which entities/endpoints do you need supported? https://developer.salesforce.com/docs/apis
If the connector is for a paid service, can we name you as a mutual user when we subscribe for an account? Which company should we name? No, I don't have the permissions to do that ... :(

Describe the alternative you are considering or using

What are you considering doing if you don’t have this integration through Airbyte? Look into Stitch data

Are you willing to submit a PR?

I don't feel comfortable, but if you want me to try things out I will help in any way possible.

Link to singer tap: https://www.singer.io/tap/salesforce-marketing-cloud/

marcosmarxm commented 2 years ago

@igrankova there is a community contribution adding this connector, is it possible to get the credentials?

harshithmullapudi commented 2 years ago

@igrankova any update here ? cc: @karinakuz is there anything we can do ?

karinakuz commented 2 years ago

@harshithmullapudi @marcosmarxm to use Salesforce Marketing Cloud Partner program is required (@igrankova mentioned this in the comments above). The Case #41868893 "Sign up for Partner Developer Edition" is submitted on 5 January and we are waiting Salesforce Support expert will get back to us. For now this case still has status "New".

schlattk commented 2 years ago

Hey let me know if I can be of assistance in setting up this test account. We have some people at the Salesforce that might be able to help.

igrankova commented 2 years ago

Hi, @schlattk, I'm trying to get the CI creds for the Marketing Cloud, but received the answer from the support: Marketing Cloud does not have a sandbox environment like Salesforce. Can you help us to get the account to the Marketing Cloud? I see we now have dev and sandbox accounts, but there's no access to Marketing Cloud.

schlattk commented 2 years ago

Hi, @igrankova when you say you have sandbox and dev accounts you presumably mean for Salesforce? SFMC is independent from SF so I suppose what we are looking for is a test account for SFMC? I suppose it doesn't need to be a "sandbox" it could just be a normal account with some sample data in it.

igrankova commented 2 years ago

Hi, @schlattk, yes, that's correct. As I understand, there's no sandbox in SFMC, so we can use just a normal account to create the oauth application.

schlattk commented 2 years ago

ok @igrankova but they don't want to give you an account?

igrankova commented 2 years ago

@schlattk SFMC can only talk about the paid account, they are sending me to the sales representative.

schlattk commented 2 years ago

ok, understood. Well I would still try and speak to them and see what they can offer to Airbyte, just for testing purposes. That shouldn't be costly I don't think.

On Mon, 21 Feb 2022 at 14:46, Iryna Grankova @.***> wrote:

@schlattk https://github.com/schlattk SFMC can only talk about the paid account, they are sending me to the sales representative. [image: image] https://user-images.githubusercontent.com/87977540/154977516-7dd8b76e-d19f-4355-8439-98a7e1541716.png

— Reply to this email directly, view it on GitHub https://github.com/airbytehq/airbyte/issues/4933#issuecomment-1046953842, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFLQMM2NVP5DQX7RS2LQS3DU4JF23ANCNFSM5A3DTJHA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you were mentioned.Message ID: @.***>

igrankova commented 2 years ago

@schlattk, it would be very helpful, thank you.

schlattk commented 2 years ago

Iryna, I meant actually you (as representative of Airbyte) should contact them. Sorry for the misunderstanding. What I meant was that even if they pass you on to the sales team there might still be a way of creating an account for Airbyte to test the connection without incurring an unreasonable expense. It should still be in their interest to be a source available on Airbyte, especially as you are working with them on Salesforce already all the best, Konrad

On Mon, 21 Feb 2022 at 15:09, Iryna Grankova @.***> wrote:

@schlattk https://github.com/schlattk, it would be very helpful, thank you.

— Reply to this email directly, view it on GitHub https://github.com/airbytehq/airbyte/issues/4933#issuecomment-1046976160, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFLQMM74UQQYUZVXW7LOOOTU4JITHANCNFSM5A3DTJHA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you were mentioned.Message ID: @.***>

igrankova commented 2 years ago

@schlattk, Oh, sorry, yes, I'll contact them.

schlattk commented 2 years ago

Hi @igrankova where do we stand on this? Is it a matter of not having a budget to pay for a licence?

sherifnada commented 2 years ago

@schlattk apologies for the delay here - iryna is impacted by the Ukraine situation so we are experiencing a delay. Will respond soon!

schlattk commented 2 years ago

@sherifnada oh ok sure nor problem really sorry to hear that.

igrankova commented 2 years ago

@schlattk, hi, Konrad, last week we discussed the sandbox account configuration and price with the SFMC team and I asked Andy to step into and help with the financial questions, they also asked about the technical workflow and I sent a video of Salesforce connector as an example of account usage. I'm still waiting for their response. Today I've send a reminder.

misteryeo commented 2 years ago

@schlattk as an update - we're still working with various folks on the Salesforce side to try and proceed here!

schlattk commented 2 years ago

great thanks for letting me know!

On Wed, 20 Apr 2022 at 03:38, Andy @.***> wrote:

@schlattk https://github.com/schlattk as an update - we're still working with various folks on the Salesforce side to try and proceed here!

— Reply to this email directly, view it on GitHub https://github.com/airbytehq/airbyte/issues/4933#issuecomment-1103408734, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFLQMM45GVWPEJKC3IHNVULVF5U2JANCNFSM5A3DTJHA . You are receiving this because you were mentioned.Message ID: @.***>

igrankova commented 2 years ago

The Business Plan is submitted (Partner Program) as a step to receive a sandbox

igrankova commented 2 years ago

Please, find creds for the SFMC sandbox in the LastPass: Salesforce Marketing Cloud sandbox

misteryeo commented 2 years ago

@schlattk FYI, we've finally managed to secure a sandbox so @harshithmullapudi will be able to move forward with you here!

jbsilva commented 1 year ago

Any updates on the Salesforce Marketing Cloud connector?

dduran28 commented 1 year ago

Any work being done in this connector?

schlattk commented 1 year ago

Hey, not to my knowledge. We have switched over to using SFMC reports and the FTP source connector.

On Thu, 27 Jul 2023 at 21:12, Dion Duran @.***> wrote:

Any work being done in this connector?

— Reply to this email directly, view it on GitHub https://github.com/airbytehq/airbyte/issues/4933#issuecomment-1654493736, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFLQMM5MYIVV6GRFU6VQYY3XSLDSVANCNFSM5A3DTJHA . You are receiving this because you were mentioned.Message ID: @.***>

dduran28 commented 1 year ago

@schlattk How can I go about using this in my Airbyte OSS env?

SFMC reports and the FTP source connector.

shmf commented 11 months ago

Hi, i am also interested in this connector - is there any update? Thanks

wwfch-cyrill commented 5 months ago

We're looking into creating such a connector. Here are some useful resources:

API Documentation: https://www.postman.com/salesforce-developers/workspace/salesforce-developers/collection/14448118-2835a976-010c-4548-92f8-f42c0382758e?action=share&creator=407776&tab=overview
Singer Implementation: https://github.com/singer-io/tap-exacttarget/tree/master/tap_exacttarget
Blocked PR using singer in airbyte: https://github.com/airbytehq/airbyte/pull/10026

Anyone started implementation or found another way of extracting data from SFMC?

airbytehq / airbyte