search

mozilla / fxa

Monorepo for Mozilla Accounts (formerly Firefox Accounts)
https://mozilla.github.io/ecosystem-platform/
Mozilla Public License 2.0
599 stars 210 forks source link

Email marketing events not in Amplitude #3725

Closed jbuck closed 4 years ago

jbuck commented 4 years ago

It was reported that the email marketing events are not being sent to Amplitude anymore, starting around April 10th. I checked BrickFTP ( /etl/deg-exacttarget ) for the files, and the latest file I'm seeing is FXA_Email_Events_20190409.zip, and FXA_Email_Events_Sent20190308.zip. We should figure out why SFMC stopped sending files to BrickFTP

┆Issue is synchronized with this Jira Task ┆Issue Number: FXA-596

jbuck commented 4 years ago

Amplitude chart for the interested: https://analytics.amplitude.com/mozilla-corp/chart/new/wi1rpzj

LaurenNiolet commented 4 years ago

I can shed some light on this. In April, the automation that produced the export file began failing. This was an ETL process that relied on SFMC's terribly under-equipped SQL infrastructure.

Efforts to troubleshoot failed and we moved on to focus on FxA MAU work. The good news is that this week, the IT team is finishing up moving FxAs from SFMC to SFDC (CRM). The result: all the data we need to resume this export will be housed in the same place, vastly simplifying the process of sending it over.

I'd like to try having the faucet turned back on in January.

clouserw commented 4 years ago

Is there any FxA Engineering work to do in this issue?

jaredhirsch commented 4 years ago

@LaurenNiolet We're doing some metrics pipeline redesign work, and we're investigating feasibility of moving our sources from batch to streaming processing. Is there an SFMC API that we could pull from, instead of relying on batch exports to FTP?

data-sync-user commented 4 years ago

➤ Wil Clouser commented:

This will be handled in this tracker: https://bugzilla.mozilla.org/show_bug.cgi?id=1617710