fastsurvey / backend

FastSurvey's backend that's crunching the data
1 stars 0 forks source link

Rejected emails and slow sending using Mailgun #85

Closed dostuffthatmatters closed 2 years ago

dostuffthatmatters commented 2 years ago

Emails to my address ab12cde@mytum.de don't seem to come through. You can look at the following JSON - for any unverified submission, the email didn't come through - the last @gmail submission also took a long time.. (> 5 minutes I think).

[
    {
        "Do you think, potatoes are a good idea?": "Helloooo",
        "Your TUM email address": {
            "email_address": "moritz.makowski@tum.de",
            "verified": true
        },
        "Is this a nice survey?": null
    },
    {
        "Do you think, potatoes are a good idea?": "",
        "Your TUM email address": {
            "email_address": "ge69zeh@mytum.de",
            "verified": false
        },
        "Is this a nice survey?": [
            "no"
        ]
    },
    {
        "Do you think, potatoes are a good idea?": "",
        "Your TUM email address": {
            "email_address": "ge69zeh@mytum.de",
            "verified": false
        },
        "Is this a nice survey?": [
            "hella yeah!"
        ]
    },
    {
        "Do you think, potatoes are a good idea?": "",
        "Your TUM email address": {
            "email_address": "makowskimoritz@gmail.com",
            "verified": true
        },
        "Is this a nice survey?": [
            "Yes"
        ]
    },
    {
        "Do you think, potatoes are a good idea?": "",
        "Your TUM email address": {
            "email_address": "ge69zeh@mytum.de",
            "verified": false
        },
        "Is this a nice survey?": [
            "Yes"
        ]
    },
    {
        "Do you think, potatoes are a good idea?": "",
        "Your TUM email address": {
            "email_address": "moritz.makowski@tum.de",
            "verified": true
        },
        "Is this a nice survey?": [
            "hella yeah!"
        ]
    },
    {
        "Do you think, potatoes are a good idea?": "",
        "Your TUM email address": {
            "email_address": "makowskimoritz@gmail.com",
            "verified": true
        },
        "Is this a nice survey?": [
            "hella yeah!"
        ]
    },
    {
        "Do you think, potatoes are a good idea?": "",
        "Your TUM email address": {
            "email_address": "ge69zeh@mytum.de",
            "verified": false
        },
        "Is this a nice survey?": [
            "hella yeah!"
        ]
    }
]

Plus the sender of the emails looks weird:

Screenshot 2021-12-03 at 15 39 09

Regarding the email format - I propose this style:

Hi there, we received your submission!

Survey: We need more surveys!
Please verify your submission by clicking here.

Cheers, the FastSurvey team
empicano commented 2 years ago

Email Sender:

The sender looks weird, but is actually correct. We're sending our automated emails from the subdomain email.fastsurvey.de in order to not interfere with manual emails (for which we simply use fastsurvey.de like in contact@fastsurvey.de). As the sender, we actually set contact@fastsurvey.de, meaning that when someone replies to this automated email it gets sent to contact@fastsurvey.de instead of the real sender.

Delivery Issues:

The email logs say that the emails to moritz.makowski@tum.de, makowskimoritz@gmail.com, and moritz@dostuffthatmatters.dev were sent successfully. Emails to ge69zeh@mytum.de were rejected by the "client host" (which I suppose means TUM).

Those issues that you encountered sadly aren't under our control. Email clients like Gmail rank IP addresses from which they receive emails by the quality of emails they receive from them. As of right now, all our emails are sent together with emails from other Mailgun users from the same IP address. Among those, there are also spammers and users that use Mailgun for spammy marketing emails. This gives Mailgun emails, in general, a low score leading to long delivery times and to emails being rejected by clients.

I want to switch to a higher-quality email provider like Postmark for a while already. However, the free tier of Mailgun is still pretty cool for the moment I think.

dostuffthatmatters commented 2 years ago

Outlook is weird ... tutatnota was instant (1sec) and gmail sometimes had a delay but got through.

I think this could be really annoying when it is never working for certain emails. Do you think outlook will be better with Postmark? I'd be willig to spend that money.

empicano commented 2 years ago

You can see their delivery times here (which does not show Outlook, however): https://status.postmarkapp.com/ -- Postmark is the only provider that has those times open to the public, so you can't really compare, but I think is a good sign.

The smallest plan for Postmark is 10 EUR for 10_000 emails per month.