Quick research to check if deeper itegration is requried with Amazon SES for mailing statistics.

[sumeetpareek]

As evident from the sendy snapshot below there are various kind of statistics that are available for a mailing campaign.

We need to do a quick research (not implementation, just getting to know) to figure if deeper integration with Amazon SES is required (beyond just using the drupal SMTP module, or drupal php sendmail() to talk to SES) for sending mails in a way such that we have statistics avaiable.

Or may be sendy is getting all these stats some other way?

This issue can be successfully closed after we have a rough quick document of how we would need our kabootr drupal talk with Amazon SES. This issue does not deal with the implementation.

Sendy's code can be looked upon from here - https://github.com/AamAadmiParty/mass-emailer-sendy/ and I am sending the unlocked code (sendy has 2 locked files) over email.

[tkuldeep]

As I understood..

• Amazon SES is web service, so can be used by and platform.
• For using or communicating with web service, we send http/https request to that web service. Request must containt these
  • End points
  • Name of the action
  • Parameter
• So In amazon SES request can be send by http://docs.aws.amazon.com/ses/latest/DeveloperGuide/sending-email.html
  • AWS SES Console
  • Amazon SES Simple Mail Transfer Protocol (SMTP) interface, [used by sendy] http://docs.aws.amazon.com/ses/latest/DeveloperGuide/send-email-smtp-app.html
  • By Using Amazon SES API. http://docs.aws.amazon.com/ses/latest/DeveloperGuide/send-email-api.html
  • We are building an application, so we can use SMTP or Amazon SES API.
  • Amzon SES API can be used in two ways.
    1. Directly => By Query Interface http://docs.aws.amazon.com/ses/latest/DeveloperGuide/query-interface.html
    2. By using AWS php sdk. http://docs.aws.amazon.com/aws-sdk-php-2/latest/class-Aws.Ses.SesClient.html
    3. AWS Command Line

[tkuldeep]

• Now for sending email through Amazon SES Simple Mail Transfer Protocol (SMTP) interface, we have to add additional software. Like postfix or smtp server.. [So confused in postfix and smtp server].
• Now if we want to send mail through amazon SMTP, change the configuration of mail server http://docs.aws.amazon.com/ses/latest/DeveloperGuide/postfix.html

By Using Amazon SES API [As I thought, here I am very confuse, I think my basic concept about sending mail is not clear]

• No requirement of smtp server.
• We will send requst by just sending HTTPS request to amazon ses web service.
• And this request can be send my two ways.
  • By Query Interface
  • By AWS php sdk.

So my option will be to use AWS php sdk, it provides much more thing like guzzle. http://guzzlephp.org/ I dont know so much about guzzle. I have just read what is guzzle.

• Now what should I do..

[tkuldeep]

Now I am studying sending mail through amazon ses via Query Interface.

• For sending https request to web service, I am using pecl-http http://www.mkfoster.com/2009/01/04/how-to-use-the-pecl-http-pecl_http-extension-to-make-http-requests-from-php/.
• Then I am trying to send request via Query interface to amazon ses.

[tkuldeep]

Yes.

• I have sent successfully request to Amazon SES via Query Interface.
• Currently I have verified my email address tkuldeep.singh@innoraft.com. so now I can send mail from mail address to others by amazon ses.
• I think using directly Amazon SES api via Query interface is very easy.

@basantsharma @mukeshagarwal @sumeetpareek Baki App log jo khe.. :-D

[tkuldeep]

• As I have sent successfully verified my email address to send mail, so I am sure similarly all the functions can be will called to perform their operation. like sending mail, get Statics data etc.
• So I am writing code for same. Please note that I for sending https request I am using pecl-http libraries. http://us.php.net/manual/en/class.httprequest.php
• But I am facing a problem , when I tried to send mail to self, I am seeing this error Value null at 'source' failed to satisfy constraint: http://docs.aws.amazon.com/ses/latest/DeveloperGuide/query-interface-responses.html. But unable to find cause. I know that I am doing silly mistake. But after spending 1 hour time, could no solve it.
• I am applying oops concept in writing code. So therefor following oops coding standard. [Please comment if I am doing wrong].

Pros of using API:

• Fully control on everything that we want and how we want to show to the customers.
• We don't need mail server, amazon will do for us. This feature is also available when we use AWS SDK to interact with Amazon SES API. But we will have so much unnecessary libraries.
• This will help in fully understanding of Amazon ses api.

Now Please give comments here, so that it will help me lot.. :-D

[tkuldeep]

• For handling amazon feedback programmatically, we have to use Amazon SNS web service. http://docs.aws.amazon.com/ses/latest/DeveloperGuide/notifications-via-sns.html
• Currently I am configuring Feedback Notifications Using the AWS Management Console, as I can also via Amazon SES API. as it required only send a request via Query Interface method. Then read a response. But I am unable to decide UI for this. *After configuring Amazon SNS service, we will receive this notification in json format. Then according to this response we have to handle our system.

[tkuldeep]

• In between days, I have written code, that how all request will be sent to Query Interface and how we handle the response.
• Now only UI for sending request and show information needs to be decided.
• And also for controlling our sending message limit and sending rate should be controller by our code. [Need to be done].

Today:

• First I will configure Amazon SNS service, then read the notification in json, accordingly sending system will send the mail. More time will be consumed in deciding, what action should be taken on what condition, then how these action will take place, and also this action should act accordingly simplenews module.
• Then will try to show sending statistics to user. Time will be consumed in preparing chart or deciding ui. [Simply User Interface].
• Retrieving statistics data and read them is very easy.

Note: After configuration Amazon SNS service, we will charge some amount. http://aws.amazon.com/sns/pricing

[tkuldeep]

• I have configured Amazon SNS for receiving notification in json format. But still I am not receiving notification. http://docs.aws.amazon.com/ses/latest/DeveloperGuide/configure-sns-notifications.html
• Now I am getting so confusion, how our system will handle so much functionality and implementation of these functionality.
• As I think I have created a platform where have,
  • How the functionality will be implemented.
  • What functionality we need. [Confused]
• So I have decided, today night or by tomorrow 10 am, I will create well document, what should be the functionality, implementation of these. Also add good comments in my code. :-D

[tkuldeep]

For Amazon configuration, I have created four menu items.

• Verify Sender Identity => admin/config/services/amazon_ses/amazon_identity_verify
• View Sender Identities => admin/config/services/amazon_ses/amazon_identity_list
• DKIM Settings => admin/config/services/amazon_ses/amazon_domain_dkim_setting
• Email Statistics => admin/config/services/amazon_ses/amazon_get_mail_statistics

Dev url: http://54.200.68.236/kabootr/docroot Clean url is not enabled. User and password are in mail.

[tkuldeep]

For configuring Amazon SNS, I have followed http://docs.aws.amazon.com/ses/latest/DeveloperGuide/configure-sns-notifications.html.

But not receiving JSON data.

[tkuldeep]

@sumeetpareek For sending authenticated mail, we need DKIM enabled domains, so that our emails can not be spoofed by third party. Now I have verified two email address have domain of innoraft.com, there for you have got email form amazon ses. For adding CNAME record please go to link http://kabootr.dev/admin/config/services/amazon_ses/amazon_domain_dkim_setting and copy CNAME record of doamin innoraft.com, and paste in DNS setting of innoraft.com.

It is not necessary, to enable DKIM. Just for testing we can. According it should not effect any other thing.

Note: Sorry for late reply, I got stuck in git issues. Actually I have changed ssh key path and rename it on my local. SO not able to push on github.

[tkuldeep]

I have created sns topic in US-west-2 region

also created subscriptions

Now when I edit feedback configuration, I am not able to see these topic, The topic which are visible here, have been created by link given here red box 1..

Point number 2 says => Only SNS topic regions are supported in US-west-1 region. Kindly note : topic created from amazon SNS console have region US-west-2 in picture 1.

May be it is causing problem..

[tkuldeep]

@sumeetpareek

• For verifying you email id go to link http://kabootr.dev/admin/config/services/amazon_ses/amazon_identity_verify
• When we gain production access, then there is not need of verification of recipient address. For more detail http://docs.aws.amazon.com/ses/latest/DeveloperGuide/request-production-access.html