Set up WSGI for Elastic Beanstalk

[ErrorsAndGlitches]

A lot of links and references can be found in this issue:

• https://github.com/ErrorsAndGlitches/waisn-tech-tools/issues/5

[ErrorsAndGlitches]

Going to start working on this.

[ErrorsAndGlitches]

• leader_only docs
• nginx configuration
• Getting to Know and Love AWS Elastic Beanstalk Configuration Files (.ebextensions)
• ebs configuration files

Still need to figure out how commands are run using these.

[ErrorsAndGlitches]

Using EB extensions for running commands before/after service start:

• https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/customize-containers-ec2.html#linux-commands

[ErrorsAndGlitches]

Setting up the docker configuration:

• https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/single-container-docker-configuration.html

[ErrorsAndGlitches]

Docker repo has been set up:

• https://cloud.docker.com/repository/docker/errorsandglitches/waisn-tech-tools-prod

Installing eb CLI:

pip install --upgrade awsebcli

[ErrorsAndGlitches]

eb create documentation:

• https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/eb3-create.html

[ErrorsAndGlitches]

Environment variables:

• https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/ebextensions-optionsettings.html

[ErrorsAndGlitches]

The meaning of upstream in nginx configuration:

• https://stackoverflow.com/questions/5877929/what-does-upstream-mean-in-nginx

[ErrorsAndGlitches]

More information about upstream and nginx configuration in general. Very thorough though I haven't read all of it, but skimmed the upstream parts:

• https://www.digitalocean.com/community/tutorials/understanding-nginx-http-proxying-load-balancing-buffering-and-caching

[ErrorsAndGlitches]

Elastic Beanstalk also supports hooks, which seem to overlap with ebextensions:

• https://docs.aws.amazon.com/en_pv/elasticbeanstalk/latest/dg/custom-platform-hooks.html

[ErrorsAndGlitches]

Issue was that EB parses the Dockerfile for the EXPOSE information.

[ErrorsAndGlitches]

May be able to use the second version of the Dockerrun.aws.json

• https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/create_deploy_docker_v2config.html

[ErrorsAndGlitches]

Other notes:

• EB automatically creates a DB name for the application to use.
• EB doesn't clear out files that were deleted from the application bundle.
• Reading the code for what /opt/elasticbeanstalk/hooks/appdeploy/ does was insightful
• There are other options such as logging that I have not configured in Dockerrun.aws.json

[ErrorsAndGlitches]

What is the relationship between .ebextensions and hooks?

• ebextensions are a higher level construct that can be used to install packages, create files, and run commands whereas hooks are simply bash scripts that get run as part of the start-up process.
• ebextensions can be used to generate hooks.
• ebextensions container_commands are run before the appdeploy hooks. The time when hooks are run is a little vague but it seems to be after the container is running and the proxy server is running.

[ErrorsAndGlitches]

Interestingly, the EB Docker set up does not have a host to container port mapping (tested on Mac). This might point to an issue that I'll need to hunt through the hooks to understand. Alternatively, moving to V2 configuration is another option.

[ErrorsAndGlitches]

Fixing SSL MySQL issue:

• https://github.com/ContinuumIO/anaconda-issues/issues/10646#issuecomment-493916183

[ErrorsAndGlitches]

Things to fix:

• static files are available on the host, but not set up in nginx
• debug page does not work nor does Log In
• alert pages do not require authentication, but they should

[ErrorsAndGlitches]

I'm also not 100% certain that the migrations happened. May need to change this to a hook (though, this doesn't require the service to be deployed so not sure what's up here).

[ErrorsAndGlitches]

I may have fixed the static files by overriding the sites-available file:

• https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/java-se-nginx.html

[ErrorsAndGlitches]

One issue was that it wasn't checked in so it wasn't getting deployed. After committing it, eb deploy wasn't updating the file. It could have to do that the file is only deployed during the first initialization. Going to try that. If not, it may be worth looking into the code again. Here are some SO articles that might help:

• https://stackoverflow.com/questions/23709841/how-to-change-nginx-config-in-amazon-elastic-beanstalk-running-a-docker-instance
• https://stackoverflow.com/questions/24860426/nginx-config-file-overwritten-during-elastic-beanstalk-deployment

[ErrorsAndGlitches]

The ebextensions approach only works for Java and Go platforms. WTF.

• https://aws.amazon.com/blogs/aws/elastic-beanstalk-update-support-for-java-and-go/

[ErrorsAndGlitches]

Fixed the static files by overwriting the sites-available file via ebextensions. Still having some trouble getting Auth0 to work, but I believe I have identified the issue in the settings logic. I have created some unit tests to verify and am testing in production now.

[ErrorsAndGlitches]

Figured out the Auth0 issue - it was because the database migration command did not specify the production settings and hence it was not creating the needed Auth0 tables.

[ErrorsAndGlitches]

When going through this tutorial:

• https://auth0.com/blog/django-tutorial-building-and-securing-web-applications/

Found that the code was taking the approach of a custom Auth0 integration, which I don't think is needed. I've switched it out to the default one and found that it was erroring on not getting email. I made the change to enable email and it works when running production model locally (not in Docker). Going to try in prod mode via docker, push, and redeploy.

[ErrorsAndGlitches]

It seems that running in DEBUG mode, but with authentication on generates more logs. It shows that the rsa module is missing.