Store original messages on S3

kmahar commented 7 years ago

I branched this off from prev PR w/ threadhash, so probably easier for you if you merge that first.

changes here:

Cleaned up logic in serve_attachment, added better error handling
Store full original messages in text form on S3 under [WEBSITE]/originalmessages/[post id][msg_id]. This happens for all Murmur posts, and for Squadbox posts that get stored in DB (those that aren't auto approved.) todo: delete posts from S3 once post is approved?
Download the original messages from S3 to get some more header data (in-reply-to, references) before sending out approved posts.
Fix some header stuff on all posts - In-Reply-To should be the message-id of a separate message that this is a reply to. and References should contain message-ids of all past messages this message was replying to.
Reorganized how files are stored on S3. break down by Murmur/Squadbox, and then what they are (attachments or original_messages). Note: in order to not break links to attachments for existing Murmur production posts, any folder X in top-level directory for S3 bucket murmur-squadbox will need to be moved to murmur/attachments/X. (if you let me know when you are going to merge, I can do this.)
auto approve messages from moderators to the squad owner. (basically treat mods as part of whitelist.)

amyxzhang commented 7 years ago

@kmahar merge conflicts

kmahar commented 7 years ago

resolved @amyxzhang

haystack / murmur