search

rllc / llc-archives

Archived sermons, backed by the cloud
https://llc-archives.herokuapp.com
MIT License
1 stars 1 forks source link

use AWS S3 notifications to kick off processing #56

Open smcadams86 opened 8 years ago

smcadams86 commented 8 years ago

Stop polling every hour to find changes. Use the built in amazon notification features of S3.

https://docs.aws.amazon.com/AmazonS3/latest/dev/NotificationHowTo.html

andeyout commented 8 years ago

Don't quite understand. Why do this?

Sent from Outlook Mobilehttps://aka.ms/qtex0l

On Thu, Mar 3, 2016 at 7:35 AM -0800, "Steven McAdams" notifications@github.com<mailto:notifications@github.com> wrote:

Stop polling every hour to find changes. Use the built in amazon notification features of S3.

https://docs.aws.amazon.com/AmazonS3/latest/dev/NotificationHowTo.html

Reply to this email directly or view it on GitHubhttps://github.com/rllc/llc-archives/issues/56.

smcadams86 commented 8 years ago

Currently we are kicking off a process once an hour to connect to amazon s3, list all the files and compare the list with the metadata stored in our database. Amazon has built in support for sending notifications when items change on s3. This would eliminate the need to poll hourly for changes, amazon would send us a notification of something changing and we could then take action against it.

On Thu, Mar 3, 2016, 09:57 Dave Anderson notifications@github.com wrote:

Don't quite understand. Why do this?

Sent from Outlook Mobilehttps://aka.ms/qtex0l

On Thu, Mar 3, 2016 at 7:35 AM -0800, "Steven McAdams" < notifications@github.commailto:notifications@github.com> wrote:

Stop polling every hour to find changes. Use the built in amazon notification features of S3.

https://docs.aws.amazon.com/AmazonS3/latest/dev/NotificationHowTo.html

Reply to this email directly or view it on GitHub< https://github.com/rllc/llc-archives/issues/56>.

— Reply to this email directly or view it on GitHub https://github.com/rllc/llc-archives/issues/56#issuecomment-191825871.

andeyout commented 8 years ago

And this action would take place automatically?

Sent from Outlook Mobilehttps://aka.ms/qtex0l

On Thu, Mar 3, 2016 at 7:32 PM -0800, "Steven McAdams" notifications@github.com<mailto:notifications@github.com> wrote:

Currently we are kicking off a process once an hour to connect to amazon s3, list all the files and compare the list with the metadata stored in our database. Amazon has built in support for sending notifications when items change on s3. This would eliminate the need to poll hourly for changes, amazon would send us a notification of something changing and we could then take action against it.

On Thu, Mar 3, 2016, 09:57 Dave Anderson notifications@github.com wrote:

Don't quite understand. Why do this?

Sent from Outlook Mobilehttps://aka.ms/qtex0l

On Thu, Mar 3, 2016 at 7:35 AM -0800, "Steven McAdams" < notifications@github.commailto:notifications@github.com> wrote:

Stop polling every hour to find changes. Use the built in amazon notification features of S3.

https://docs.aws.amazon.com/AmazonS3/latest/dev/NotificationHowTo.html

Reply to this email directly or view it on GitHub< https://github.com/rllc/llc-archives/issues/56>.

Reply to this email directly or view it on GitHub https://github.com/rllc/llc-archives/issues/56#issuecomment-191825871.

Reply to this email directly or view it on GitHubhttps://github.com/rllc/llc-archives/issues/56#issuecomment-192081524.

smcadams86 commented 8 years ago

Read through the Amazon documentation I linked.

On Thu, Mar 3, 2016, 21:34 Dave Anderson notifications@github.com wrote:

And this action would take place automatically?

Sent from Outlook Mobilehttps://aka.ms/qtex0l

On Thu, Mar 3, 2016 at 7:32 PM -0800, "Steven McAdams" < notifications@github.commailto:notifications@github.com> wrote:

Currently we are kicking off a process once an hour to connect to amazon s3, list all the files and compare the list with the metadata stored in our database. Amazon has built in support for sending notifications when items change on s3. This would eliminate the need to poll hourly for changes, amazon would send us a notification of something changing and we could then take action against it.

On Thu, Mar 3, 2016, 09:57 Dave Anderson notifications@github.com wrote:

Don't quite understand. Why do this?

Sent from Outlook Mobilehttps://aka.ms/qtex0l

On Thu, Mar 3, 2016 at 7:35 AM -0800, "Steven McAdams" < notifications@github.commailto:notifications@github.com> wrote:

Stop polling every hour to find changes. Use the built in amazon notification features of S3.

https://docs.aws.amazon.com/AmazonS3/latest/dev/NotificationHowTo.html

Reply to this email directly or view it on GitHub< https://github.com/rllc/llc-archives/issues/56>.

Reply to this email directly or view it on GitHub https://github.com/rllc/llc-archives/issues/56#issuecomment-191825871.

Reply to this email directly or view it on GitHub< https://github.com/rllc/llc-archives/issues/56#issuecomment-192081524>.

— Reply to this email directly or view it on GitHub https://github.com/rllc/llc-archives/issues/56#issuecomment-192081748.