search

whiletrue-do / WTD_learning_material

MIT License
0 stars 0 forks source link

Lambdas in AWS #1

Open kcorn1982 opened 1 year ago

kcorn1982 commented 1 year ago

I would like to know how Lambdas work and some background, please.

A few simple working examples would be great, something along these lines: extract a dataset from Redshift or S3, manipulate it, and output in a CSV or even better in AWS QuickSight.

moved here for @ealejunas

ealejunas commented 1 year ago

thanks @kcorn1982. Shared more thoughts about the project on Slack:

we could use a free tier in AWS which will give access to Lambda and S3 services https://aws.amazon.com/free/?trk=ce1f55b8-6da8-4aa2-af36-3f11e9a449ae&sc_channel=ps&[…]f.Free%20Tier%20Types=all&awsf.Free%20Tier%20Categories=all

steps as I see this working:

  1. Set up a free AWS account
  2. Upload a csv into S3 (sharing a random dataset called Unit_Economics.csv)
  3. Use Lambda service to manipulate csv. A simple calculation into a new column will do. In this example we could say a success criteria is to achieve Cost Per Transaction, so that means col b/colc and output is in col d, called CPT
  4. visualise results if possible
  5. Store an updated version back on S3

Exercise outcome: we should be able to get API access to S3 bucket and a csv file, be able to work out lambda as well as beware of security (csv file public/private; access tokens etc.)