search

ajander / bird-behavior

0 stars 0 forks source link

Figure out how to pull API data into AWS data storage of some kind #4

Open ajander opened 1 year ago

ajander commented 1 year ago

What kind of pipeline should I set up to query an API at a given frequency and add to a table or bucket? Try this out with a weather API.

ajander commented 1 year ago

https://docs.aws.amazon.com/whitepapers/latest/building-data-lakes/data-ingestion-methods.html

ajander commented 1 year ago

Lambda function, with a Cloudwatch rule to schedule it. See notes for links on how to do it.