aws-samples / serverless-patterns

Serverless patterns. Learn more at the website: https://serverlessland.com/patterns.
https://serverlessland.com
Other
1.61k stars 928 forks source link

New pattern submission: Amazon Athena to AWS Glue #333

Closed shindeja closed 2 years ago

shindeja commented 2 years ago

To submit a template to the Serverless Patterns Collection, submit an issue with the following information.

image

Description

Amazon Athena integration with AWS Glue

This pattern in CDK offers an example to generate an AWS Glue Tables and connect to AWS Athena to execute queries. Tables of type CSV and TSV are created with the help of CFNTable.

Language: Typescript

YouTube videoId (optional e.g. "VI79XQW4dIM") : NA

Framework: CDK

Services from Amazon Athena to AWS Glue

Description:

This example creates AWS Glue tables of type CSV and TSV with the help of CDK using CFnTable Construct. It demonstrate the usage of serdeinfo in CDK to create tables of various types.

Deployment commands

  1. Create a new directory, navigate to that directory in a terminal and clone the GitHub repository:
    git clone https://github.com/aws-samples/serverless-patterns
  2. Change directory to the pattern directory:
    cd cdk-athena-glue
  3. To deploy from the command line use the following:
      npx cdk bootstrap aws://accountnumber/region
      npx cdk synth
      npx cdk deploy --all

GitHub PR for template:

https://github.com/aws-samples/serverless-patterns/pull/332

Payload example : NA

Additional resources : NA

Author bio

Name: Jayesh A Shinde Photo URL: https://github.com/shindeja/shindeja/blob/main/shindeja.jpeg Twitter handle: https://twitter.com/jayeshashinde Description: Jayesh is Cloud Application Architect at AWS Pro-serve India.

Name: Atul Sharma Photo URL: https://github.com/shindeja/shindeja/blob/main/atulsharma.jpeg Twitter handle: NA Description: Atul is Sr. Cloud Application Architect at AWS Pro-serve India.

Name: Feroz Kumar Photo URL: https://github.com/shindeja/shindeja/blob/main/feroz.jpeg Twitter handle: NA Description: Feroz is Cloud Application Consultant at AWS Pro-serve India.

jbesw commented 2 years ago

Thanks for the contribution - this is now live at https://serverlessland.com/patterns/athena-glue-s3-cdk.