search

wallabyway / acc-bim360-parquet-reports

This repo provides an AWS Lambda function that converts CSV files from Autodesk Construction Cloud (ACC) or BIM360 to Parquet format and stores them in your S3 bucket. The Parquet files can be used for efficient reporting in AWS QuickSight or other tools. This serverless solution ensures scalability and easy integration
MIT License
2 stars 0 forks source link

IGNORE: (static images for README) #1

Open wallabyway opened 1 week ago

wallabyway commented 1 week ago 
''' mermaid
graph LR
    A[ACC/BIM360] -->|CSV File| B[S3 Signed URL]
    B -->|Event: CSV URL| C[AWS Lambda Fn]
    C -->|Convert CSV to Parquet| D[S3 Bucket]
    D --> E[AWS QuickSight]
'''

SVG: mermaid-diagram-2024-09-19-142944

wallabyway commented 4 days ago

sequenceDiagram participant User participant LambdaRequest as Data Connector Request (Lambda) participant ACCServer as ACC Server participant LambdaCallback as Webhook Listener (Lambda) participant LambdaConverter as CSV to Parquet Converter (Lambda) participant S3 as S3 Bucket

User->>LambdaRequest: Initiate Data Connector Request
LambdaRequest->>ACCServer: Schedule CSV Export
ACCServer->>LambdaCallback: Webhook - CSV Files Ready
LambdaCallback->>ACCServer: GET List of CSV IDs
LambdaCallback->>LambdaConverter: Swap CSV ID for Signed URL
LambdaConverter->>ACCServer: Download CSV Files
LambdaConverter->>ACCServer: 
LambdaConverter->>LambdaConverter: Convert CSV to Parquet
LambdaConverter->>S3: Upload Parquet Files
LambdaConverter->>S3: 
LambdaConverter->>S3:

mermaid-diagram-2024-09-26-144740