search

blockchain-etl / ethereum-export-pipeline

UNMAINTAINED! AWS CloudFormation scripts for Ethereum ETL export pipeline
MIT License
8 stars 5 forks source link

CloudFormation template is rejected for exceeding size limits #11

Open lazzarello opened 6 years ago

lazzarello commented 6 years ago

I generated an export_pipeline.template today and the size on my local disk is 738765 bytes. WHen I create a new stack and choose the option to "Upload a template to Amazon S3" the dashboard fails to proceed and informs me that there was a Template validation error: Template may not exceed 460800 bytes in size.

This seems like an odd limitation. Not sure how or why this check exists.

medvedev1088 commented 6 years ago

Thanks for reporting this. I also found this issue. The workaround I used is to generate smaller templates with fewer blocks, say only first 4 million blocks, then next 2 million blocks etc.

majeas165 commented 6 years ago

Could you try another option "Specify an Amazon S3 template URL". For this option, you need to pre-upload the CloudFormation file in S3.