big-data-lab-umbc / Reproducible_and_portable_app_in_cloud

A toolkit to deploy, execute, analyze, and reproduce big data analytics automatically in the cloud.
6 stars 6 forks source link

Missing Template file for running the RPAC tool. #3

Closed SWAP1795 closed 1 year ago

SWAP1795 commented 1 year ago

Hi, I am getting the below error while trying to run the RPAC tool in my system. Glad if anyone can help. samconfig.toml and template.yml files are missing from the repository which is causing error while running the same.

image

jianwuwang commented 1 year ago

A little more context: https://github.com/big-data-lab-umbc/Reproducible_and_portable_app_in_cloud/tree/main/examples/CloudRetrievalViaDask is the application used for the execution.

SWAP1795 commented 1 year ago

I performed the below steps to run the RPAC toolkit:

  1. Ran AWS Configure
  2. then, "python main.py --one_click" command
  3. then got the following error.

C:\Users\16464\Downloads\Reproducible_and_portable_app_in_cloud-main (1)\Reproducible_and_portable_app_in_cloud-main>aws configure AWS Access Key ID [****5BKF]: AWS Secret Access Key [****5iUh]: Default region name [None]: us-east-1 Default output format [None]: json

C:\Users\16464\Downloads\Reproducible_and_portable_app_in_cloud-main (1)\Reproducible_and_portable_app_in_cloud-main>python main.py --one_click SatelliteCollocationViaDask the aws template start deploying on aws 2023-01-17 16:35:59 Loading policies from IAM... 2023-01-17 16:36:00 Finished loading policies from IAM. C:\Users\16464\Downloads\Reproducible_and_portable_app_in_cloud-main (1)\Reproducible_and_portable_app_in_cloud-main\reproduce\pipeline.json is a valid SAM Template

SAM CLI update available (1.70.0); (1.68.0 installed) To download: https://docs.aws.amazon.com/serverless-application-model/latest/developerguide/serverless-sam-cli-install.html 2023-01-17 16:36:01 There are unpublished metrics. Please make sure you call publish after you record all metrics. 2023-01-17 16:36:01 There are unpublished metrics. Please make sure you call publish after you record all metrics. Building codeuri: C:\Users\16464\Downloads\Reproducible_and_portable_app_in_cloud-main (1)\Reproducible_and_portable_app_in_cloud-main\reproduce\lambda runtime: python3.6 metadata: {} architecture: x86_64 functions: CloudRetrievalFunction, S3ToDynamodb

Build Failed Error: PythonPipBuilder:Validation - Binary validation failed for python, searched for python in following locations : ['C:\Users\16464\AppData\Local\Programs\Python\Python310\python.EXE', 'C:\Users\16464\AppData\Local\Microsoft\WindowsApps\python.EXE', 'C:\Users\16464\AppData\Local\Microsoft\WindowsApps\python3.EXE'] which did not satisfy constraints for runtime: python3.6. Do you have python for runtime: python3.6 on your PATH? 2023-01-17 16:36:09,425 | Config file location: C:\Users\16464\Downloads\Reproducible_and_portable_app_in_cloud-main (1)\Reproducible_and_portable_app_in_cloud-main\reproduce\samconfig.toml 2023-01-17 16:36:09,426 | Config file 'C:\Users\16464\Downloads\Reproducible_and_portable_app_in_cloud-main (1)\Reproducible_and_portable_app_in_cloud-main\reproduce\samconfig.toml' does not exist 2023-01-17 16:36:09,427 | Using SAM Template at C:\Users\16464\Downloads\Reproducible_and_portable_app_in_cloud-main (1)\Reproducible_and_portable_app_in_cloud-main\reproduce\template.yml Error: Template file not found at C:\Users\16464\Downloads\Reproducible_and_portable_app_in_cloud-main (1)\Reproducible_and_portable_app_in_cloud-main\reproduce\template.yml Resource provisioning success. Logs folder s3://aws-sam-cli-managed-default-samclisourcebucket-xscicpwnc0z3/06c51409-b616-4470-b678-69d315cc6758.

Error parsing parameter '--entries': Expected: '=', received: ''' for input: '[{Source: ^ Cloud execution start.

C4rohan commented 1 year ago

Try Update the Python version to 3.8 and change update the personal.ini file your_python_runtime= python3.8 ... The other apps have different requirement of python version and maybe you are using a different python version. Highly recommend you keep a constant python version. Also aws-sam-cli now and some important libraries supports python3.8 and higher.

C4rohan commented 1 year ago

Highly recommend to update aws cli to latest version, update python to latest or python3.8 or above. And update the config file your_python_runtime where ever needed.