Could not execute the runtime

[vysecurity]

Using AWS Runtime.

python3 shadowbrute.py -d REDACTED -w subdomain_wordlist.txt
2022-01-24 16:47:39,414 [INFO] File with same name already exists in the bucket, skipping upload
2022-01-24 16:47:39,414 [ERROR] Could not execute the runtime.

Could not execute the runtime. How can I debug?

[fyoorer]

did you update config.py with the name of your runtime? Also, have you completed the setup steps under "local machine" section

[vysecurity]

Yep I did. Getting this error when running too:

python3 shadowclone.py -i abc.txt -s 3 -o a.txt -c "cat {INPUT}"
2022-01-24 19:41:08,703 [INFO] Uploading input file to storage
2022-01-24 19:41:08,796 [INFO] Splitting input file into chunks of 3 lines
2022-01-24 19:41:10,492 [INFO] lithops.config -- Lithops v2.5.8
2022-01-24 19:41:10,501 [INFO] lithops.storage.backends.aws_s3.aws_s3 -- S3 client created - Region: us-west-2
2022-01-24 19:41:11,502 [INFO] lithops.serverless.backends.aws_lambda.aws_lambda -- AWS Lambda client created - Region: us-west-2
2022-01-24 19:41:11,503 [INFO] lithops.invokers -- ExecutorID b1deb7-0 | JobID M000 - Selected Runtime: lithops_v2-5-8_fgwc/shadow-runtime - 512MB
2022-01-24 19:41:11,504 [ERROR] Could not execute the runtime.

But there's not enough debugging info for me to figure out what's wrong with the execution. This happens when running it from an M1 Macbook. The same command works on a VPS.

[vysecurity]

Noticed a bug tonight too. When splitting down a 1000 line file down to 10 lines a file. It's way slow? The operation is slow.

[fyoorer]

Well, that is expected because each chunk is uploaded separately so right now it's causing lots of s3 API requests that's slowing it down. I have got a new idea on reducing s3 api requests, hopefully that will improve the performance dramatically

[vysecurity]

Actually what I'm saying is, I've barely ran anything and it's used over 200k executions already?

[bugbaba]

Just printed the exception object and this is the message. Indicating it can run only with python 3.8 only.

The indicated runtime 'lithops_v2-5-8_3i7d/sc-runtime' is running Python 3.8 and it is not compatible with the local Python version 3.10

[sumgr0]

Facing the same issue as well.

[fyoorer]

Have you tried running with python version 3.8?

[sumgr0]

downgrading the python version would break the other workflows... I would request you to kindly look into supporting the python 3.10 if possible.

[georgebecerescu]

same error.

python --version
Python 3.10.7

Solution seems to be to use pyenv which let you chose 3.8 as running env.