search

lithops-cloud / lithops

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀
http://lithops.cloud
Apache License 2.0
317 stars 105 forks source link

Some libraries missing when installing Lithops #1163

Closed RaulGracia closed 1 year ago

RaulGracia commented 1 year ago

Description of the problem When installing Lithops, the first time that I execute a job requiring S3 access, there is a failure as the library boto3 is missing. I wonder if there could be a better check of the required dependencies and install all of them when running lithops installation (as it may happen also to other libraries). Once the library is manually installed, things work as expected.

JosepSampe commented 1 year ago

When installing lithops for a specific cloud, you have to specify which cloud are you using in order to install specific packages, for example: python3 -m pip install lithops[aws]

https://github.com/lithops-cloud/lithops/blob/master/docs/source/compute_config/aws_lambda.md#installation

JosepSampe commented 1 year ago

In #1166 I included the boto3 lib in the default installation dependencies, so from now on there is no need to explicitly execute python3 -m pip install lithops[aws] anymore for the AWS backends