search

crypto-lake / lake-api

Python API for accessing Lake high frequency tick trades & order book data
https://crypto-lake.com/
Apache License 2.0
28 stars 3 forks source link

Why is Pandas <2 required? #4

Closed IngLP closed 12 months ago

IngLP commented 1 year ago

Description

I want to install lake API with a Pandas version greater than 2.0.0. Why is lake api restricting pandas version to <2?

What I Did

Just installing requirements as follows:

pandas >= 2.1.0
lakeapi
leftys commented 1 year ago

Hi @nosalorenz, this is caused by one of our dependencies awswrangler that also depends on pandas. We are using its older version, that depends on older pandas and cannot simply update it due to some breaking changes. We knew about this issue, but we will increase its priority and hopefully remove the <2 constraint within a few days to solve your issues.

IngLP commented 1 year ago

Hi, thanks for the fast answer. I see the problem. I hope you are able to move to the new awswrangler version as soon as possible.

IngLP commented 1 year ago

Hi, are there any news on this?

leftys commented 1 year ago

Hi @nosalorenz, I just released lakeapi==0.9.1 that should remove awswrangler dependency completely. Check it out and let me know if I can close this, it worked well with latest Pandas version for me plus removed a lot of indirect dependencies from our code.

There are some ugly temporary workarounds there as we would like to move away from direct s3 access completely, but my efforts in this direction were not successful yet.