Hello.
I have discovered a performance degradation in the .concat function of pandas version 1.4.3. And I notice the repository depends on pandas 1.4.3 in requirements.txt. I am not sure whether this performance problem in pandas will affect this repository. I found some discussions on pandas GitHub related to this issue, including #47501 and #47508.
I also found that notebooks/02 - Prepare Data.ipynb used the influenced api. There may be more files using the influenced api.
Suggestion
I would recommend considering an upgrade to a different version of pandas >= 1.4.4 or exploring other solutions to optimize the performance of .concat.
Any other workarounds or solutions would be greatly appreciated.
Thank you!
Issue Description:
Hello. I have discovered a performance degradation in the
.concatfunction of pandas version 1.4.3. And I notice the repository depends on pandas 1.4.3 inrequirements.txt. I am not sure whether this performance problem in pandas will affect this repository. I found some discussions on pandas GitHub related to this issue, including #47501 and #47508. I also found thatnotebooks/02 - Prepare Data.ipynbused the influenced api. There may be more files using the influenced api.Suggestion
I would recommend considering an upgrade to a different version of pandas >= 1.4.4 or exploring other solutions to optimize the performance of
.concat. Any other workarounds or solutions would be greatly appreciated. Thank you!