search

regen100 / lfs-dal

LFS Custom Transfer Agent
MIT License
22 stars 2 forks source link

Upload speed #1

Closed nicolas-graves closed 9 months ago

nicolas-graves commented 9 months ago

Hi ! Developer of https://github.com/nicolas-graves/lfs-s3 here.

I find this initiative very interesting because of the sheer options it allows for git large files management. I'm having some issues when trying to use it though, I will put each in a separate issue.

I'm testing s3 configuration, basically the same that I use in https://github.com/nicolas-graves/lfs-s3

First, I'm having a very slow upload speed. It probably on OpenDAL's side, which seem to use an http process while I use the AWS SDK on my side, but my upload speed is not better than 30Ko/s (compared to more than 1Mo/s with the AWS SDK).

regen100 commented 9 months ago

Thanks for your report! I have reproduced the issue as well. The cause was improper use of buffering in the code I wrote. I have fixed it in #3, please check it out.

nicolas-graves commented 9 months ago

Thanks, that was the issue.