Qovery / Replibyte

Seed your development database with real data ⚡️
https://www.replibyte.com
GNU General Public License v3.0
4.17k stars 129 forks source link

Performance issues on dump #266

Open cterence opened 1 year ago

cterence commented 1 year ago

Hello,

I've made some basic testing of Replibyte and I'm currently experiencing two performance issues :

Here are the testing conditions :

Hardware :

Software :

With all of this, here are my testing steps :

Creating the dump takes around 11 min at 0.4~0.5 MB/s.

Is there anything that I'm doing wrong ?

Don't hesitate to ask for more details if I've gone over anything, I'll be happy to help.

TheKipmaster commented 1 year ago

I've been having the same issue in a very similar environment. Any word on this?

maxleroy commented 1 year ago

Yup pretty much the same happening here, maybe worse. Running on a ubuntu cloud vm 2vCPUs/4GB RAM, with a local 200MB MySQL database. I get OOM killed with replibyte using 3GB of memory 😬

ikegentz commented 1 year ago

Slow for me as well, even on local disk I'm getting < 1Mib/sec when creating a dump

evoxmusic commented 1 year ago

Hello 👋, I'm aware of this issue and I'm working on benchmarking and performance improvements here. Thanks for your feedback