search

littlebizzy / slickstack

Lightning-fast WordPress on Nginx
https://slickstack.io
GNU General Public License v3.0
629 stars 112 forks source link

SS_DASHBOARD fix, rclone working, small fixes/changes - please check #142

Closed backamblock closed 2 years ago

backamblock commented 2 years ago

@jessuppi what do you think about this?

backamblock commented 2 years ago

@jessuppi rclone works fine now, got rate limited a few times on b2. Lucky me used a free b2 account for testing, would've paid some $$$ for API requests if i wasn't limited to free...

@ everybody Words of warning: when uploading to b2, do NOT use /var/www/ it will most likely kill your 2500 free daily Class C transactions in one run. my highscore was 3500 while testing before they could deactivate my api because of 1k parallel transfers 🥇

for parallel transfers. 1000 pins my 2c amd epyc vps to 200% CPU, so i'd recommend staying under 500 parallel transfers if you want to sync /var/www/ as a whole. take 40% of these values for 1c vps, not more for /var/www/backups you can keep the default value of 15

i would definitely recommend using ss-dump-files for a time-correct backup as many things can change in the 10+ minutes rclone will run. but it will use more space of course. i will use it because it is easier to keep track of versions of 2-5 vs 2k files when it comes to restoring them. also i don't want to pay for api transactions on b2. decide for yourself.

edit: File sizes and RAM are 2 important factors to consider! you can set the max file Limit before it is chunked to 5gb, but then it will be chunked to 96mb $parallel_transfers and is stored in RAM! this can easily crash any usual VPS. 9615=1440mb RAM! so set your parallel transfers lower when using the ss dump files method. 2-5 should be enough. remember, parts of your cache are also stored in RAM

edit2: i should integrate a possibility to exclude the ss-config backups or include only the last X.. they are generated every 5 minutes or in that ballpark.

backamblock commented 2 years ago

@jessuppi Hey, please check the commits when you are free. i'd like to close this so i can try some things without spamming this with commits 👍🏻

jessuppi commented 2 years ago

@backamblock Thanks for all your research and help on this, however I'm not very good at Git and there are 28 commits in this single Pull Request which makes it nearly impossible for me to review properly. If possible, it would really help my ability to accept (certain) commits if they were divided into smaller changes?

backamblock commented 2 years ago

@jessuppi yes that is exactly my problem. it seems that i can only make one pull request and whatever i commit to my fork after this, is automatically added :/ i can just close/cancel the pull request

until i figure out how to make it possible with another branch or something, you can see what has changed between your current branch and my last commit in the files section here https://github.com/littlebizzy/slickstack/pull/142/files since i made some pretty useless mini commits with just a missing backslash, this makes it easier to overview the scope

edit: okay the only way is to make a new branch for every scope of commits. i will do that in the future

jessuppi commented 2 years ago

Much appreciated, I will cancel this PR for now since it's too difficult to review entirely.