search

ericaltendorf / plotman

Chia plotting manager
Apache License 2.0
911 stars 280 forks source link

only one tmp used at least when using madmax #807

Open altendky opened 3 years ago

altendky commented 3 years ago

Originally posted by @wasdokij in https://github.com/ericaltendorf/plotman/pull/797#issuecomment-867360811

I have a problem

5950x + 3* 2T nvme

Looking at my setup, the results are not what I expected

version: [2]

directories:
        tmp:
                - /ssd1/Plotter
                - /ssd2/Plotter
                - /ssd3/Plotter

        tmp_overrides:
                "/ssd1/Plotter":
                        tmpdir_max_jobs: 2

                "/ssd2/Plotter":
                        tmpdir_max_jobs: 2

                "/ssd3/Plotter":
                        tmpdir_max_jobs: 2

        dst:
                - /d/Plots
                - /e/Plots
                - /f/Plots
                - /g/Plots
                - /h/Plots

scheduling:

        tmpdir_stagger_phase_major: 2
        tmpdir_stagger_phase_minor: 1
        tmpdir_stagger_phase_limit: 1
        tmpdir_max_jobs: 2
        global_max_jobs: 6
        global_stagger_m: 5
        polling_time_s: 20

        type: madmax

        madmax:
                n_threads: 8         
                n_buckets: 256

1624514385031

altendky commented 3 years ago

Sorry, I haven't had time to dig into this too far. Could you share a screenshot of plotman interactive --no-autostart-plotting --no-autostart-archiving? This will show a bit more information about what tmps plotman is acknowledging exist. Also, I don't know if you were adding more tmp drives or such but please make sure to save your config and restart the plotting processes. Check ps aux | grep plotman to make sure you don't have more than one generally. But sure, I don't see any evidence this is caused by multiple instances. Just... looking to make sure we rule out 'the simple stuff'.

altendky commented 3 years ago

@wasdokij, this is still not working for you? I'm inching back towards this being what i need to look into 'soon'.

altendky commented 3 years ago

madmax requires a trailing / on the tmp directory and we had a silly pure equality check that failed due to not having the trailing / on the reference path. Anyways, I merged the fix to development. Let me know if it helps your setup.

wasdokij commented 3 years ago

/

Thank you！ The solution: madmax requires a trailing / on the tmp directory

altendky commented 3 years ago

Well, the fact that madmax required that exposed plotman doing too simplistic of a comparison of directories which has been fixed. plotman already made sure the trailing slash was provided to madmax.