Manager does not detect phases and so not work

[DM4DS]

The manager starts without any problems. It also starts the configured plots with the correct settings, does logs, all seems running BUT the view stays showing Phase 1, also no progress or temp_size.

And while it doesn´t recognize the phases after 1, it does not start more then the phase 1 configured plots!

Without fix, its useless.

Manager staying in Phase 1:

Log File: CM_2021-05-01_14_00_03_941431.log

Config: config.txt

For security reason I edited the files so you will see some XXX for Keys etc. should´nt a surprise.

Like you see I´m using V1.1.2, maybe it needs a update to the manager?

Thanks for fast reply.

Edit:

1 Plot finished now. The View doesn´t show it anymore and counts 1 finished but before no new plot was started to keep it working using space etc...so it looks like doing the first jobs until all end and then idle...

Edit 2 :)

Progress detected from "GUI-Plots" Before going into bed, and while the manager doesn´t work correct, i started 3 plots in the gui to do some overnight plots. Not more, not less but maybe for interest, so here is the screenshot.

Hope you can help. Your manager is a great idea if it works and I have some more HDD to fill.

EDIT 3!

THE PLOTS are not found:

Why are they not found? The Plot is copied, it is there, but not found?

I´m back in the GUI for now

[mjsr]

Disclaimer: I'm a new user of this plot manager and I'm just trying to help.

Looked at your config.txt file and, out of curiosity, do you see any logs being created in T:\Chia\Logs (this is set as the folder_path value).

Wondering if your logs are not being properly written/read.

[DM4DS]

One of the Logs is attached in the first post , so yes, they are written (correct) and showing the other phases.

[beef1218]

I'm also new to this. Does the manager rely on the line numbers set in the config to find out which phase it is in? Maybe compare the line numbers in config with your actual log file? Another though, maybe try setting the log level from "ERROR" to "INFO" in order to obtain more information to find out what went wrong?

[DM4DS]

@beef1218 if I open the LOG file, the phases end at the correct lines, as in the config specified. Also tryed to +- 3 the lines to get a results but changed nothing.

setting the error level is maybe an idea.

[swar]

It appears that its having a hard time detecting those files.

Are these network drives by any chance? Also can you do as @beef1218 suggested and change log_level to INFO and then let that run for a while and forward over your manager.log output afterwards?

[DM4DS]

While I´m traveling during the week, I´m not sure about time to check the things in the next days. Thought to get it working before I must leave....

The drives are local, but I tested also RAMDisk and LAN Drives, same problem.

I run 2 more PLOTs today and again I ran into the Plots not found problem which only should a problem if the keys are not correct but i checked the LOGs and they are identical. I only run one wallet, no idea what should be wrong.

Maybe I find time during travel to check some things remote.

I also run VMs, maybe I test into one of them just to see what happens.

Thanks for coming back @swar . Taking the time to read all the issues and try to help. Thanks!

[gntz555]

micron_2021-05-03_03_10_30_863699.log

I have a similar issue, where it seems that it won't detect the different phases. Also the discord notifiction doesn't appear when a plot is finished. I just edited the log to INFO and restarted the manager.

[garthheff]

It appears that its having a hard time detecting those files.

Are these network drives by any chance? Also can you do as @beef1218 suggested and change log_level to INFO and then let that run for a while and forward over your manager.log output afterwards?

I fired up proc mon, the files are been read by the manager view to end of file. manager.log doesn't really show much. it's looks like it's failing to detect the stages, is there any debug level logging?

[Stromer199]

I have the same issue. The viewer only shows phase 1 without any change over time. But plots are beeing created. I added the manger.log with degug-leve INFO. But I can't find anything suspicious. manager.log

[42x42x42]

same for me, first opened after install

[42x42x42]

same for me, first opened after install

in my case, only plots launched from GUI are detected correctly. Plots from PowerShell doesn't show progress because there are no logs for them in .chia\mainnet\plotter

[Stromer199]

In order to run the Plot-Manger i did install Python (download from webpage and "classic install") and ran the Plot-Manager straight away without a restart. Last night I de-installed python and re-installed it from the Microsoft Store. Then Over night all running plots were completed so that I could restart the computer this morning. After restart the viewer displays everything correctly. So maybe it has been a python thing or more likely after Python install a restart is required.

[DM4DS]

Thanks for all the posts and hints etc.

Yesterday I tryed again and for the first moment I thought it work while after manager start the view worked for few refreshs! That is a good news I think, cause before I never ever seen % in progress. But, then the view crashed with psutil xxx (sorry I haven´t wrote down the exact message) and after that again the same problem.

Tryed to restart the view, again 0 progress. Tryed restart / stop / start the manager und then start the view, again 0 progress.

It worked until the view crashed.... Running always as admin, also tested without admin, so that couldn´t the problem.

During the week i restarted the machine twice, so restart didn´t solve my problem (@Stromer199 )

What I really not understand is: The Logs look absolutly normal to me. They are readable, they are updated. The Manager looks to work, only the view is broken.

I will run the manager on a second machine and hope that it runs, to see any difference in output of the files etc. Maybe let it run overnight so see if the "complets" count.

If that also doesn´t work, i try it in a VM :) The performace will be horrible but I want to see the % in progress and the phase detection to analyze the difference. To goal is to get it working on the main machine. I still have over 20TB to fill. 36TB already done during the week. :)

[garthheff]

@DM4DS is any of the logs or plots going to a network/mapped drive, my did this until I sent everything locally.

[DM4DS]

@garthheff no, all local. But I tested RAMDisk, NAS (Samba), same problem.

Edit: On my old Phenom it works perfect (not sure which smiley I should use :( or :) ) 15 years old i think and it works first try. I let it run just to see any crashs or whatever. The Phenom uses normal HDDs, so the performance will be horrible and so no option to plot on that machine. But I can compare the LOGs, to see any differences.

[DM4DS]

Yeah - good news! @swar : I tryed the developer version 9 minutes ago and at the moment I´m typing it´s working like it should. Also testing some of the newer features like the delayed start, for me a gimick, but why not. Also testing the "above normal" priority feature.

Please leave it open, so I can come back and report in hours.

I have still 1 13TB drive to fill and 4TB on a bigger one, hope I can show you some screenshots from your fantastic work.

If all works. I can offer to PLOT for other users. I have NVMEs left to "destroy" :)

[DM4DS]

5 - hours later and the manager is doing its job like never before :)

Not sure that the second destination drive is really necessary but your manager could´nt know that I´m using a fast NVMe as staging drive.

Here a picture how it looks with conservative settings for Phase 1, which I changend in the last minutes to run more while Win10 Logs show that the CPU can handle more:

To get the Plots faster from the plotting drives, i use a "staging drive". My 1TB drive C with 1 job less which should be bring enough free space to do that job.

To get the job done, copying the plots to the final HDDs, I´m running a small .bat file to rename the files in the manager destination folder into .temp , robocopy, rename them back to *.plot in the final HDD folder. This way I don´t get the error for the plot during the copy process in the GUI.

Here´s the code:

@echo off :loop set "source=C:\ChiaPlots" set "destination=K:\ChiaK" ren "%source%\*.plot" *.temp robocopy "%source%" "%destination%" /mov *.temp ren "%destination%\*.temp" *.plot timeout /t 60 goto loop (each command should be in a new line to be save, the preview does it all in one line :( )

The destination (without second destination is always "C:\ChiaPlots" and from there I can fill all the different drives just by "updating" the destination until the HDD is filled.

Maybe on option to build into the manager?

@swar : For now I say thanks and coming back tomorrow with hopefully good news while the manager and the view is still runnning.

[DM4DS]

Here we are again :(

After about 8 hours it happend again. Before going into bed I took a last look and what do I see:

Any ideas? Nothing in the LOG

Edit:

After a view Updates psutil going stale and the viewer doesn´t reload:

@swar is there a solution?

[Motophan]

hi.

this occurs when you are using windows and a network drive. if you use robocopy.exe (standard in every version of windows) to copy *.plot files to your samba share you can effectively do what you are trying to do.

C:\Windows\System32\Robocopy.exe H:\ "\\192.168.XX.XX\sambasharename" *.plot /r:0 /w:0 /MOVE /MOT:5

In this example, H:/ is the destination set in swar.

If anyone knows a method to make this window spawn on boot please let me know. Thanks!

[adobito]

@DM4DS I just had this issue and managed to solve it for myself, so maybe this helps you out.

1. Download and run Sysinternals Process Explorer
2. Right click on the top column bar above all the processes -> Select Columns -> Process Performance
3. Check the Handle Count checkbox and press OK.
4. Click on the Handles column to sort by handle count.
5. Check to see if you have any with way more handles than the others. If you do, close it in task manager.

After I did this, my info started showing up in view.

[SkebengZA]

@adobito Just signing in to say this worked for me, thanks! It looks like I had a rogue motherboard app (armoury crate) that was creating thousands of handles and messing with Swar. Strange bug, but my progress monitor is working again.

[DM4DS]

@Motophan I don´t use Networkdrives Running in "autostart" doesn´ t work?

@adobito IT WORKS!

Same as @SkebengZA . It was the Armory Crate from the last Update.

I killed the process and the view works.

@swar : Hope you read this.

Many many thanks, now I can really test this beautiful tool. 11TB left , 50TB already done ...

If someone needs help plotting, after my drives are filled . contact me

[KiudLyrl]

Well it did not work for me (I killed lighting service and armoury crate), some plots are still saying progress : 0.04% and temp_size 0GiB.

[adobito]

@LoudMurmur Did you restart the view? Did you check if you had any other processes leaking handles?

[ksgnu]

@adobito Worked for me, thanks! In my case it was that nasty ASUS Armoury Software as well.

[KiudLyrl]

@adobito yes I did, after killing everything and relaunching it 5 times it worked BUT as it progressed the bug reappeared when it added a 12th plots, this one was stuck at 0.04% again.

I'm going to make a fresh windows installation with nothing installed to see if this solves the problem

[swar]

Try version 0.1.0 to see if it fixes your issues. https://github.com/swar/Swar-Chia-Plot-Manager/releases/tag/v.0.1.0

@DM4DS my inbox is literally spammed with Github emails right now so they are all not making it to me. I will try to check back in here tomorrow.

[DM4DS]

@swar started it 5 minutes ago without problem.

Will come back if something escalates or whatever :)

[timephy]

Hey, having this exact problem on 1 of 2 identical machines... Just suddenly started happening....

bit of digging -> might be caused by or related to https://github.com/giampaolo/psutil/pull/597

(I am on version 0.1.0)

[Emperornero]

Chiming in to say I also have this issue on WSL Version 1.

Why is it unable to read network drives? This seems like an non-issue. No way to save "locally" on WSL Version 1. Linux thinks everything is a network drive.

2021-05-20 14:35:51 [INFO]: Debug Level: INFO
2021-05-20 14:35:51 [INFO]: Chia Location: /home/rainmaker/chia/venv/bin/chia
2021-05-20 14:35:51 [INFO]: Log Directory: /home/rainmaker/plotmanlogs
2021-05-20 14:35:51 [INFO]: Jobs: [{'name': 'WD', 'max_plots': 80, 'farmer_public_key': None, 'pool_public_key': None, 'temporary_directory': ['/mnt/i', '/mnt/h', '/mnt/j'], 'temporary2_directory': None, 'destination_directory': '/mnt/k', 'size': 32, 'bitfield': True, 'threads': 8, 'buckets': 128, 'memory_buffer': 3600, 'max_concurrent': 12, 'max_concurrent_with_start_early': 16, 'initial_delay_minutes': 0, 'stagger_minutes': 10, 'max_for_phase_1': 12, 'concurrency_start_early_phase': 4, 'concurrency_start_early_phase_delay': 0, 'temporary2_destination_sync': False, 'exclude_final_directory': False, 'skip_full_destinations': True, 'unix_process_priority': 10, 'windows_process_priority': 32, 'enable_cpu_affinity': False, 'cpu_affinity': [0, 1, 2, 3, 4, 5]}]
2021-05-20 14:35:51 [INFO]: Manager Check Interval: 60
2021-05-20 14:35:51 [INFO]: Max Concurrent: 15
2021-05-20 14:35:51 [INFO]: Max for Phase 1: 15
2021-05-20 14:35:51 [INFO]: Minimum Minutes between Jobs: 5
2021-05-20 14:35:51 [INFO]: Progress Settings: {'phase1_line_end': 801, 'phase2_line_end': 834, 'phase3_line_end': 2474, 'phase4_line_end': 2620, 'phase1_weight': 33.4, 'phase2_weight': 20.43, 'phase3_weight': 42.29, 'phase4_weight': 3.88}
2021-05-20 14:35:51 [INFO]: Notification Settings: {'notify_discord': True, 'discord_webhook_url': ', 'notify_ifttt': False, 'ifttt_webhook_url': 'https://maker.ifttt.com/trigger/{event}/with/key/{api_key}', 'notify_sound': False, 'song': 'audio.mp3', 'notify_pushover': False, 'pushover_user_key': 'xx', 'pushover_api_key': 'xx', 'notify_telegram': False, 'telegram_token': 'xxxxx', 'notify_twilio': False, 'twilio_account_sid': 'xxxxx', 'twilio_auth_token': 'xxxxx', 'twilio_from_phone': 1234657890, 'twilio_to_phone': 1234657890}
2021-05-20 14:35:51 [INFO]: View Settings: {'check_interval': 60, 'datetime_format': '%Y-%m-%d %H:%M:%S', 'include_seconds_for_phase': False, 'include_drive_info': True, 'include_cpu': True, 'include_ram': True, 'include_plot_stats': True}
2021-05-20 14:35:51 [INFO]: Instrumentation Settings: {'prometheus_enabled': False, 'prometheus_port': 9090}
2021-05-20 14:35:51 [INFO]: Loading jobs into objects.
2021-05-20 14:35:51 [INFO]: Grabbing system drives.
2021-05-20 14:35:51 [INFO]: Found System Drives: ['/sys/fs/cgroup/devices', '/sys/fs/cgroup', '/sys', '/run/user', '/run/shm', '/run/lock', '/run', '/proc/sys/fs/binfmt_misc', '/proc', '/mnt/n', '/mnt/m', '/mnt/k', '/mnt/j', '/mnt/i', '/mnt/h', '/mnt/g', '/mnt/f', '/mnt/e', '/mnt/d', '/mnt/c', '/dev/pts', '/dev', '/']
2021-05-20 14:35:51 [INFO]: Grabbing running plots.
2021-05-20 14:35:51 [INFO]: Getting running plots
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 32
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 3298
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 3773
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 4103
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 4414
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 4955
2021-05-20 14:35:51 [INFO]: Finding log file for process: 32
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 3298
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 3773
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 4103
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 4414
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 4955
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finished finding running plots
2021-05-20 14:35:51 [INFO]: WD Found. Setting next stagger date to 2021-05-20 14:41:52.050000
2021-05-20 14:35:51 [INFO]: Checking to see if stagger needs to be altered due to minimum_minutes_between_jobs. Value: 5
2021-05-20 14:35:51 [INFO]: All dates: [datetime.datetime(2021, 5, 20, 12, 38, 52, 460000), datetime.datetime(2021, 5, 20, 13, 11, 24, 840000), datetime.datetime(2021, 5, 20, 13, 48, 13, 980000), datetime.datetime(2021, 5, 20, 14, 4, 45, 160000), datetime.datetime(2021, 5, 20, 14, 14, 8, 750000), datetime.datetime(2021, 5, 20, 14, 31, 52, 50000)]
2021-05-20 14:35:51 [INFO]: Calculated Latest Job Start Date: 2021-05-20 14:31:52.050000
2021-05-20 14:35:51 [INFO]: Calculated Minimum Stagger: 2021-05-20 14:36:52.050000
2021-05-20 14:35:51 [INFO]: Skipping stagger for WD. Stagger is larger than minimum_minutes_between_jobs. Minimum: 2021-05-20 14:36:52.050000, Current: 2021-05-20 14:41:52.050000
2021-05-20 14:35:51 [INFO]: Starting loop.
2021-05-20 14:35:51 [INFO]: Checking log progress..
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:35:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:35:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:35:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:35:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:35:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:35:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:36:51 [INFO]: Checking log progress..
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:36:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:36:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:36:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:36:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:36:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:36:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:37:51 [INFO]: Checking log progress..
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:37:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:37:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:37:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:37:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:37:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:37:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:38:51 [INFO]: Checking log progress..
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:38:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:38:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:38:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:38:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:38:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:38:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:39:51 [INFO]: Checking log progress..
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:39:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:39:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:39:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:39:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:39:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:39:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:40:51 [INFO]: Checking log progress..
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:40:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:40:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:40:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:40:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:40:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:40:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:41:51 [INFO]: Checking log progress..
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:41:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:41:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:41:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:41:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:41:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:41:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:42:51 [INFO]: Checking log progress..
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:42:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:42:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:42:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:42:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:42:51 [INFO]: Calculating new job stagger time. Next stagger kickoff: 2021-05-20 14:52:51.243152
2021-05-20 14:42:51 [INFO]: Setting a minimum stagger for all jobs. 5
2021-05-20 14:42:51 [INFO]: Skipping stagger for WD. Stagger is larger than minimum_minutes_between_jobs. Min: 2021-05-20 14:47:51.243217, Current: 2021-05-20 14:52:51.243152
2021-05-20 14:42:51 [INFO]: Starting new plot for job: WD
2021-05-20 14:42:51 [INFO]: Job log file path: /home/rainmaker/plotmanlogs/WD_2021-05-20_14_42_51_243282.log
2021-05-20 14:42:51 [INFO]: Checking for full destinations.
2021-05-20 14:42:51 [INFO]: Drive "/mnt/k" has 1346146784256 free space.
2021-05-20 14:42:51 [INFO]: Job temporary directory: /mnt/i
2021-05-20 14:42:51 [INFO]: Job destination directory: /mnt/k
2021-05-20 14:42:51 [INFO]: Job temporary2 directory: None
2021-05-20 14:42:51 [INFO]: Starting with plot command: ['/home/rainmaker/chia/venv/bin/chia', 'plots', 'create', '-k', '32', '-b', '3600', '-t', '/mnt/i', '-d', '/mnt/k', '-r', '8', '-u', '128']
2021-05-20 14:42:51 [INFO]: Starting process
2021-05-20 14:42:51 [INFO]: Started process: 5338
2021-05-20 14:42:51 [INFO]: Setting priority level: 10
2021-05-20 14:42:51 [INFO]: Set priority level
2021-05-20 14:42:51 [INFO]: Job total running: 7
2021-05-20 14:42:51 [INFO]: Job running: [32, 3298, 3773, 4103, 4414, 4955, 5338]
2021-05-20 14:42:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:43:51 [INFO]: Checking log progress..
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:43:51 [INFO]: PID still alive: 5338
2021-05-20 14:43:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:43:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:43:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:43:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:43:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:43:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:44:51 [INFO]: Checking log progress..
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:44:51 [INFO]: PID still alive: 5338
2021-05-20 14:44:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:44:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:44:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:44:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:44:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:44:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:45:51 [INFO]: Checking log progress..
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:45:51 [INFO]: PID still alive: 5338
2021-05-20 14:45:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:45:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:45:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:45:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:45:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:45:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:46:51 [INFO]: Checking log progress..
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:46:51 [INFO]: PID still alive: 5338
2021-05-20 14:46:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:46:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:46:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:46:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:46:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:46:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:47:51 [INFO]: Checking log progress..
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:47:51 [INFO]: PID still alive: 5338
2021-05-20 14:47:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:47:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:47:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:47:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:47:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:47:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:48:51 [INFO]: Checking log progress..
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:48:51 [INFO]: PID still alive: 5338
2021-05-20 14:48:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:48:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:48:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:48:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:48:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:48:51 [INFO]: Sleeping for 60 seconds.

[adobito]

Chiming in to say I also have this issue on WSL Version 1.

Why is it unable to read network drives? This seems like an non-issue. No way to save "locally" on WSL Version 1. Linux thinks everything is a network drive.

2021-05-20 14:35:51 [INFO]: Debug Level: INFO
2021-05-20 14:35:51 [INFO]: Chia Location: /home/rainmaker/chia/venv/bin/chia
2021-05-20 14:35:51 [INFO]: Log Directory: /home/rainmaker/plotmanlogs
2021-05-20 14:35:51 [INFO]: Jobs: [{'name': 'WD', 'max_plots': 80, 'farmer_public_key': None, 'pool_public_key': None, 'temporary_directory': ['/mnt/i', '/mnt/h', '/mnt/j'], 'temporary2_directory': None, 'destination_directory': '/mnt/k', 'size': 32, 'bitfield': True, 'threads': 8, 'buckets': 128, 'memory_buffer': 3600, 'max_concurrent': 12, 'max_concurrent_with_start_early': 16, 'initial_delay_minutes': 0, 'stagger_minutes': 10, 'max_for_phase_1': 12, 'concurrency_start_early_phase': 4, 'concurrency_start_early_phase_delay': 0, 'temporary2_destination_sync': False, 'exclude_final_directory': False, 'skip_full_destinations': True, 'unix_process_priority': 10, 'windows_process_priority': 32, 'enable_cpu_affinity': False, 'cpu_affinity': [0, 1, 2, 3, 4, 5]}]
2021-05-20 14:35:51 [INFO]: Manager Check Interval: 60
2021-05-20 14:35:51 [INFO]: Max Concurrent: 15
2021-05-20 14:35:51 [INFO]: Max for Phase 1: 15
2021-05-20 14:35:51 [INFO]: Minimum Minutes between Jobs: 5
2021-05-20 14:35:51 [INFO]: Progress Settings: {'phase1_line_end': 801, 'phase2_line_end': 834, 'phase3_line_end': 2474, 'phase4_line_end': 2620, 'phase1_weight': 33.4, 'phase2_weight': 20.43, 'phase3_weight': 42.29, 'phase4_weight': 3.88}
2021-05-20 14:35:51 [INFO]: Notification Settings: {'notify_discord': True, 'discord_webhook_url': ', 'notify_ifttt': False, 'ifttt_webhook_url': 'https://maker.ifttt.com/trigger/{event}/with/key/{api_key}', 'notify_sound': False, 'song': 'audio.mp3', 'notify_pushover': False, 'pushover_user_key': 'xx', 'pushover_api_key': 'xx', 'notify_telegram': False, 'telegram_token': 'xxxxx', 'notify_twilio': False, 'twilio_account_sid': 'xxxxx', 'twilio_auth_token': 'xxxxx', 'twilio_from_phone': 1234657890, 'twilio_to_phone': 1234657890}
2021-05-20 14:35:51 [INFO]: View Settings: {'check_interval': 60, 'datetime_format': '%Y-%m-%d %H:%M:%S', 'include_seconds_for_phase': False, 'include_drive_info': True, 'include_cpu': True, 'include_ram': True, 'include_plot_stats': True}
2021-05-20 14:35:51 [INFO]: Instrumentation Settings: {'prometheus_enabled': False, 'prometheus_port': 9090}
2021-05-20 14:35:51 [INFO]: Loading jobs into objects.
2021-05-20 14:35:51 [INFO]: Grabbing system drives.
2021-05-20 14:35:51 [INFO]: Found System Drives: ['/sys/fs/cgroup/devices', '/sys/fs/cgroup', '/sys', '/run/user', '/run/shm', '/run/lock', '/run', '/proc/sys/fs/binfmt_misc', '/proc', '/mnt/n', '/mnt/m', '/mnt/k', '/mnt/j', '/mnt/i', '/mnt/h', '/mnt/g', '/mnt/f', '/mnt/e', '/mnt/d', '/mnt/c', '/dev/pts', '/dev', '/']
2021-05-20 14:35:51 [INFO]: Grabbing running plots.
2021-05-20 14:35:51 [INFO]: Getting running plots
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 32
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 3298
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 3773
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 4103
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 4414
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 4955
2021-05-20 14:35:51 [INFO]: Finding log file for process: 32
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 3298
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 3773
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 4103
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 4414
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 4955
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finished finding running plots
2021-05-20 14:35:51 [INFO]: WD Found. Setting next stagger date to 2021-05-20 14:41:52.050000
2021-05-20 14:35:51 [INFO]: Checking to see if stagger needs to be altered due to minimum_minutes_between_jobs. Value: 5
2021-05-20 14:35:51 [INFO]: All dates: [datetime.datetime(2021, 5, 20, 12, 38, 52, 460000), datetime.datetime(2021, 5, 20, 13, 11, 24, 840000), datetime.datetime(2021, 5, 20, 13, 48, 13, 980000), datetime.datetime(2021, 5, 20, 14, 4, 45, 160000), datetime.datetime(2021, 5, 20, 14, 14, 8, 750000), datetime.datetime(2021, 5, 20, 14, 31, 52, 50000)]
2021-05-20 14:35:51 [INFO]: Calculated Latest Job Start Date: 2021-05-20 14:31:52.050000
2021-05-20 14:35:51 [INFO]: Calculated Minimum Stagger: 2021-05-20 14:36:52.050000
2021-05-20 14:35:51 [INFO]: Skipping stagger for WD. Stagger is larger than minimum_minutes_between_jobs. Minimum: 2021-05-20 14:36:52.050000, Current: 2021-05-20 14:41:52.050000
2021-05-20 14:35:51 [INFO]: Starting loop.
2021-05-20 14:35:51 [INFO]: Checking log progress..
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:35:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:35:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:35:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:35:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:35:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:35:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:36:51 [INFO]: Checking log progress..
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:36:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:36:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:36:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:36:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:36:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:36:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:37:51 [INFO]: Checking log progress..
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:37:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:37:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:37:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:37:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:37:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:37:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:38:51 [INFO]: Checking log progress..
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:38:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:38:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:38:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:38:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:38:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:38:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:39:51 [INFO]: Checking log progress..
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:39:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:39:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:39:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:39:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:39:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:39:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:40:51 [INFO]: Checking log progress..
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:40:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:40:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:40:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:40:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:40:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:40:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:41:51 [INFO]: Checking log progress..
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:41:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:41:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:41:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:41:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:41:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:41:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:42:51 [INFO]: Checking log progress..
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:42:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:42:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:42:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:42:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:42:51 [INFO]: Calculating new job stagger time. Next stagger kickoff: 2021-05-20 14:52:51.243152
2021-05-20 14:42:51 [INFO]: Setting a minimum stagger for all jobs. 5
2021-05-20 14:42:51 [INFO]: Skipping stagger for WD. Stagger is larger than minimum_minutes_between_jobs. Min: 2021-05-20 14:47:51.243217, Current: 2021-05-20 14:52:51.243152
2021-05-20 14:42:51 [INFO]: Starting new plot for job: WD
2021-05-20 14:42:51 [INFO]: Job log file path: /home/rainmaker/plotmanlogs/WD_2021-05-20_14_42_51_243282.log
2021-05-20 14:42:51 [INFO]: Checking for full destinations.
2021-05-20 14:42:51 [INFO]: Drive "/mnt/k" has 1346146784256 free space.
2021-05-20 14:42:51 [INFO]: Job temporary directory: /mnt/i
2021-05-20 14:42:51 [INFO]: Job destination directory: /mnt/k
2021-05-20 14:42:51 [INFO]: Job temporary2 directory: None
2021-05-20 14:42:51 [INFO]: Starting with plot command: ['/home/rainmaker/chia/venv/bin/chia', 'plots', 'create', '-k', '32', '-b', '3600', '-t', '/mnt/i', '-d', '/mnt/k', '-r', '8', '-u', '128']
2021-05-20 14:42:51 [INFO]: Starting process
2021-05-20 14:42:51 [INFO]: Started process: 5338
2021-05-20 14:42:51 [INFO]: Setting priority level: 10
2021-05-20 14:42:51 [INFO]: Set priority level
2021-05-20 14:42:51 [INFO]: Job total running: 7
2021-05-20 14:42:51 [INFO]: Job running: [32, 3298, 3773, 4103, 4414, 4955, 5338]
2021-05-20 14:42:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:43:51 [INFO]: Checking log progress..
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:43:51 [INFO]: PID still alive: 5338
2021-05-20 14:43:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:43:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:43:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:43:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:43:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:43:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:44:51 [INFO]: Checking log progress..
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:44:51 [INFO]: PID still alive: 5338
2021-05-20 14:44:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:44:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:44:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:44:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:44:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:44:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:45:51 [INFO]: Checking log progress..
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:45:51 [INFO]: PID still alive: 5338
2021-05-20 14:45:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:45:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:45:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:45:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:45:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:45:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:46:51 [INFO]: Checking log progress..
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:46:51 [INFO]: PID still alive: 5338
2021-05-20 14:46:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:46:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:46:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:46:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:46:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:46:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:47:51 [INFO]: Checking log progress..
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:47:51 [INFO]: PID still alive: 5338
2021-05-20 14:47:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:47:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:47:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:47:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:47:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:47:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:48:51 [INFO]: Checking log progress..
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:48:51 [INFO]: PID still alive: 5338
2021-05-20 14:48:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:48:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:48:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:48:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:48:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:48:51 [INFO]: Sleeping for 60 seconds.

From the info you posted, I don't understand what your issue is. Can you add more details about what specifically is not behaving how you expect ti to?

[Emperornero]

Chiming in to say I also have this issue on WSL Version 1. Why is it unable to read network drives? This seems like an non-issue. No way to save "locally" on WSL Version 1. Linux thinks everything is a network drive.

2021-05-20 14:35:51 [INFO]: Debug Level: INFO
2021-05-20 14:35:51 [INFO]: Chia Location: /home/rainmaker/chia/venv/bin/chia
2021-05-20 14:35:51 [INFO]: Log Directory: /home/rainmaker/plotmanlogs
2021-05-20 14:35:51 [INFO]: Jobs: [{'name': 'WD', 'max_plots': 80, 'farmer_public_key': None, 'pool_public_key': None, 'temporary_directory': ['/mnt/i', '/mnt/h', '/mnt/j'], 'temporary2_directory': None, 'destination_directory': '/mnt/k', 'size': 32, 'bitfield': True, 'threads': 8, 'buckets': 128, 'memory_buffer': 3600, 'max_concurrent': 12, 'max_concurrent_with_start_early': 16, 'initial_delay_minutes': 0, 'stagger_minutes': 10, 'max_for_phase_1': 12, 'concurrency_start_early_phase': 4, 'concurrency_start_early_phase_delay': 0, 'temporary2_destination_sync': False, 'exclude_final_directory': False, 'skip_full_destinations': True, 'unix_process_priority': 10, 'windows_process_priority': 32, 'enable_cpu_affinity': False, 'cpu_affinity': [0, 1, 2, 3, 4, 5]}]
2021-05-20 14:35:51 [INFO]: Manager Check Interval: 60
2021-05-20 14:35:51 [INFO]: Max Concurrent: 15
2021-05-20 14:35:51 [INFO]: Max for Phase 1: 15
2021-05-20 14:35:51 [INFO]: Minimum Minutes between Jobs: 5
2021-05-20 14:35:51 [INFO]: Progress Settings: {'phase1_line_end': 801, 'phase2_line_end': 834, 'phase3_line_end': 2474, 'phase4_line_end': 2620, 'phase1_weight': 33.4, 'phase2_weight': 20.43, 'phase3_weight': 42.29, 'phase4_weight': 3.88}
2021-05-20 14:35:51 [INFO]: Notification Settings: {'notify_discord': True, 'discord_webhook_url': ', 'notify_ifttt': False, 'ifttt_webhook_url': 'https://maker.ifttt.com/trigger/{event}/with/key/{api_key}', 'notify_sound': False, 'song': 'audio.mp3', 'notify_pushover': False, 'pushover_user_key': 'xx', 'pushover_api_key': 'xx', 'notify_telegram': False, 'telegram_token': 'xxxxx', 'notify_twilio': False, 'twilio_account_sid': 'xxxxx', 'twilio_auth_token': 'xxxxx', 'twilio_from_phone': 1234657890, 'twilio_to_phone': 1234657890}
2021-05-20 14:35:51 [INFO]: View Settings: {'check_interval': 60, 'datetime_format': '%Y-%m-%d %H:%M:%S', 'include_seconds_for_phase': False, 'include_drive_info': True, 'include_cpu': True, 'include_ram': True, 'include_plot_stats': True}
2021-05-20 14:35:51 [INFO]: Instrumentation Settings: {'prometheus_enabled': False, 'prometheus_port': 9090}
2021-05-20 14:35:51 [INFO]: Loading jobs into objects.
2021-05-20 14:35:51 [INFO]: Grabbing system drives.
2021-05-20 14:35:51 [INFO]: Found System Drives: ['/sys/fs/cgroup/devices', '/sys/fs/cgroup', '/sys', '/run/user', '/run/shm', '/run/lock', '/run', '/proc/sys/fs/binfmt_misc', '/proc', '/mnt/n', '/mnt/m', '/mnt/k', '/mnt/j', '/mnt/i', '/mnt/h', '/mnt/g', '/mnt/f', '/mnt/e', '/mnt/d', '/mnt/c', '/dev/pts', '/dev', '/']
2021-05-20 14:35:51 [INFO]: Grabbing running plots.
2021-05-20 14:35:51 [INFO]: Getting running plots
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 32
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 3298
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 3773
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 4103
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 4414
2021-05-20 14:35:51 [INFO]: Found chia plotting process: 4955
2021-05-20 14:35:51 [INFO]: Finding log file for process: 32
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 3298
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 3773
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 4103
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 4414
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finding log file for process: 4955
2021-05-20 14:35:51 [INFO]: Finding associated job
2021-05-20 14:35:51 [INFO]: Found job: WD
2021-05-20 14:35:51 [INFO]: Finished finding running plots
2021-05-20 14:35:51 [INFO]: WD Found. Setting next stagger date to 2021-05-20 14:41:52.050000
2021-05-20 14:35:51 [INFO]: Checking to see if stagger needs to be altered due to minimum_minutes_between_jobs. Value: 5
2021-05-20 14:35:51 [INFO]: All dates: [datetime.datetime(2021, 5, 20, 12, 38, 52, 460000), datetime.datetime(2021, 5, 20, 13, 11, 24, 840000), datetime.datetime(2021, 5, 20, 13, 48, 13, 980000), datetime.datetime(2021, 5, 20, 14, 4, 45, 160000), datetime.datetime(2021, 5, 20, 14, 14, 8, 750000), datetime.datetime(2021, 5, 20, 14, 31, 52, 50000)]
2021-05-20 14:35:51 [INFO]: Calculated Latest Job Start Date: 2021-05-20 14:31:52.050000
2021-05-20 14:35:51 [INFO]: Calculated Minimum Stagger: 2021-05-20 14:36:52.050000
2021-05-20 14:35:51 [INFO]: Skipping stagger for WD. Stagger is larger than minimum_minutes_between_jobs. Minimum: 2021-05-20 14:36:52.050000, Current: 2021-05-20 14:41:52.050000
2021-05-20 14:35:51 [INFO]: Starting loop.
2021-05-20 14:35:51 [INFO]: Checking log progress..
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:35:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:35:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:35:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: /mnt/k
2021-05-20 14:35:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:35:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:35:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:35:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:35:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:36:51 [INFO]: Checking log progress..
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:36:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:36:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:36:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: /mnt/k
2021-05-20 14:36:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:36:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:36:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:36:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:36:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:37:51 [INFO]: Checking log progress..
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:37:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:37:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:37:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: /mnt/k
2021-05-20 14:37:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:37:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:37:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:37:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:37:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:38:51 [INFO]: Checking log progress..
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:38:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:38:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:38:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: /mnt/k
2021-05-20 14:38:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:38:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:38:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:38:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:38:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:39:51 [INFO]: Checking log progress..
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:39:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:39:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:39:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: /mnt/k
2021-05-20 14:39:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:39:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:39:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:39:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:39:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:40:51 [INFO]: Checking log progress..
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:40:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:40:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:40:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: /mnt/k
2021-05-20 14:40:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:40:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:40:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:40:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:40:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:41:51 [INFO]: Checking log progress..
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:41:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:41:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:41:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: /mnt/k
2021-05-20 14:41:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:41:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:41:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:41:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:41:52.050000
2021-05-20 14:41:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:42:51 [INFO]: Checking log progress..
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:42:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:42:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:42:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: /mnt/k
2021-05-20 14:42:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:42:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:42:51 [INFO]: Total jobs in phase 1: 6
2021-05-20 14:42:51 [INFO]: Calculating new job stagger time. Next stagger kickoff: 2021-05-20 14:52:51.243152
2021-05-20 14:42:51 [INFO]: Setting a minimum stagger for all jobs. 5
2021-05-20 14:42:51 [INFO]: Skipping stagger for WD. Stagger is larger than minimum_minutes_between_jobs. Min: 2021-05-20 14:47:51.243217, Current: 2021-05-20 14:52:51.243152
2021-05-20 14:42:51 [INFO]: Starting new plot for job: WD
2021-05-20 14:42:51 [INFO]: Job log file path: /home/rainmaker/plotmanlogs/WD_2021-05-20_14_42_51_243282.log
2021-05-20 14:42:51 [INFO]: Checking for full destinations.
2021-05-20 14:42:51 [INFO]: Drive "/mnt/k" has 1346146784256 free space.
2021-05-20 14:42:51 [INFO]: Job temporary directory: /mnt/i
2021-05-20 14:42:51 [INFO]: Job destination directory: /mnt/k
2021-05-20 14:42:51 [INFO]: Job temporary2 directory: None
2021-05-20 14:42:51 [INFO]: Starting with plot command: ['/home/rainmaker/chia/venv/bin/chia', 'plots', 'create', '-k', '32', '-b', '3600', '-t', '/mnt/i', '-d', '/mnt/k', '-r', '8', '-u', '128']
2021-05-20 14:42:51 [INFO]: Starting process
2021-05-20 14:42:51 [INFO]: Started process: 5338
2021-05-20 14:42:51 [INFO]: Setting priority level: 10
2021-05-20 14:42:51 [INFO]: Set priority level
2021-05-20 14:42:51 [INFO]: Job total running: 7
2021-05-20 14:42:51 [INFO]: Job running: [32, 3298, 3773, 4103, 4414, 4955, 5338]
2021-05-20 14:42:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:43:51 [INFO]: Checking log progress..
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:43:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:43:51 [INFO]: PID still alive: 5338
2021-05-20 14:43:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:43:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: /mnt/k
2021-05-20 14:43:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:43:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:43:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:43:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:43:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:44:51 [INFO]: Checking log progress..
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:44:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:44:51 [INFO]: PID still alive: 5338
2021-05-20 14:44:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:44:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: /mnt/k
2021-05-20 14:44:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:44:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:44:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:44:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:44:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:45:51 [INFO]: Checking log progress..
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:45:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:45:51 [INFO]: PID still alive: 5338
2021-05-20 14:45:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:45:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: /mnt/k
2021-05-20 14:45:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:45:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:45:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:45:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:45:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:46:51 [INFO]: Checking log progress..
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:46:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:46:51 [INFO]: PID still alive: 5338
2021-05-20 14:46:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:46:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: /mnt/k
2021-05-20 14:46:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:46:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:46:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:46:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:46:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:47:51 [INFO]: Checking log progress..
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:47:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:47:51 [INFO]: PID still alive: 5338
2021-05-20 14:47:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:47:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: /mnt/k
2021-05-20 14:47:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:47:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:47:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:47:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:47:51 [INFO]: Sleeping for 60 seconds.
2021-05-20 14:48:51 [INFO]: Checking log progress..
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 32
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 3298
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 3773
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 4103
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 4414
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 4955
2021-05-20 14:48:51 [INFO]: Checking log progress for PID: 5338
2021-05-20 14:48:51 [INFO]: PID still alive: 5338
2021-05-20 14:48:51 [INFO]: Monitoring jobs to start.
2021-05-20 14:48:51 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146784256}
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: /mnt/k
2021-05-20 14:48:51 [INFO]: Free space after checking active jobs: {'/mnt/k': 1346146784256}
2021-05-20 14:48:51 [INFO]: Checking to queue work for job: WD
2021-05-20 14:48:51 [INFO]: Total jobs in phase 1: 7
2021-05-20 14:48:51 [INFO]: Waiting for job stagger, skipping. Next allowable time: 2021-05-20 14:52:51.243152
2021-05-20 14:48:51 [INFO]: Sleeping for 60 seconds.

From the info you posted, I don't understand what your issue is. Can you add more details about what specifically is not behaving how you expect ti to?

Is it not supposed to detect the plot ID and the time per phase?

[adobito]

From the info you posted, I don't understand what your issue is. Can you add more details about what specifically is not behaving how you expect ti to?

Is it not supposed to detect the plot ID and the time per phase?

Yes, but those come from the log file generated by the plotter process. Maybe your plotmanager can't find them or doesn't have access to read them?

[Emperornero]

If it wasn't able to see the files wouldn't it not be able to detect how many were running?

For some reason it is just not able to read the files. Why would that be?

On Thu, May 20, 2021, 5:10 PM Jesús Luzón @.***> wrote:

From the info you posted, I don't understand what your issue is. Can you add more details about what specifically is not behaving how you expect ti to?

Is it not supposed to detect the plot ID and the time per phase?

Yes, but those come from the log file generated by the plotter process. Maybe your plotmanager can't find them or doesn't have access to read them?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/swar/Swar-Chia-Plot-Manager/issues/53#issuecomment-845562303, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACSSRVBTVOYV7DRBG3TFP7TTOWQIFANCNFSM436Y3H5A .

[adobito]

If it wasn't able to see the files wouldn't it not be able to detect how many were running? For some reason it is just not able to read the files. Why would that be? … On Thu, May 20, 2021, 5:10 PM Jesús Luzón @.***> wrote: From the info you posted, I don't understand what your issue is. Can you add more details about what specifically is not behaving how you expect ti to? Is it not supposed to detect the plot ID and the time per phase? Yes, but those come from the log file generated by the plotter process. Maybe your plotmanager can't find them or doesn't have access to read them? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#53 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACSSRVBTVOYV7DRBG3TFP7TTOWQIFANCNFSM436Y3H5A .

It knows what plots are running by checking running processes. It knows the progress of each plot by reading the log file.

[Emperornero]

If it wasn't able to see the files wouldn't it not be able to detect how many were running? For some reason it is just not able to read the files. Why would that be? … On Thu, May 20, 2021, 5:10 PM Jesús Luzón @.***> wrote: From the info you posted, I don't understand what your issue is. Can you add more details about what specifically is not behaving how you expect ti to? Is it not supposed to detect the plot ID and the time per phase? Yes, but those come from the log file generated by the plotter process. Maybe your plotmanager can't find them or doesn't have access to read them? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#53 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACSSRVBTVOYV7DRBG3TFP7TTOWQIFANCNFSM436Y3H5A .

It knows what plots are running by checking running processes. It knows the progress of each plot by reading the log file.

I'm aware of that, I'm saying it's not reading the logs, so it doesn't know what the progress is at.

Meanwhile, my process is now hanging because even though 6 of the plots are done, because it can't read the logs but it knows about the process ID, it is still believing they are running..... Isn't it supposed to start new plots after the current ones are done?

2021-05-20 19:44:03 [INFO]: Free space after checking active jobs: {'/mnt/k': 910788162560}
2021-05-20 19:44:03 [INFO]: Checking to queue work for job: WD
2021-05-20 19:44:03 [INFO]: Total jobs in phase 1: 6
2021-05-20 19:44:03 [INFO]: Job's max concurrent limit has been met, skipping. Max concurrent minus start_early: 12, Max concurrent: 12
2021-05-20 19:44:03 [INFO]: Sleeping for 60 seconds.
2021-05-20 19:45:03 [INFO]: Checking log progress..
2021-05-20 19:45:03 [INFO]: Checking log progress for PID: 32
2021-05-20 19:45:03 [INFO]: Checking log progress for PID: 3298
2021-05-20 19:45:03 [INFO]: Checking log progress for PID: 3773
2021-05-20 19:45:03 [INFO]: Checking log progress for PID: 4103
2021-05-20 19:45:03 [INFO]: Checking log progress for PID: 4414
2021-05-20 19:45:03 [INFO]: Checking log progress for PID: 4955
2021-05-20 19:45:03 [INFO]: Checking log progress for PID: 5338
2021-05-20 19:45:03 [INFO]: PID still alive: 5338
2021-05-20 19:45:03 [INFO]: Checking log progress for PID: 5714
2021-05-20 19:45:03 [INFO]: PID still alive: 5714
2021-05-20 19:45:03 [INFO]: Checking log progress for PID: 6080
2021-05-20 19:45:03 [INFO]: PID still alive: 6080
2021-05-20 19:45:03 [INFO]: Checking log progress for PID: 6442
2021-05-20 19:45:03 [INFO]: PID still alive: 6442
2021-05-20 19:45:03 [INFO]: Checking log progress for PID: 6805
2021-05-20 19:45:03 [INFO]: PID still alive: 6805
2021-05-20 19:45:03 [INFO]: Checking log progress for PID: 7168
2021-05-20 19:45:03 [INFO]: PID still alive: 7168
2021-05-20 19:45:03 [INFO]: Monitoring jobs to start.
2021-05-20 19:45:03 [INFO]: Free space before checking active jobs: {'/mnt/k': 1564788162560}
2021-05-20 19:45:03 [INFO]: /mnt/k
2021-05-20 19:45:03 [INFO]: /mnt/k
2021-05-20 19:45:03 [INFO]: /mnt/k
2021-05-20 19:45:03 [INFO]: /mnt/k
2021-05-20 19:45:03 [INFO]: /mnt/k
2021-05-20 19:45:03 [INFO]: /mnt/k
2021-05-20 19:45:03 [INFO]: Free space after checking active jobs: {'/mnt/k': 910788162560}
2021-05-20 19:45:03 [INFO]: Checking to queue work for job: WD
2021-05-20 19:45:03 [INFO]: Total jobs in phase 1: 6
2021-05-20 19:45:03 [INFO]: Job's max concurrent limit has been met, skipping. Max concurrent minus start_early: 12, Max concurrent: 12
2021-05-20 19:45:03 [INFO]: Sleeping for 60 seconds.
2021-05-20 19:46:03 [INFO]: Checking log progress..
2021-05-20 19:46:03 [INFO]: Checking log progress for PID: 32
2021-05-20 19:46:03 [INFO]: Checking log progress for PID: 3298
2021-05-20 19:46:03 [INFO]: Checking log progress for PID: 3773
2021-05-20 19:46:03 [INFO]: Checking log progress for PID: 4103
2021-05-20 19:46:03 [INFO]: Checking log progress for PID: 4414
2021-05-20 19:46:03 [INFO]: Checking log progress for PID: 4955
2021-05-20 19:46:03 [INFO]: Checking log progress for PID: 5338
2021-05-20 19:46:03 [INFO]: PID still alive: 5338
2021-05-20 19:46:03 [INFO]: Checking log progress for PID: 5714
2021-05-20 19:46:03 [INFO]: PID still alive: 5714
2021-05-20 19:46:03 [INFO]: Checking log progress for PID: 6080
2021-05-20 19:46:03 [INFO]: PID still alive: 6080
2021-05-20 19:46:03 [INFO]: Checking log progress for PID: 6442
2021-05-20 19:46:03 [INFO]: PID still alive: 6442
2021-05-20 19:46:03 [INFO]: Checking log progress for PID: 6805
2021-05-20 19:46:03 [INFO]: PID still alive: 6805
2021-05-20 19:46:03 [INFO]: Checking log progress for PID: 7168
2021-05-20 19:46:03 [INFO]: PID still alive: 7168
2021-05-20 19:46:03 [INFO]: Monitoring jobs to start.
2021-05-20 19:46:03 [INFO]: Free space before checking active jobs: {'/mnt/k': 1564788162560}
2021-05-20 19:46:03 [INFO]: /mnt/k
2021-05-20 19:46:03 [INFO]: /mnt/k
2021-05-20 19:46:03 [INFO]: /mnt/k
2021-05-20 19:46:03 [INFO]: /mnt/k
2021-05-20 19:46:03 [INFO]: /mnt/k
2021-05-20 19:46:03 [INFO]: /mnt/k
2021-05-20 19:46:03 [INFO]: Free space after checking active jobs: {'/mnt/k': 910788162560}
2021-05-20 19:46:03 [INFO]: Checking to queue work for job: WD
2021-05-20 19:46:03 [INFO]: Total jobs in phase 1: 6
2021-05-20 19:46:03 [INFO]: Job's max concurrent limit has been met, skipping. Max concurrent minus start_early: 12, Max concurrent: 12
2021-05-20 19:46:03 [INFO]: Sleeping for 60 seconds.

[adobito]

If it wasn't able to see the files wouldn't it not be able to detect how many were running? For some reason it is just not able to read the files. Why would that be? … On Thu, May 20, 2021, 5:10 PM Jesús Luzón @.***> wrote: From the info you posted, I don't understand what your issue is. Can you add more details about what specifically is not behaving how you expect ti to? Is it not supposed to detect the plot ID and the time per phase? Yes, but those come from the log file generated by the plotter process. Maybe your plotmanager can't find them or doesn't have access to read them? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#53 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACSSRVBTVOYV7DRBG3TFP7TTOWQIFANCNFSM436Y3H5A .

It knows what plots are running by checking running processes. It knows the progress of each plot by reading the log file.

I'm aware of that, I'm saying it's not reading the logs, so it doesn't know what the progress is at.

Meanwhile, my process is now hanging because even though 6 of the plots are done, because it can't read the logs but it knows about the process ID, it is still believing they are running..... Isn't it supposed to start new plots after the current ones are done?

That's not how it works. It knows to show the plot or not depending on the process running. If the process is still running, it'll show. When the process is done, it won't be shown anymore. You can try and confirm if the processes shown are the same you have running on your computer.

[Emperornero]

If it wasn't able to see the files wouldn't it not be able to detect how many were running? For some reason it is just not able to read the files. Why would that be? … On Thu, May 20, 2021, 5:10 PM Jesús Luzón @.***> wrote: From the info you posted, I don't understand what your issue is. Can you add more details about what specifically is not behaving how you expect ti to? Is it not supposed to detect the plot ID and the time per phase? Yes, but those come from the log file generated by the plotter process. Maybe your plotmanager can't find them or doesn't have access to read them? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#53 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACSSRVBTVOYV7DRBG3TFP7TTOWQIFANCNFSM436Y3H5A .

It knows what plots are running by checking running processes. It knows the progress of each plot by reading the log file.

I'm aware of that, I'm saying it's not reading the logs, so it doesn't know what the progress is at. Meanwhile, my process is now hanging because even though 6 of the plots are done, because it can't read the logs but it knows about the process ID, it is still believing they are running..... Isn't it supposed to start new plots after the current ones are done?

That's not how it works. It knows to show the plot or not depending on the process running. If the process is still running, it'll show. When the process is done, it won't be shown anymore. You can try and confirm if the processes shown are the same you have running on your computer.

Program just crashed with this error.

[timephy]

Hey, having this exact problem on 1 of 2 identical machines... Just suddenly started happening....

bit of digging -> might be caused by or related to https://github.com/giampaolo/psutil/pull/597

(I am on version 0.1.0)

My problem was "fixed" by a restart... Does not make me happier.

[Emperornero]

If it wasn't able to see the files wouldn't it not be able to detect how many were running? For some reason it is just not able to read the files. Why would that be? … On Thu, May 20, 2021, 5:10 PM Jesús Luzón @.***> wrote: From the info you posted, I don't understand what your issue is. Can you add more details about what specifically is not behaving how you expect ti to? Is it not supposed to detect the plot ID and the time per phase? Yes, but those come from the log file generated by the plotter process. Maybe your plotmanager can't find them or doesn't have access to read them? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#53 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACSSRVBTVOYV7DRBG3TFP7TTOWQIFANCNFSM436Y3H5A .

It knows what plots are running by checking running processes. It knows the progress of each plot by reading the log file.

I'm aware of that, I'm saying it's not reading the logs, so it doesn't know what the progress is at. Meanwhile, my process is now hanging because even though 6 of the plots are done, because it can't read the logs but it knows about the process ID, it is still believing they are running..... Isn't it supposed to start new plots after the current ones are done?

That's not how it works. It knows to show the plot or not depending on the process running. If the process is still running, it'll show. When the process is done, it won't be shown anymore. You can try and confirm if the processes shown are the same you have running on your computer.

And that's what I'm saying.... plots are finishing but still being marked as "active" in the logs, when ps aux shows they are no longer running. Have to restart the manager to get them started again, on top of it not detecting what phase they are at or plot id they have.

Before restart:

2021-05-21 07:32:32 [INFO]: Free space after checking active jobs: {'/mnt/k': 1237146259968}
2021-05-21 07:32:32 [INFO]: Checking to queue work for job: 980 Pro Q
2021-05-21 07:32:32 [INFO]: Total jobs in phase 1: 7
2021-05-21 07:32:32 [INFO]: Job's max concurrent limit has been met, skipping. Max concurrent minus start_early: 12, Max concurrent: 12
2021-05-21 07:32:32 [INFO]: Sleeping for 60 seconds.
2021-05-21 07:33:32 [INFO]: Checking log progress..
2021-05-21 07:33:32 [INFO]: Checking log progress for PID: 4955
2021-05-21 07:33:32 [INFO]: Checking log progress for PID: 5338
2021-05-21 07:33:32 [INFO]: Checking log progress for PID: 5714
2021-05-21 07:33:32 [INFO]: Checking log progress for PID: 6080
2021-05-21 07:33:32 [INFO]: Checking log progress for PID: 6442
2021-05-21 07:33:32 [INFO]: Checking log progress for PID: 6805
2021-05-21 07:33:32 [INFO]: Checking log progress for PID: 7168
2021-05-21 07:33:32 [INFO]: Checking log progress for PID: 12242
2021-05-21 07:33:32 [INFO]: PID still alive: 12242
2021-05-21 07:33:32 [INFO]: Checking log progress for PID: 12544
2021-05-21 07:33:32 [INFO]: PID still alive: 12544
2021-05-21 07:33:32 [INFO]: Checking log progress for PID: 12838
2021-05-21 07:33:32 [INFO]: PID still alive: 12838
2021-05-21 07:33:32 [INFO]: Checking log progress for PID: 13148
2021-05-21 07:33:32 [INFO]: PID still alive: 13148
2021-05-21 07:33:32 [INFO]: Checking log progress for PID: 13458
2021-05-21 07:33:32 [INFO]: PID still alive: 13458
2021-05-21 07:33:32 [INFO]: Monitoring jobs to start.
2021-05-21 07:33:32 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146259968}
2021-05-21 07:33:32 [INFO]: /mnt/k
2021-05-21 07:33:32 [INFO]: /mnt/k
2021-05-21 07:33:32 [INFO]: /mnt/k
2021-05-21 07:33:32 [INFO]: /mnt/k
2021-05-21 07:33:32 [INFO]: /mnt/k
2021-05-21 07:33:32 [INFO]: /mnt/k
2021-05-21 07:33:32 [INFO]: /mnt/k
2021-05-21 07:33:32 [INFO]: Free space after checking active jobs: {'/mnt/k': 1237146259968}
2021-05-21 07:33:32 [INFO]: Checking to queue work for job: 980 Pro Q
2021-05-21 07:33:32 [INFO]: Total jobs in phase 1: 7

After restart:

2021-05-21 07:33:49 [INFO]: Grabbing running plots.
2021-05-21 07:33:49 [INFO]: Getting running plots
2021-05-21 07:33:49 [INFO]: Found chia plotting process: 12242
2021-05-21 07:33:49 [INFO]: Found chia plotting process: 12544
2021-05-21 07:33:49 [INFO]: Found chia plotting process: 12838
2021-05-21 07:33:49 [INFO]: Found chia plotting process: 13148
2021-05-21 07:33:49 [INFO]: Found chia plotting process: 13458
2021-05-21 07:33:49 [INFO]: Finding log file for process: 12242
2021-05-21 07:33:49 [INFO]: Finding associated job
2021-05-21 07:33:49 [INFO]: Found job: 980 Pro Q
2021-05-21 07:33:49 [INFO]: Finding log file for process: 12544
2021-05-21 07:33:49 [INFO]: Finding associated job
2021-05-21 07:33:49 [INFO]: Found job: 980 Pro Q
2021-05-21 07:33:49 [INFO]: Finding log file for process: 12838
2021-05-21 07:33:49 [INFO]: Finding associated job
2021-05-21 07:33:49 [INFO]: Found job: 980 Pro Q
2021-05-21 07:33:49 [INFO]: Finding log file for process: 13148
2021-05-21 07:33:49 [INFO]: Finding associated job
2021-05-21 07:33:49 [INFO]: Found job: 980 Pro Q
2021-05-21 07:33:49 [INFO]: Finding log file for process: 13458
2021-05-21 07:33:49 [INFO]: Finding associated job
2021-05-21 07:33:49 [INFO]: Found job: 980 Pro Q
2021-05-21 07:33:49 [INFO]: Finished finding running plots
2021-05-21 07:33:49 [INFO]: 980 Pro Q Found. Setting next stagger date to 2021-05-21 06:04:27.850000
2021-05-21 07:33:49 [INFO]: Checking to see if stagger needs to be altered due to minimum_minutes_between_jobs. Value: 5
2021-05-21 07:33:49 [INFO]: All dates: [datetime.datetime(2021, 5, 21, 5, 10, 24, 520000), datetime.datetime(2021, 5, 21, 5, 24, 25, 650000), datetime.datetime(2021, 5, 21, 5, 34, 26, 250000), datetime.datetime(2021, 5, 21, 5, 44, 27, 370000), datetime.datetime(2021, 5, 21, 5, 54, 27, 850000)]
2021-05-21 07:33:49 [INFO]: Calculated Latest Job Start Date: 2021-05-21 05:54:27.850000
2021-05-21 07:33:49 [INFO]: Calculated Minimum Stagger: 2021-05-21 05:59:27.850000
2021-05-21 07:33:49 [INFO]: Skipping stagger for 980 Pro Q. Stagger is larger than minimum_minutes_between_jobs. Minimum: 2021-05-21 05:59:27.850000, Current: 2021-05-21 06:04:27.850000
2021-05-21 07:33:49 [INFO]: Starting loop.
2021-05-21 07:33:49 [INFO]: Checking log progress..
2021-05-21 07:33:49 [INFO]: Checking log progress for PID: 12242
2021-05-21 07:33:49 [INFO]: Checking log progress for PID: 12544
2021-05-21 07:33:49 [INFO]: Checking log progress for PID: 12838
2021-05-21 07:33:49 [INFO]: Checking log progress for PID: 13148
2021-05-21 07:33:49 [INFO]: Checking log progress for PID: 13458
2021-05-21 07:33:49 [INFO]: Monitoring jobs to start.
2021-05-21 07:33:49 [INFO]: Free space before checking active jobs: {'/mnt/k': 2000146259968}
2021-05-21 07:33:49 [INFO]: /mnt/k
2021-05-21 07:33:49 [INFO]: /mnt/k
2021-05-21 07:33:49 [INFO]: /mnt/k
2021-05-21 07:33:49 [INFO]: /mnt/k
2021-05-21 07:33:49 [INFO]: /mnt/k
2021-05-21 07:33:49 [INFO]: Free space after checking active jobs: {'/mnt/k': 1455146259968}
2021-05-21 07:33:49 [INFO]: Checking to queue work for job: 980 Pro Q
2021-05-21 07:33:49 [INFO]: Total jobs in phase 1: 5

Also, it thinks they're in phase 1. Obviously they're not if the log files are 100 kb.... To test this, I run 'grep' on the log file, and it has zero problems reading the file, so why can't Swar?

[clarejor]

killing Armoury Crate from Process Explorer fixed it for me also. It had over 2 million handles!

[DM4DS]

Just a short update and a question:

1: The manager runs now, the only thing that from time to time happens is the hang of ´view´ with the known psutil error.

2: since yesterday 1.1.6 of chia is out. Is it possible to stop the manager, update (also the config link) the GUI, and start the manager again?

I have so many plots running in beautiful stagged time, I don´t wanna stop it :)

Maybe nice to hear @swar that i did 36 plots yesterday. Is it the difficulty kicking the times more and more, so early in the blockchain time or are my NVMes throttling more and more dying? S.M.A.R.T says 63% good.

[timephy]

killing Armoury Crate from Process Explorer fixed it for me also. It had over 2 million handles!

Only killing Armoury Crate does not seem to be enough to fix it for me :/

[Emperornero]

Is it possible this is actually an issue with psutil?

This issue also happens on plotman.

[timephy]

Hey, having this exact problem on 1 of 2 identical machines... Just suddenly started happening....

bit of digging -> might be caused by or related to https://github.com/giampaolo/psutil/pull/597

(I am on version 0.1.0)

Yes i believe so @Emperornero

[ramd3z]

Chiming in to say I encountered this same issue today. Ran swar for 3 days without issue- rebooted to swap out a HD and the issue arose after 4 jobs ~ 3 hours. Killing all 3 of the 'armoury crate' service from windows resource manager fixed the issue so far. re-ran a status command and all of my status' are correct right away.

I do often have issues with swar detecting psutil and am forced to reinstall the requirements.txt after a command prompt window is closed before I can issue any swar commands.