abueide / harry-plotter

An easy to use graphical chia plot manager & optimizer for windows, mac & linux. You're a farmer, Harry!
GNU General Public License v3.0
125 stars 15 forks source link

Absolutely impredectible behavior in 1.1.14 #105

Closed josemanuelhda closed 3 years ago

josemanuelhda commented 3 years ago

I must say that I love the idea of your software, and I have made quite a bunch of plots, but not I cannot use it anymore, I am done, most of the times when I run it and say start stagger nothing happens, well, really it does not work for me any more, another times I close the program and open it again and it apparently starts with the stagger options saved (4,4,4 30 minutes, I use 4 diferent temp drives and the same for destination, that is the reason) nothing on temp drives configured or saved.

But when it starts staggering in the ocasions it decides to run this way, it always starts 2 different chia procesess at the same time and making 2 different plots, the program thinks it is making only one, but the 2 chia.ese are running at the same time in the same drive, I know this because I can see the different names of the temp files created in the drive.

So now I am totally stacked, I am thinking about using older versions or using chia client.

Is it possible that the new chia app 1.1.17 is causing this behavior?

I use this machine only for plotting, so the chia client is never running except comanded by hp, but I updated it yesterday I thing, and I don't know if this may be the problem.

I will try with hp 1.1.11 and update info.

abueide commented 3 years ago

Hi, sorry that you're having this experience. Please update to harry plotter 1.1.14 (it has a bunch of bug fixes since 1.1.11). You can update while plots are still running. The 1.1.7 chia version shouldn't make any difference.

Also please read through the wiki, specifically the getting started section. It contains a lot of info about how to use the program so it will work like you expect it to. Especially read the testing with k25's section in the optimization guide, I think it will help you make sure your setup is working as expected. You can also try resetting your config by deleting the ~/.harryplotter folder. some unexpected behavior can come from outdated logs or job configs from older versions

https://github.com/abueide/harry-plotter/wiki/Getting-Started

https://github.com/abueide/harry-plotter/wiki/Optimization-Guide

If you've done this and its still not working feel free to stop by the discord and I'll help to figure out what issues you're having and try to resolve them in harry plotter. I'd really like to understand more about what's going wrong so I can fix it.

josemanuelhda commented 3 years ago

Hi, thank you so much for your atention, although 1.1.11 may be buggy, now I don't need low memory jobs so I can do my plotting with 1.1.11, it is working fine with chia 1.1.7, so no need to make more testing, as I have already lost half a day plotting time.

I have done tests on my system with k25 plots also, so no need to re run them.

I have uninstalled 1.1.14 and installed 1.1.11, my jobs were there, not erased by uninstall, and everything is working fine no, although with no low memory settings and no stats avalaible, but working as it should.

Previously I hade uninstalled and reinstalles 1.1.14, reset settings, erased everything and repair instalation too, tried everything, but with the bizarre behavior explained in my initial post. Everything double and triple checked.

No restart windows with the old version, so all enviromental variables were the same, I cannot find or explain what the problem was, I am sorry for that, as I understand people's concern about my report, but at least if somebody comes to the same place I arrived they can do what I have done and keep using your program, wich I really love, even with the bugs.

abueide commented 3 years ago

I'll try to do some more testing to see if I can make what you described happen locally. If I can get it to happen I'll be able to fix it. Thanks for the info again.

deljjar commented 3 years ago

in 1.1.13 it happened to me the same or yours in 1.1.14, you have several jobs, as if it duplicates the jobs, 1 is shown in HP and in process explorer you see the 2 same jobs.

josemanuelhda commented 3 years ago

yes, 2 identical processes started at the same time running in windows task explorer, that is what happens

abueide commented 3 years ago

I can't make this happen. Is my setup different than yours in any significant way?

image

abueide commented 3 years ago

these are the stagger settings I used image

abueide commented 3 years ago

here's another test using the same stagger settings across 2 separate drives image

if you could detail exactly the steps you took for your setup, it would help a ton.

deljjar commented 3 years ago

now i'm using 1.1.11 which ran with less problems and my plots ending at an average of 04h30m, I make 3 plots in parallel with stragger 30min. I don't know if I can talk here or open another topic, it happened when I migrated to version 1.1.13 my plots started to take longer than normal, on average 6hrs.

deljjar commented 3 years ago

about duplicate jobs, it didn't happen very often.

abueide commented 3 years ago

@deljjar i believe the performance problem was a bug with stats which is now fixed in 1.1.14. but no need to upgrade if it's working until there is a feature you want.

deljjar commented 3 years ago

here's another test using the same stagger settings across 2 separate drives

try to start a job, and cancel it, and try again that same job to see if what happened to us happens, this duplication.

deljjar commented 3 years ago

@deljjar i believe the performance problem was a bug with stats which is now fixed in 1.1.14. but no need to upgrade if it's working until there is a feature you want.

I will do tests on 1.1.14 when I finish my work, I like news

josemanuelhda commented 3 years ago

these are the stagger settings I used image

my settings are very similar, 4 different drives, stagger 4 4 4 and 30 minutes, I try to make them work at the same time, one on each different, but similar drives, and final destination the same drive, it works perfect for me when hp obeys, but when I push start stagger nothing happens, I close hp and start it again, and some times it starts the stagger by itself but with duplicate proceses, this is as accurate as I can tell you how things work

my pc has 16 threads and 16 gig of ram, so I give every job 3 threads and 3 gigs or ram, so I leave for windows and other tasks 4 threads and 4 gigs of ram, I don't know it this adds some more information to you

I have only let this happen with the first plot, as my drive cannot hold more than one, when I notice 2 plots running I force stop from hp, it works with only one of the plots, If i kill in windows task any of the plots instead of asking hp it kills the process in hp too, no matter wich one I chose

both plottings start simultaneously but with different name in the plot, I can see that in the files in the temp drive

the most annoying thing is stagger all not working at all in my case, it only works when starting hp, it starts auto, not always, but with 2 proceses at the time

once I did not notice the double plotting and I restarted hp to realize I had 4 jobs running at the same time in the same drive (I had not killed the first 2)

I use chia plot status to monitor plotting, and it detects instantly this behavior

I am sorry you cannot duplicate the problem, but it is there, stagger all does not work at all, but in the same windows session with 1.1.11 everything runs as it should, no restart in between as I already told you, and no duplicate plotting

abueide commented 3 years ago

wait so you're saying the duplicating only happens when you restart harry plotter? and if you don't restart it, then start stagger won't work?

josemanuelhda commented 3 years ago

I am thinking, as I use static time in stagger, and you have added another option in 1.1.14 that was not in 1.1.1.11 that maybe the time variable is located in the wrong place in the code, you could try the same settings I quoted with 1 minute or 2 static time to see it this make the program go nuts, I use 30 minutes, if that is the issue you don't have to wait for the second plotting, as the duplication is at the first plot already

josemanuelhda commented 3 years ago

wait so you're saying the duplicating only happens when you restart harry plotter?

yes, because start stagger stopped working, I used it for a couple of days normally, but then it went this way, no reinstalling or reseting settings could solve it

but the start time of both proceses is the same, I can see it in chia plot status and in windows task, they appear at the same time both, and as subproceses of hp

abueide commented 3 years ago

okay thats really useful info thank you

josemanuelhda commented 3 years ago

I have sent you an email with my telegram address in case I may help you chatting

thank you so much for your work

firipusan commented 3 years ago

Sometimes on 1.1.14 when you restart duplicates start which uses more cpu and ram than normal. I just restart the pc and reopen harry plotter until this does not occur then everything works exactly like it should. This did not happen on 1.1.11 but we did not have drive control.

MinesofMoriaCrypto commented 3 years ago

I think this is probably related to the issue that I'm having too. It seems that it prioritizes certain limit settings, and if it satisfies the one, it stops paying attention t some of the others.

flutech82 commented 3 years ago

I previously posted a SPEED ISSUE ,now I have same problem from when I installed version with DRIVES TAB 1.1.14. I checked on 500 gb NVME and have ERROR 1 problem (disk full) when plotting because it started more than 2 plots. Here below my configuration, maybe I made some mistake and the SPEED ISSUE was only because I have more than 2 plots running. I checked folders and really have more than 2 plots running. image image image

flutech82 commented 3 years ago

FOUND SOMETHING!!!! I removed stagger configuration SETTINGS I tryed to START STAGGER and nothing happen, so I push another time START STAGGER and nothing happen. I closed HARRY PLOTTER and reopened, in this way I see nvme2 and nvme 1Tb 1 JOBS running...BUT SURPRISE!!!......in temp folders I found 2 plots running for each JOB, it means each time I push START STAGGER I start a Plot series,I thought there must be 30 minutes drive configuration blocking new starts.

Done some more test: Each Job use DRIVE CONFIGURATION independently If, like in previous releases u make 1 job for each plot , staggered in same drive and Stagger Settings, probably something goes wrong with drive settings

josemanuelhda commented 3 years ago

I keep on using version 11 until this is solved, although I assume we are all testing madmax in our setups

abueide commented 3 years ago

let me know if you guys are still having issues in 1.2.0