madMAx43v3r / chia-plotter

Apache License 2.0
2.27k stars 663 forks source link

Ploting with external NVME USB 3.1 #875

Open NitsugaCodu opened 3 years ago

NitsugaCodu commented 3 years ago

Hi All

Im trying to plot with an external NVME through USB 3.1 and always happen something new but normally ended in a termination without any warning. This cause that i have to disconnect the NVME without eject the device in system (otherwise windows 10 dont have the capability to keep detecting the driver or working on them or like an empty driver)

I tested using so many different setup, starting from 1 thread with 128 buckets for U and V, to 256, 512. There few cases that dont crash and it can be completed using different setup, however, i run again with the working config and crash again.

It can crash in phase 1, 2 or 3. I didnt find any rational or logic. It doesnt increase the temp above 70, in fact, it keeps around 50 using crystaldiskinfo

I can plot through usb 3.1 using the official chia plot.

Do you know what can happen? Thanks

germapet commented 3 years ago

me pasaba igual lo soluciono eliminando la particion creo una nueva no funciona si formateas de forma rapida. debes formatear lento.

NitsugaCodu commented 3 years ago

Thanks Germapet, i will try that. To anyone else, Germapet indicated that the quick partition doesnt work and we need to do a "slow partition".

Gracias!

NitsugaCodu commented 3 years ago

I did the slow partition/format and only run correctly the first one then it get exit in the second one.

[2021/07/31 02:15:12] Crafting plot 2 out of 8 [2021/07/31 02:15:12] Process ID: 13604 [2021/07/31 02:15:12] Number of Threads: 4 [2021/07/31 02:15:12] Number of Buckets P1: 2^7 (128) [2021/07/31 02:15:12] Number of Buckets P3+P4: 2^7 (128) [2021/07/31 02:15:12] Pool Puzzle Hash: [2021/07/31 02:15:12] Farmer Public Key: [2021/07/31 02:15:12] Working Directory: E:\ [2021/07/31 02:15:12] Working Directory 2: E:\ [2021/07/31 02:15:12] Plot Name: plot-k32-2021-07-31-02-15-1745c1023106882e66c72a9e84056bb05af3f79a29cac54591d2530759ace5c4 [2021/07/31 02:17:06] [P1] Table 1 took 114.257 sec [2021/07/31 02:23:35] Copy to D:\NFT\plot-k32-2021-07-30-23-28-f4031d1b14ef24aee062b370dc671a980881c0c833dc7f82aff2327954983bf4.plot failed with: fopen() failed [2021/07/31 02:23:42] [2021/07/31 02:23:42] Process has exited.

Jacek-ghub commented 3 years ago

What are your d: and e; drives, how did you format d: (NTFS or FAT), what are the sizes? How did you start your plotter, any manager, or by hand?

Looks like "plotting" on e: drive works fine. However, the final xfr to d: drive fails, as for some reason the mover cannot open/create a new file on d: drive.

You may want to specify your final destination as e:\dst (or something), and once the first plot is finished, try to move that file manually to d:

NitsugaCodu commented 3 years ago

Hi Jacek. Drive D is the external HDD and it's a NTFS. Size 4 GB. Started using the plot manager tool (new). Drive E: its the external NTFS SSD NVME 3.1 USB 465 GB.

I did the test using different hard drive, formated drive E different times, always NTFS, I started the plotter through powersheel so many times and it keeps failing.

The failing can happen in phase 1, phase 2, phase 3 or 4. It can happen in the first plot or second, i cannot run 2 plot without and ending. You will notice is not something about temperature because it-s the second phase...

Using my internal SSD run the plot in 79 minutes and run without faulty wathever quantity i want.

This is another log that fail in the first run failing in another step

Thanks

LOG [2021/07/29 08:58:18] ./chia_ploter/chia_plot.exe -f XXXX -c XXXX -n 1 -r 4 -K 1 -u 256 -v 256 -t E:\ -2 E:\ -d D:\

[2021/07/29 08:58:18] Multi-threaded pipelined Chia k32 plotter - 055a5db [2021/07/29 08:58:18] Build 0.1.5 for Windows. Check for latest updates: https://stotiks.github.io/chia-plotter/ [2021/07/29 08:58:18] [2021/07/29 08:58:19] Final Directory: D:\ [2021/07/29 08:58:19] Number of Plots: 1 [2021/07/29 08:58:19] Crafting plot 1 out of 1 [2021/07/29 08:58:19] Process ID: 8608 [2021/07/29 08:58:19] Number of Threads: 4 [2021/07/29 08:58:19] Number of Buckets P1: 2^8 (256) [2021/07/29 08:58:19] Number of Buckets P3+P4: 2^8 (256) [2021/07/29 08:58:19] Pool Puzzle Hash: XXXX [2021/07/29 08:58:19] Farmer Public Key: XXXX [2021/07/29 08:58:19] Working Directory: E:\ [2021/07/29 08:58:19] Working Directory 2: E:\ [2021/07/29 08:58:19] Plot Name: plot-k32-2021-07-29-08-58-XXXXX [2021/07/29 08:59:45] [P1] Table 1 took 86.7531 sec [2021/07/29 09:08:49] [P1] Table 2 took 543.601 sec, found 4295004088 matches [2021/07/29 09:56:12] [2021/07/29 09:56:12] Process has exited.

Jacek-ghub commented 3 years ago

You mean, your d: is 4TB, right? Not 4GB?

All that you have there looks good. Format is not the best tool to test your NVMe (or a disk). You could run chkdsk, as maybe that will find some issues (I think, when you right click on that drive, and select Tools / Error Checking / Check, maybe this is the same as chkdks).

Not sure what brand of your NVMe is, but pushing 60deg is rather hot. Actually, I struggled a bit with Samsung 970, as those run rather hot (I put a small fan to blow over the heatsink).

Although, this time, it looks like plotter run out of e: disk space, but again you have plenty there. Although, you didn't write whether e: is empty or you still have something there (formatting would indicate empty).

Also, it kind of looks like a weird access rights / privileges to some extent. I would try to run it from cmd line (not PowerShell), as cmd is kind of dumber, and potentially more forgiving. Also, don't run it with administrative privileges.

As far as plot manager, I would try PSChiaPlotter (in my opinion, the best). Although, would try to get it working via cmd line first.

Also, I would not go just for root e:, and d:, but rather create some folders there. I don't think that there is anything wrong with using roots, but worth a try. So try from command line; chia_ploter/chia_plot.exe -f XXXX -c XXXX -n 1 -r 4 -u 256 -t E:\tmp\ -d D:\dst\

For monitoring temperatures, etc., I would use HWMonitor. It is an excellent tool.

Also, what is your computer (desktop or laptop), what is the CPU. Maybe CPU or memory gets hot?

By the way, looks like right now you are choking on disk access (NVMe). You may want to consider getting one more USB drive. I don't know, whether there would be a difference between external SSD vs. NVMe, as the limiting factor could be the USB link. Still, separating temp1 from temp2 really helps to speed plotting up.

germapet commented 3 years ago

20210731_231252

Your device is overheating so you can only do 1 re-create the partition every time it stops, and try to put more heat sinks on it.