AAMasters / Candles-Volumes-Indicator-Bot

Produces a dataset with multi-period candles and volumes.
Other
1 stars 2 forks source link

[ERR] 'findPreviousContent' - Empty or corrupt candle file found at Poloniex/Output/Candles/Multi-Period-Market/02-hs for market USDT_BTC . Skipping this Market. #2

Open Luis-Fernando-Molina opened 6 years ago

Luis-Fernando-Molina commented 6 years ago

Last Interval:

2018-03-14T00:02:35.989Z 1 [INFO] initialize - Entering function 'initialize' 2018-03-14T00:02:36.942Z 2 [INFO] Entering function 'start' 2018-03-14T00:02:36.942Z 3 [INFO] Entering function 'marketsLoop' 2018-03-14T00:02:36.942Z 4 [INFO] Entering function 'openMarket' 2018-03-14T00:02:36.942Z 5 [INFO] Entering function 'closeAndOpenMarket' 2018-03-14T00:02:36.942Z 6 [INFO] Entering function 'openMarket' 2018-03-14T00:02:36.942Z 7 [INFO] 'openMarket' - marketQueue.length = 99 2018-03-14T00:02:36.942Z 8 [INFO] 'openMarket' - market sucessfully opened : USDT_BTC 2018-03-14T00:02:44.426Z 9 [ERR] 'findPreviousContent' - Empty or corrupt candle file found at Poloniex/Output/Candles/Multi-Period-Market/02-hs for market USDT_BTC . Skipping this Market. 2018-03-14T00:02:44.442Z 10 [INFO] Entering function 'closeAndOpenMarket' 2018-03-14T00:02:44.442Z 11 [INFO] Entering function 'openMarket' 2018-03-14T00:02:44.442Z 12 [INFO] Entering function 'closeAndOpenMarket' 2018-03-14T00:02:44.442Z 13 [INFO] Entering function 'openMarket'

Previous Interval: (last 50 lines)

2018-03-13T23:58:59.591Z 11579 [INFO] 'writeStatusReport' - Content written: {"lastFile":{"year":2016,"month":10,"days":19}} 2018-03-13T23:58:59.591Z 11580 [INFO] New processing time @ 2016/10/20. 2018-03-13T23:59:01.193Z 11581 [WARN] Finished with File @ USDT_BTC, 610 records inserted into Poloniex/Output/Candles/Multi-Period-Market/24-hs/USDT_BTC.json 2018-03-13T23:59:02.379Z 11582 [WARN] Finished with File @ USDT_BTC, 610 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/24-hs/USDT_BTC.json 2018-03-13T23:59:03.902Z 11583 [WARN] Finished with File @ USDT_BTC, 1219 records inserted into Poloniex/Output/Candles/Multi-Period-Market/12-hs/USDT_BTC.json 2018-03-13T23:59:05.080Z 11584 [WARN] Finished with File @ USDT_BTC, 1219 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/12-hs/USDT_BTC.json 2018-03-13T23:59:06.636Z 11585 [WARN] Finished with File @ USDT_BTC, 1828 records inserted into Poloniex/Output/Candles/Multi-Period-Market/08-hs/USDT_BTC.json 2018-03-13T23:59:07.819Z 11586 [WARN] Finished with File @ USDT_BTC, 1828 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/08-hs/USDT_BTC.json 2018-03-13T23:59:09.354Z 11587 [WARN] Finished with File @ USDT_BTC, 2437 records inserted into Poloniex/Output/Candles/Multi-Period-Market/06-hs/USDT_BTC.json 2018-03-13T23:59:10.545Z 11588 [WARN] Finished with File @ USDT_BTC, 2437 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/06-hs/USDT_BTC.json 2018-03-13T23:59:12.087Z 11589 [WARN] Finished with File @ USDT_BTC, 3656 records inserted into Poloniex/Output/Candles/Multi-Period-Market/04-hs/USDT_BTC.json 2018-03-13T23:59:13.281Z 11590 [WARN] Finished with File @ USDT_BTC, 3656 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/04-hs/USDT_BTC.json 2018-03-13T23:59:14.859Z 11591 [WARN] Finished with File @ USDT_BTC, 4874 records inserted into Poloniex/Output/Candles/Multi-Period-Market/03-hs/USDT_BTC.json 2018-03-13T23:59:16.079Z 11592 [WARN] Finished with File @ USDT_BTC, 4874 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/03-hs/USDT_BTC.json 2018-03-13T23:59:17.835Z 11593 [WARN] Finished with File @ USDT_BTC, 7311 records inserted into Poloniex/Output/Candles/Multi-Period-Market/02-hs/USDT_BTC.json 2018-03-13T23:59:19.052Z 11594 [WARN] Finished with File @ USDT_BTC, 7311 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/02-hs/USDT_BTC.json 2018-03-13T23:59:20.661Z 11595 [WARN] Finished with File @ USDT_BTC, 14621 records inserted into Poloniex/Output/Candles/Multi-Period-Market/01-hs/USDT_BTC.json 2018-03-13T23:59:21.922Z 11596 [WARN] Finished with File @ USDT_BTC, 14621 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/01-hs/USDT_BTC.json 2018-03-13T23:59:21.922Z 11597 [INFO] Entering function 'writeStatusReport' 2018-03-13T23:59:22.767Z 11598 [INFO] 'writeStatusReport' - Content written: {"lastFile":{"year":2016,"month":10,"days":20}} 2018-03-13T23:59:22.767Z 11599 [INFO] New processing time @ 2016/10/21. 2018-03-13T23:59:24.425Z 11600 [WARN] Finished with File @ USDT_BTC, 611 records inserted into Poloniex/Output/Candles/Multi-Period-Market/24-hs/USDT_BTC.json 2018-03-13T23:59:25.608Z 11601 [WARN] Finished with File @ USDT_BTC, 611 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/24-hs/USDT_BTC.json 2018-03-13T23:59:27.124Z 11602 [WARN] Finished with File @ USDT_BTC, 1221 records inserted into Poloniex/Output/Candles/Multi-Period-Market/12-hs/USDT_BTC.json 2018-03-13T23:59:28.321Z 11603 [WARN] Finished with File @ USDT_BTC, 1221 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/12-hs/USDT_BTC.json 2018-03-13T23:59:29.842Z 11604 [WARN] Finished with File @ USDT_BTC, 1831 records inserted into Poloniex/Output/Candles/Multi-Period-Market/08-hs/USDT_BTC.json 2018-03-13T23:59:31.050Z 11605 [WARN] Finished with File @ USDT_BTC, 1831 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/08-hs/USDT_BTC.json 2018-03-13T23:59:32.588Z 11606 [WARN] Finished with File @ USDT_BTC, 2441 records inserted into Poloniex/Output/Candles/Multi-Period-Market/06-hs/USDT_BTC.json 2018-03-13T23:59:33.785Z 11607 [WARN] Finished with File @ USDT_BTC, 2441 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/06-hs/USDT_BTC.json 2018-03-13T23:59:35.326Z 11608 [WARN] Finished with File @ USDT_BTC, 3662 records inserted into Poloniex/Output/Candles/Multi-Period-Market/04-hs/USDT_BTC.json 2018-03-13T23:59:36.546Z 11609 [WARN] Finished with File @ USDT_BTC, 3662 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/04-hs/USDT_BTC.json 2018-03-13T23:59:38.110Z 11610 [WARN] Finished with File @ USDT_BTC, 4882 records inserted into Poloniex/Output/Candles/Multi-Period-Market/03-hs/USDT_BTC.json 2018-03-13T23:59:39.319Z 11611 [WARN] Finished with File @ USDT_BTC, 4882 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/03-hs/USDT_BTC.json 2018-03-13T23:59:40.907Z 11612 [WARN] Finished with File @ USDT_BTC, 7323 records inserted into Poloniex/Output/Candles/Multi-Period-Market/02-hs/USDT_BTC.json 2018-03-13T23:59:42.124Z 11613 [WARN] Finished with File @ USDT_BTC, 7323 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/02-hs/USDT_BTC.json 2018-03-13T23:59:43.773Z 11614 [WARN] Finished with File @ USDT_BTC, 14645 records inserted into Poloniex/Output/Candles/Multi-Period-Market/01-hs/USDT_BTC.json 2018-03-13T23:59:45.014Z 11615 [WARN] Finished with File @ USDT_BTC, 14645 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/01-hs/USDT_BTC.json 2018-03-13T23:59:45.014Z 11616 [INFO] Entering function 'writeStatusReport' 2018-03-13T23:59:45.881Z 11617 [INFO] 'writeStatusReport' - Content written: {"lastFile":{"year":2016,"month":10,"days":21}} 2018-03-13T23:59:45.881Z 11618 [INFO] New processing time @ 2016/10/22. 2018-03-13T23:59:47.553Z 11619 [WARN] Finished with File @ USDT_BTC, 612 records inserted into Poloniex/Output/Candles/Multi-Period-Market/24-hs/USDT_BTC.json 2018-03-13T23:59:48.726Z 11620 [WARN] Finished with File @ USDT_BTC, 612 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/24-hs/USDT_BTC.json 2018-03-13T23:59:51.152Z 11621 [WARN] Finished with File @ USDT_BTC, 1223 records inserted into Poloniex/Output/Candles/Multi-Period-Market/12-hs/USDT_BTC.json 2018-03-13T23:59:52.339Z 11622 [WARN] Finished with File @ USDT_BTC, 1223 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/12-hs/USDT_BTC.json 2018-03-13T23:59:53.858Z 11623 [WARN] Finished with File @ USDT_BTC, 1834 records inserted into Poloniex/Output/Candles/Multi-Period-Market/08-hs/USDT_BTC.json 2018-03-13T23:59:55.052Z 11624 [WARN] Finished with File @ USDT_BTC, 1834 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/08-hs/USDT_BTC.json 2018-03-13T23:59:56.584Z 11625 [WARN] Finished with File @ USDT_BTC, 2445 records inserted into Poloniex/Output/Candles/Multi-Period-Market/06-hs/USDT_BTC.json 2018-03-13T23:59:57.797Z 11626 [WARN] Finished with File @ USDT_BTC, 2445 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/06-hs/USDT_BTC.json 2018-03-13T23:59:59.327Z 11627 [WARN] Finished with File @ USDT_BTC, 3668 records inserted into Poloniex/Output/Candles/Multi-Period-Market/04-hs/USDT_BTC.json 2018-03-14T00:00:01.104Z 11628 [WARN] Finished with File @ USDT_BTC, 3668 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/04-hs/USDT_BTC.json 2018-03-14T00:00:02.667Z 11629 [WARN] Finished with File @ USDT_BTC, 4890 records inserted into Poloniex/Output/Candles/Multi-Period-Market/03-hs/USDT_BTC.json 2018-03-14T00:00:03.877Z 11630 [WARN] Finished with File @ USDT_BTC, 4890 records inserted into Poloniex/Output/Volumes/Multi-Period-Market/03-hs/USDT_BTC.json

Interval Executor:

2018-03-14T00:02:35.255Z 1 [INFO] initialize - Entering function 'initialize' 2018-03-14T00:02:35.270Z 2 [INFO] Entering function 'start'. 2018-03-14T00:02:35.270Z 3 [INFO] Entering function 'startNewInterval', next execution inmediately after the current Interval finishes. 2018-03-14T00:02:44.630Z 4 [WARN] Received the signal from last Interval execution to not call it anymore. Stopping execution.

Luis-Fernando-Molina commented 6 years ago

I checked the file and it was empty. That means that we need to improve the handling of errors while writing files. Will delete the status report file and restart the process. Also, I will leave this issue open so that when the UPGRADE to ALPHA standard is done, it is also included a better handling of errors while writing files.