Open jiewmeng opened 2 years ago
after adding new engine to cluster i have similar situation - data from old engine are processed, data from new node are saved to /home/scantron/console/scan_results/complete
and wait for processing.
are there any steps i can perform to debug and fix this issue?
I noticed that I randomly see instances where results files are missing even tho the job is completed. Even if I see results JSON in the scantron UI, the link points to a 404 page. If I try to find the results files on
/home/scantron/console/for_bigdata_analytics
its not found