Closed prasad01dalavi closed 3 years ago
Run make traineddata [...]
(all other arguments like before) to create the missing traineddata files.
Yes I have done that to get the traineddata file. But what about the further training process. Is it completed but looks like Error rate is too high. It is not even close to 0
It says "Finished". So yes, it is completed. You need more iterations.
Ok, As it is mentioned, we should not be using traineddata file in model_name/ directory, It is alos of lower in size. Else we should be using beside the data/ dir traineddata file for recognition. Here, when I generate the traineddata file for best and fast, it is of 1.5 MB only. But generally it is above 10 MB and if we are using START_MODEL= eng then it should be atleast around that size i.e. 12 MB
make traineddata might not be generating valid traineddata file. That is my guess.
MAX_ITERATIONS := 40000 There are around 1,41,814 total ground truth files (image+text)
Here, when I generate the traineddata file for best and fast, it is of 1.5 MB only
They are valid. Just try them with tesseract
. Depending on the network specifications the traineddata files are small (even smaller than 1 MB for fast).
Tesseract commit. Default: $(TESSERACT_VERSION) TESSERACT_VERSION := 4.1.1
I suggest using latest code for tesseract from master branch in GitHub.
Thanks @stweil and @Shreeshrii
@Shreeshrii I have already increased the max iteration to 40k from 10k. where did you find that I am not iterating even once. What should I place the value of max iteration for 1,41,814/2 samples of dataset
I removed --eval_listfile
and again started training, let's see whether it gives me the same error or not
1,41,814/2
So, more than 70,000 lstmf files will be generated for your training data. Each iteration is for one lstmf file. So, 40,000 iterations means you haven't gone through the complete training data.
Woah!, Got your point. MAX Iteration should be >= Total samples(image+text)/2
Thank you!
I thought @stweil had added EPOCHS=20 as the default, where each epoch was equal to number of lstmf files used for training.
Yes, 1 Epoch will be going through each lstmfile. and 10 epoch means going through each lstm file for 10 times. Then what is meant by MAX_ITERATIONS in our case. Did I say right above i.e. >= training sample/2
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
I went through one of the similar issue with above. but could not find fix for this.
Snippet of Makefile
There are around 1,41,814 total ground truth files (image+text)
It did not generate model.traineddata as it failed at the end.
Hardware Config: 4vCPU and 16 GB RAM GCP VM Compute Optimized.
Can someone please help with this issue?
Note: It worked well when dataset was 34,306 (image + text)
Reference Link: https://github.com/tesseract-ocr/tesseract/issues/757#issuecomment-418236407