taku910 / crfpp

CRF++: Yet Another CRF toolkit
Other
505 stars 192 forks source link

what's the meaning of this export? #41

Closed karterotte closed 7 years ago

karterotte commented 7 years ago

I used this command to train my data:

CRF++-0.58/crf_learn -a MIRA -f 30 -H 10 template train_data model

and it shows:

Number of sentences: 299769 Number of features: 3260280 Number of thread(s): 32 Freq: 30 eta: 0.00010 C: 1.00000 shrinking size: 10

but in training console :

iter=148 terr=0.00038 serr=0.00215 act=669 uact=135 obj=9552.22259 kkt=0.98669 iter=149 terr=0.00038 serr=0.00212 act=669 uact=126 obj=9552.24988 kkt=0.89123 iter=150 terr=0.00038 serr=0.00212 act=667 uact=127 obj=9552.24988 kkt=0.00000 iter=151 terr=0.00520 serr=0.02583 act=299769 uact=549 obj=9932.48463 kkt=17.21649 iter=152 terr=0.00358 serr=0.01923 act=299769 uact=656 obj=10176.21849 kkt=12.91036

I don't know why it continues training when kkt=0. It seems no ends. T T Anything wrong?

karterotte commented 7 years ago

here are new exports(grep kkt=0.000):

iter=150 terr=0.00038 serr=0.00212 act=667 uact=127 obj=9552.24988 kkt=0.00000 iter=271 terr=0.00060 serr=0.00268 act=1176 uact=363 obj=11873.45978 kkt=0.00000 iter=359 terr=0.00070 serr=0.00345 act=1158 uact=570 obj=12798.10565 kkt=0.00000 iter=420 terr=0.00086 serr=0.00404 act=2018 uact=530 obj=13334.79360 kkt=0.00000 iter=514 terr=0.00094 serr=0.00481 act=1669 uact=759 obj=13712.72705 kkt=0.00000 iter=580 terr=0.00103 serr=0.00716 act=2176 uact=793 obj=13987.47472 kkt=0.00000 iter=638 terr=0.00125 serr=0.00939 act=2846 uact=1642 obj=14222.93934 kkt=0.00000 iter=707 terr=0.00126 serr=0.00940 act=2844 uact=1796 obj=14372.37340 kkt=0.00000 iter=761 terr=0.00145 serr=0.01023 act=3105 uact=1508 obj=14481.73161 kkt=0.00000 iter=790 terr=0.00144 serr=0.00988 act=3069 uact=2042 obj=14573.35143 kkt=0.00000

I want to know when it will stop and how can i set params to stop training at certain iter or terr?

Thanks!

karterotte commented 7 years ago

I found answer:http://www.hankcs.com/nlp/the-crf-model-format-description.html

Thanks