Found a bug in file dict_util.go

[ntcat]

in this func: func (seg Segmenter) Reader(reader bufio.Reader, files ...string) error

those code lines: if fsErr != nil { if fsErr == io.EOF { ... } must put after : ... seg.Dict.AddToken(token) Otherwise,last line of dictory file will be missed.exclude the last line is empty.

[ntcat]

and, change this line:

        if freq == 0.0  {
            continue
        }

to:

        if freq == 0.0 && fsErr != io.EOF {
            continue
        }

otherwise, will met dead loop, when dictory file is empty.