加载一个8m的字典，但是整个seg就占用很大的内容，整个项目占用内存最大的，有没有什么办法优化？

[brookxs]

1. Please speak English (English only), this is the language everybody of us can speak and write.
2. Please take a moment to search that an issue doesn't already exist.
3. Please ask questions or config/deploy problems on our Gitter channel: https://gitter.im/go-ego/ego
4. Please give all relevant information below for bug reports, incomplete details will be handled as an invalid report.

You MUST delete the content above including this line before posting, otherwise your issue will be invalid.

• Gse version (or commit ref):
• Go version:
• Operating system and bit:
• Can you reproduce the bug at Examples:
  • [ ] Yes (provide example code)
  • [ ] No
  • [ ] Not relevant
• Provide example code:

//go:embed zh/dictionary.txt
var zhSimpleDict string
var (
    seg gse.Segmenter
)
func Init() (err error) {
    return seg.LoadDictEmbed(zhSimpleDict)
}

• Log gist: (pprof) top Showing nodes accounting for 138.46MB, 97.84% of 141.52MB total Dropped 26 nodes (cum <= 0.71MB) Showing top 10 nodes out of 35 flat flat% sum% cum cum% 40.95MB 28.93% 28.93% 77.66MB 54.87% github.com/go-ego/gse.(Dictionary).AddToken 36.71MB 25.94% 54.87% 36.71MB 25.94% github.com/vcaesar/cedar.(Cedar).addBlock 31.50MB 22.26% 77.13% 31.50MB 22.26% github.com/go-ego/gse.(Segmenter).SplitTextToWords 9MB 6.36% 83.49% 129.18MB 91.28% github.com/go-ego/gse.(Segmenter).LoadDictStr 8.99MB 6.35% 89.85% 8.99MB 6.35% strings.genSplit 5.52MB 3.90% 93.75% 5.52MB 3.90% embed.FS.ReadFile 2.02MB 1.43% 95.18% 2.02MB 1.43% github.com/go-ego/gse/hmm.loadDefEmit 1.78MB 1.26% 96.44% 1.78MB 1.26% github.com/mozillazg/go-pinyin.init 1.13MB 0.8% 97.23% 1.13MB 0.8% github.com/valyala/fasthttp/stackless.NewFunc 0.85MB 0.6% 97.84% 0.85MB 0.6% github.com/goccy/go-json/internal/decoder.init.0

  Description

  整个项目中gse占用内存最大，有没有什么办法优化？ 字典是8m的大小 ...