examples/inference/cpp transformer_example需要超大内存问题

bytedance / lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation

Other

3.22k stars 329 forks source link

Closed kevinmgyu closed 2 years ago

kevinmgyu commented 2 years ago

怎么需要这么大内存模型的pb文件只有1g

kevinmgyu commented 2 years ago

配置文件

hexisyztem commented 2 years ago

max_batch_size is too big