search

xverse-ai / XVERSE-13B

XVERSE-13B: A multilingual large language model developed by XVERSE Technology Inc.
Apache License 2.0
649 stars 58 forks source link

generate 的 stop words 是什么？ #12

Closed luefei closed 1 year ago

luefei commented 1 year ago

generate 的 stop words 是什么？

ouyangliqi commented 1 year ago

请参考README中的Transformers 加载方式： https://github.com/xverse-ai/XVERSE-13B#transformers-%E5%8A%A0%E8%BD%BD%E6%96%B9%E5%BC%8F

underspirit commented 1 year ago 
tokenizer.eos_token

即'<|endoftext|>'