search

airockchip / rknn-llm

Other
422 stars 37 forks source link

RKLLMParam max_context_len Maximum supported length #11

Open jun-zhang opened 7 months ago

jun-zhang commented 7 months ago

当输入过大的prompt会造成崩溃，但是qwen1.5支持32k的上下文，是否可以开放更大的max_context_len