Handle sequences longer than 2048 tokens

zycyc / LAMBDA

Local & Private LLM that drafts responses LIKE you automatically

MIT License

34 stars 3 forks source link

Handle sequences longer than 2048 tokens #2

Open fredrikburmester opened 5 hours ago

fredrikburmester commented 5 hours ago

Getting this warning in the terminal during stage 2.

2024-11-15 12:24:00,127 - [WARNING] Some sequences are longer than 2048 tokens. The longest sentence 2822 will be truncated to 2048. Consider pre-splitting your data to save memory.