1500 total tokens, on 24GB cards. Plans are to dynamically change the number of allotted tokens based on batch size.
No user input is required for the token limit expansion.
If a batch of images contains more than 1500, it's truncated to size. Due to the shifting nature of memory usage, memory is cleared every 100 steps with a second through pass every 250 steps. May need adjusting for long term brewing, but has been stable for 42 hours without stoppage.
1500 total tokens, on 24GB cards. Plans are to dynamically change the number of allotted tokens based on batch size.
No user input is required for the token limit expansion.
If a batch of images contains more than 1500, it's truncated to size. Due to the shifting nature of memory usage, memory is cleared every 100 steps with a second through pass every 250 steps. May need adjusting for long term brewing, but has been stable for 42 hours without stoppage.