Open mihir83in opened 5 years ago
@skonves this is a question, I am not sure how can I add label to it, Apologies.
I am not aware of any performance hits or benchmarks for this library.
I am interested in discovering what types are benchmarking would be useful for developers. I will leave this issue open for a bit to see if the community has any opinions.
It would be better if we get the benchmarking on the memory utilization wrt the request count. I stress tested one scenario and found the memory utilization grows with the context size.
Is there a way to clean the context after some point of time or by an event?
@mahajanankur were you able to find something ?
Thanks for building and maintaining this one-of-its-kind library. Are there any noted / possible performance hits using it?
Are there any benchmarks that describe / test the performance when using it?
Thanks,