Open huo-ju opened 9 months ago
Proposal:
add a sfast_extra_key to customize the cache key.
sfast_extra_key
The current trace module key included hash_arg(args) and hash_arg(kwargs), but some args could be set up in other ways. (e.g. by attention_processor mixin).
hash_arg(args)
hash_arg(kwargs)
Enabling extra kwargs can let users easily define their own trace key.
Proposal:
add a
sfast_extra_keyto customize the cache key.The current trace module key included
hash_arg(args)andhash_arg(kwargs), but some args could be set up in other ways. (e.g. by attention_processor mixin).Enabling extra kwargs can let users easily define their own trace key.