Open fahadh4ilyas opened 1 year ago
Does your xformers monkey patch compatible for llama model with default context (without condensed rotary embedding)? And you said in another issue that xformers can be use in non-A100 gpu, what kind of gpu that can use it? Does A6000 supports it?
@fahadh4ilyas Thanks for trying! I think xformer document has a better list, it definitely supports V100 in my use case,
Does your xformers monkey patch compatible for llama model with default context (without condensed rotary embedding)? And you said in another issue that xformers can be use in non-A100 gpu, what kind of gpu that can use it? Does A6000 supports it?