Compile tvm kernel in newer version of CUDA

allenai / longformer

Longformer: The Long-Document Transformer

https://arxiv.org/abs/2004.05150

Apache License 2.0

2.05k stars 276 forks source link

Compile tvm kernel in newer version of CUDA #176

Closed elb3k closed 2 years ago

elb3k commented 3 years ago

Hi appreciate the repo.

I was using longformer with cuda 11.0 (needed for newer gpus). But lib_diagonaled_mm_float32_cuda.so was compiled on cuda 10.0. Instructions to compile with tvm is fetching docker with cuda 10.0 image anyway, is there any way/hint to compile library using newer CUDA version. Or whole tvm library was compiled with cuda 10.0?

jannessm commented 2 years ago

maybe the implementation from huggingface helps: https://github.com/huggingface/transformers/blob/master/src/transformers/models/longformer/modeling_longformer.py