Closed vince62s closed 3 months ago
those are not supported by torch.compile would be great to use cos/sin the same way as non interleaved.
cf: https://github.com/karpathy/llama2.c/pull/103/files
those are not supported by torch.compile would be great to use cos/sin the same way as non interleaved.
cf: https://github.com/karpathy/llama2.c/pull/103/files