search

dusty-nv / jetson-containers

Machine Learning Containers for NVIDIA Jetson and JetPack-L4T
MIT License
1.89k stars 416 forks source link

Building ctranslate2 on AGX with JP5 #512

Closed budzianowski closed 1 month ago

budzianowski commented 1 month ago

Building with JP5 and 35.1.2 the ctranslate2 errors with https://github.com/OpenNMT/CTranslate2/issues/1664 Have you managed to have successful builds lately or only with JP6 (higher cuda version).

dusty-nv commented 1 month ago

@budzianowski I believe I've only built it recently on JP6, and yea it builds flash-attention which requires newer CUDA.