IBM / text-generation-inference

IBM development fork of https://github.com/huggingface/text-generation-inference
Apache License 2.0
52 stars 30 forks source link

Bump fms-extras version to avoid torch 2.3.0 issue #82

Closed tdoublep closed 4 months ago

tdoublep commented 4 months ago

Motivation

Torch 2.3.0 was released last week and fms-extras was pulling it in as a build dependency, leading to symbol conflicts with torch 2.2.1 (what we are using currently). I've changed the versioning inside fms-extras to ensure this doesn't happen.

Modifications

Just bumping version for fms-extras

Result

Resolves ImportErrors that are present with current main:

 ImportError: /opt/tgis/lib/python3.11/site-packages/fms_extras/paged_c.cpython-311-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda14ExchangeDeviceEa

Related Issues

n/a