[Feature Request]: Add AMD GPU support please - Githubissues

infiniflow / ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

https://ragflow.io

Apache License 2.0

22.86k stars 2.24k forks source link

[Feature Request]: Add AMD GPU support please #2457

Open wcwong22000 opened 2 months ago

wcwong22000 commented 2 months ago

Is there an existing issue for the same feature request?

[X] I have checked the existing issues.

Is your feature request related to a problem?

My rig has AMD 7900GRE (a model popular in Greater China Region). It took hours to parse just one WORD doc of 200 pages.

Describe the feature you'd like

Please add AMD GPU's ROCm support to enable it to use embedding to accelerate parsing documents like NVIDIA GPU does.

Describe implementation you've considered

No response

Documentation, adoption, use case

No response

Additional information

No response