search

nextcloud / llm2

MIT License
2 stars 0 forks source link

GPU Support #16

Open janmuennich opened 5 days ago

janmuennich commented 5 days ago

Apparently GPU support has been removed again recently. There are still the inactive feature branches gpu-support and nvidia-support but commit 4a1ccd1 removed it from main.

I cannot find any information though about the reasons behind this. Could the developers clarify the issue, if this is still on the roadmap and if and what help you would need?

marcelklehr commented 5 days ago

Hi @janmuennich Yes, we're about to add GPU support again. ETA is some time next week.