search

IEIT-Yuan / Yuan-2.0

Yuan 2.0 Large Language Model
Other
681 stars 85 forks source link

请问源2.0-102B（Windows）是否支持英特尔arc独立显卡 #133

Open tonyxx1 opened 6 months ago

tonyxx1 commented 6 months ago

如题，下个月英特尔将送来一张Arc A750测试，我想知道源2.0是否支持它。

zhaoxudong01 commented 6 months ago

没有在该设备上进行过测试。 目前模型依赖的flash attention, fused_kernel都是cuda编译的，在英特尔独显上应该是需要修改对应的部分进行适配。

tonyxx1 commented 6 months ago

需要修改哪里呢

获取Outlook for Androidhttps://aka.ms/AAb9ysg

From: zhaoxudong01 @.> Sent: Wednesday, March 20, 2024 10:33:36 AM To: IEIT-Yuan/Yuan-2.0 @.> Cc: tonyxx1 @.>; Author @.> Subject: Re: [IEIT-Yuan/Yuan-2.0] 请问源2.0-102B（Windows）是否支持英特尔arc独立显卡 (Issue #133)

没有在该设备上进行过测试。 目前模型依赖的flash attention, fused_kernel都是cuda编译的，在英特尔独显上应该是需要修改对应的部分进行适配。

― Reply to this email directly, view it on GitHubhttps://github.com/IEIT-Yuan/Yuan-2.0/issues/133#issuecomment-2008578330, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A2NU22TYNHPSAKWID5HKNPLYZDYQBAVCNFSM6AAAAABE5WEIR2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMBYGU3TQMZTGA. You are receiving this because you authored the thread.Message ID: @.***>

zhuhong commented 6 months ago

see： https://github.com/intel-analytics/ipex-llm