search

opea-project / GenAIExamples

Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
https://opea.dev
Apache License 2.0
220 stars 135 forks source link

Not able to install on ARM based Ampere instances #604

Open ShankarRIntel opened 1 month ago

ShankarRIntel commented 1 month ago

error.txt While installing using the instructions for the ChatQnA example on Xeon. The following errors occur( error.txt). These seem to be due to the unavailability/incompatibility of certain python libraries on ARM processors

endomorphosis commented 1 month ago

This is more properly raised with docarray, the failing dependency. https://github.com/docarray/docarray

However if you really want, you can perhaps not implement docarray[full] depending on hardware platform.

louie-tsai commented 3 weeks ago

@ShankarRIntel For the ARM compiling issue, do you mention below code? `

`

We don't support ARM as the platforms. Do you do cross compilation on Xeon?

thanks

ShankarRIntel commented 3 weeks ago

Its not an arm related error just that certain python libraries are not supported on ARM I believe. Shankar

From: Louie Tsai @.> Sent: Tuesday, August 20, 2024 6:45 PM To: opea-project/GenAIExamples @.> Cc: Ratneshwaran, Shankar @.>; Mention @.> Subject: Re: [opea-project/GenAIExamples] Not able to install on ARM based Ampere instances (Issue #604)

@ShankarRIntelhttps://github.com/ShankarRIntel I don't see any ARM related error, but only saw below errors. `

`

Could you give us more details? Also we don't support ARM as the platforms.

thanks

— Reply to this email directly, view it on GitHubhttps://github.com/opea-project/GenAIExamples/issues/604#issuecomment-2300097138, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AYMDOK24BKBWCYPKMJF3YNDZSPWIVAVCNFSM6AAAAABMSRY4YKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBQGA4TOMJTHA. You are receiving this because you were mentioned.Message ID: @.**@.>>

ShankarRIntel commented 2 weeks ago

The error appears because of certain files not being present in the arm source tree when compiling some libraries . Hence this error. Would you be able to debug which library and what fails, and can it be resolved. Thanks Shankar

From: Louie Tsai @.> Sent: Tuesday, August 20, 2024 6:45 PM To: opea-project/GenAIExamples @.> Cc: Ratneshwaran, Shankar @.>; Mention @.> Subject: Re: [opea-project/GenAIExamples] Not able to install on ARM based Ampere instances (Issue #604)

@ShankarRIntelhttps://github.com/ShankarRIntel I don't see any ARM related error, but only saw below errors. `

`

Could you give us more details? Also we don't support ARM as the platforms.

thanks

— Reply to this email directly, view it on GitHubhttps://github.com/opea-project/GenAIExamples/issues/604#issuecomment-2300097138, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AYMDOK24BKBWCYPKMJF3YNDZSPWIVAVCNFSM6AAAAABMSRY4YKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBQGA4TOMJTHA. You are receiving this because you were mentioned.Message ID: @.**@.>>

louie-tsai commented 1 week ago

@ShankarRIntel
No ARM package is needed for ChatQnA. Could you remind us what package need ARM support in your case?

regards Louie

ShankarRIntel commented 1 week ago

Hi Louis, Can I provide you with an Ampere instance for debugging? Shankar

From: Louie Tsai @.> Sent: Tuesday, September 3, 2024 11:35 AM To: opea-project/GenAIExamples @.> Cc: Ratneshwaran, Shankar @.>; Mention @.> Subject: Re: [opea-project/GenAIExamples] Not able to install on ARM based Ampere instances (Issue #604)

@ShankarRIntelhttps://github.com/ShankarRIntel No ARM package is needed for ChatQnA. Could you remind us what package need ARM support in your case?

regards Louie

— Reply to this email directly, view it on GitHubhttps://github.com/opea-project/GenAIExamples/issues/604#issuecomment-2327172690, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AYMDOK3ZSQYDFSAL7PEMMS3ZUX6O5AVCNFSM6AAAAABMSRY4YKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMRXGE3TENRZGA. You are receiving this because you were mentioned.Message ID: @.**@.>>

louie-tsai commented 1 week ago

@ShankarRIntel
What architecture does Ampere instance have? if it is a ARM based instance, this might be a feature request instead.

regards Louie

ShankarRIntel commented 1 week ago

Yes that is correct Ampere is ARM. A request from Oracle for compatibility. Shankar

From: Louie Tsai @.> Sent: Tuesday, September 3, 2024 1:53 PM To: opea-project/GenAIExamples @.> Cc: Ratneshwaran, Shankar @.>; Mention @.> Subject: Re: [opea-project/GenAIExamples] Not able to install on ARM based Ampere instances (Issue #604)

@ShankarRIntelhttps://github.com/ShankarRIntel What architecture does Ampere instance have? if it is a ARM based instance, this might be a feature request instead.

regards Louie

— Reply to this email directly, view it on GitHubhttps://github.com/opea-project/GenAIExamples/issues/604#issuecomment-2327417473, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AYMDOK2QSTME5LXSK3LDQ4LZUYOS5AVCNFSM6AAAAABMSRY4YKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMRXGQYTONBXGM. You are receiving this because you were mentioned.Message ID: @.**@.>>

louie-tsai commented 1 week ago

@kevinintel There is a new feature request to support Oracle Ampere instance. please guide Shankar how to move this feature request forward.

kevinintel commented 5 days ago

It's not high priority task. Oracle Cloud is on roadmap, but not ARM based machine

mkbhanda commented 5 days ago

Ideally the hardware vendor, ARM or a party interested in using OPEA on ARM should engage on this issue. Let us label it with "ARM" and "Backlog". Currently we do not support ARM.

ShankarRIntel commented 5 days ago

Thanks, I believe we should document that Shankar

From: Malini Bhandaru @.> Sent: Wednesday, September 11, 2024 12:26 AM To: opea-project/GenAIExamples @.> Cc: Ratneshwaran, Shankar @.>; Mention @.> Subject: Re: [opea-project/GenAIExamples] Not able to install on ARM based Ampere instances (Issue #604)

Ideally the hardware vendor, ARM or a party interested in using OPEA on ARM should engage on this issue. Let us label it with "ARM" and "Backlog". Currently we do not support ARM.

— Reply to this email directly, view it on GitHubhttps://github.com/opea-project/GenAIExamples/issues/604#issuecomment-2342863862, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AYMDOK6UHWDWT65HHPFOKLDZV7V7XAVCNFSM6AAAAABMSRY4YKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNBSHA3DGOBWGI. You are receiving this because you were mentioned.Message ID: @.**@.>>