search

SeldonIO / seldon-core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
https://www.seldon.io/tech/products/core/
Other
4.37k stars 831 forks source link

ARM support for seldon-core #4438

Open SurendraKMali opened 1 year ago

SurendraKMali commented 1 year ago

seldon-core supports deployment on AWS EKS.

The AWS have newer ARM based EC2 instance class Name Graviton ie. a series, cheaper and faster.

As of now seldon-core don't have support for ARM , It will be good to have it, More economical to use it on scale then.

ukclivecox commented 1 year ago

This is something we might want to look at for v2

Jose-Bastos commented 1 year ago

Hello! Any updates on this for v2? I tried to install on my M2 for initial dev and got an error.

ukclivecox commented 1 year ago

We need more help for this as areas - does this issue help at all?https://github.com/SeldonIO/seldon-core/issues/4594

asingh9530 commented 1 year ago

@cliveseldon Seems this issue is still open, so wanted to bring attention to following command make deploy-local as this will pull only base x86_64 images. Currently there seems to have no way to have these builds specifically for arm.

wuxiaocheng0506 commented 9 months ago

Does v1 now supports deploy on ARM? or is there any way to get v1 images based on ARM architecture?