search

bahrain-uob / moe-questions-bank

This repository will include the MOE Questions Bank challenge artifacts
1 stars 0 forks source link

Prepare SageMaker environment #11

Open BaselMalalla opened 1 week ago

fedaabd commented 1 day ago

Can we have detailes; we explored the jump start with xxx FM; we reached the conclusion, and then we attempted SageMaker Studio; we are doing x, and we are facing this challenge to be continued working on xxxx

BaselMalalla commented 1 day ago

We explored SageMaker with JumpStart and managed to deploy a few models, but the quality was terrible and customization was limited.

Without JumpStart, we couldn't fully explore the results with our desired models because we faced deployment issues (i.e. health check timeout). We need to get the deployment issues fixed, which mostly isn't within our reach; it is related to account limitations, user rights, etc..

Additionally, we managed to deploy the desired models (ollama) on our local machines and the results were great.