search

opea-project / GenAIComps

GenAI components at micro-service level; GenAI service composer to create mega-service
Apache License 2.0
77 stars 140 forks source link

OPEA docker images take a lot of disk space #921

Open xiguiw opened 6 days ago

xiguiw commented 6 days ago

OPEA takes a lot of disk space.

"To deploy them on ITAC using medium or large Xeon VMs, 64GB isn’t sufficient and the next tier is 2TB which is much more expensive."

OPEA consumes lots of space: Both memory and disk space.

It is helpful to reduce the OPEA size.

erojaso commented 6 days ago

I've had similar problems Creating an image for embedding-tei-server used to take 5 min now it takes 20 min and 4.6 gb

REPOSITORY TAG IMAGE ID CREATED SIZE acraksexplore.azurecr.io/embedding-tei 0.0.3 881d61f97080 10 hours ago 4.6GB opea/embedding-tei 0.0.3 881d61f97080 10 hours ago 4.6GB ghcr.io/huggingface/text-embeddings-inference cpu-1.5 64f8afb02d72 4 months ago 138MB