danny-avila / rag_api

ID-based RAG FastAPI: Integration with Langchain and PostgreSQL/pgvector
https://librechat.ai/
MIT License
315 stars 131 forks source link

`librechat-rag-api-dev-lite` Image size tripled in the last update #102

Open bastiandg opened 1 day ago

bastiandg commented 1 day ago

What happened?

The image file size of the librechat-rag-api-dev-lite went from 2.1 GB to 7.62 GB

ghcr.io/danny-avila/librechat-rag-api-dev-lite   <none>       1acf95644082   5 weeks ago     2.1GB
ghcr.io/danny-avila/librechat-rag-api-dev-lite   latest       8ae645617180   9 days ago      7.62GB

Steps to Reproduce

docker pull ghcr.io/danny-avila/librechat-rag-api-dev-lite:aa105bcebb3cc1fd2afa06358879d767f9cf7598
docker history ghcr.io/danny-avila/librechat-rag-api-dev-lite:aa105bcebb3cc1fd2afa06358879d767f9cf7598

What browsers are you seeing the problem on?

No response

Relevant log output

The issue seems to be related to the pip install:

$ docker history ghcr.io/danny-avila/librechat-rag-api-dev-lite:aa105bcebb3cc1fd2afa06358879d767f9cf7598
IMAGE          CREATED         CREATED BY                                      SIZE      COMMENT
8ae645617180   9 days ago      CMD ["python" "main.py"]                        0B        buildkit.dockerfile.v0
<missing>      9 days ago      COPY . . # buildkit                             122kB     buildkit.dockerfile.v0
<missing>      9 days ago      RUN /bin/sh -c pip install --no-cache-dir -r…   6.28GB    buildkit.dockerfile.v0
<missing>      9 days ago      COPY requirements.lite.txt . # buildkit         681B      buildkit.dockerfile.v0
<missing>      9 days ago      RUN /bin/sh -c apt-get update     && apt-get…   346MB     buildkit.dockerfile.v0
<missing>      9 days ago      WORKDIR /app                                    0B        buildkit.dockerfile.v0
<missing>      6 weeks ago     CMD ["python3"]                                 0B        buildkit.dockerfile.v0
<missing>      6 weeks ago     RUN /bin/sh -c set -eux;  for src in idle3 p…   36B       buildkit.dockerfile.v0
<missing>      6 weeks ago     RUN /bin/sh -c set -eux;   wget -O python.ta…   55.8MB    buildkit.dockerfile.v0
<missing>      6 weeks ago     ENV PYTHON_SHA256=aab0950817735172601879872d…   0B        buildkit.dockerfile.v0
<missing>      6 weeks ago     ENV PYTHON_VERSION=3.10.15                      0B        buildkit.dockerfile.v0
<missing>      6 weeks ago     ENV GPG_KEY=A035C8C19219BA821ECEA86B64E628F8…   0B        buildkit.dockerfile.v0
<missing>      6 weeks ago     RUN /bin/sh -c set -eux;  apt-get update;  a…   17.8MB    buildkit.dockerfile.v0
<missing>      6 weeks ago     ENV LANG=C.UTF-8                                0B        buildkit.dockerfile.v0
<missing>      6 weeks ago     ENV PATH=/usr/local/bin:/usr/local/sbin:/usr…   0B        buildkit.dockerfile.v0
<missing>      10 months ago   RUN /bin/sh -c set -ex;  apt-get update;  ap…   588MB     buildkit.dockerfile.v0
<missing>      10 months ago   RUN /bin/sh -c set -eux;  apt-get update;  a…   177MB     buildkit.dockerfile.v0
<missing>      19 months ago   RUN /bin/sh -c set -eux;  apt-get update;  a…   48.5MB    buildkit.dockerfile.v0
<missing>      19 months ago   CMD ["bash"]                                    0B        buildkit.dockerfile.v0
<missing>      19 months ago   ADD rootfs.tar.xz / # buildkit                  117MB     buildkit.dockerfile.v0

Screenshots

Looking at the image with dive my guess is that some python dependencies changed. This leads to a bunch of unnecessary nvidia dependencies being installed.

dive

Code of Conduct

danny-avila commented 1 day ago

Thanks looking into it!

@berry-13 i think the latest commit was erroneously merged since the lite image should not have ollama or huggingface dependencies.