airyhq / airy

💬 Open Source App Framework to build streaming apps with real-time data - 💎 Build real-time data pipelines and make real-time data universally accessible - 🤖 Join historical and real-time data in the stream to create smarter ML and AI applications. - ⚡ Standardize complex data ingestion and stream data to apps with pre-built connectors
https://airy.co/docs/core
Apache License 2.0
369 stars 44 forks source link

Optimize the Docker images #169

Closed ljupcovangelski closed 3 years ago

ljupcovangelski commented 4 years ago

The size of the Docker images has a direct impact on the time that it takes to get the Airy Core Platform up-and-running. Also, since we package some of the images in the Vagrant box, this will have an impact on the size of the box and the time it takes for downloading it.

Currently used Docker images include:

ljupcovangelski commented 3 years ago

This is the current status of the images:

For the base services:

confluentinc/cp-kafka            598MB
confluentinc/cp-zookeeper        598MB
confluentinc/cp-schema-registry  1.21GB
postgres                         158MB
redis                            40.9MB

For the apps:

ghcr.io/airyhq/api/admin                       365MB
ghcr.io/airyhq/sources/twilio-events-router    361MB
ghcr.io/airyhq/sources/twilio-webhook          354MB
ghcr.io/airyhq/webhook/publisher               368MB
ghcr.io/airyhq/sources/facebook-sender         361MB
ghcr.io/airyhq/sources/google-events-router    361MB
ghcr.io/airyhq/sources/chat-plugin             366MB
ghcr.io/airyhq/sources/facebook-events-router  361MB
ghcr.io/airyhq/sources/google-webhook          349MB
ghcr.io/airyhq/sources/facebook-webhook        349MB
ghcr.io/airyhq/frontend/demo                   26.4MB
ghcr.io/airyhq/webhook/consumer                27.1MB
ghcr.io/airyhq/sources/twilio-sender           366MB
ghcr.io/airyhq/api/auth                        310MB
ghcr.io/airyhq/sources/google-sender           363MB
ghcr.io/airyhq/frontend/chat-plugin            21.9MB
ghcr.io/airyhq/api/communication               366MB

At the moment, we will focus the most at Kafka, Zookeeper and the Schema registry.

ljupcovangelski commented 3 years ago

The image for Kafka and Zookeeper has been optimized. Both statefulsets at the moment use the same image, only with different arguments to the entrypoint of the container.

Still left is the Schema registry image.

lucapette commented 3 years ago

finished in #596 🎉