Custom runtime for GAE based on gcr.io/google-appengine/jetty

[rdolce]

If I build the Docker as a standalone Docker from cloudshel jetty is started and it works, while if I deploy the same Dockerfile in a GAE felxible service jetty is not working and any attempt to establish a connection from inside the docker to localhost 8080 result in a connection that will remain stuck. Can you please check?

Please find attached the Dockerfile.

`FROM gcr.io/google-appengine/jetty ADD wimem-0.0.1-SNAPSHOT.war $JETTY_BASE/webapps/root.war

Versions

ADD sources.list /etc/apt/sources.list RUN apt-get update RUN apt-get -y install curl gnupg

RUN export CHROME_DRIVER_VERSION=curl -sS chromedriver.storage.googleapis.com/LATEST_RELEASE

ENV CHROME_DRIVER_VERSION 2.40 ENV SELENIUM_STANDALONE_VERSION 3.4.0

RUN SELENIUM_SUBDIR=$(echo "$SELENIUM_STANDALONE_VERSION" | cut -d"." -f-2)

ENV SELENIUM_SUBDIR 3.4

Remove existing downloads and binaries so we can start from scratch.

RUN apt-get remove google-chrome-stable RUN rm -f ~/selenium-server-standalone-*.jar RUN rm -f ~/chromedriver_linux64.zip RUN rm -f /usr/local/bin/chromedriver RUN rm -f /usr/local/bin/selenium-server-standalone.jar

Install dependencies.

RUN apt-get update RUN apt-get install -y unzip openjdk-8-jre-headless xvfb libxi6 libgconf-2-4

Install Chrome.

RUN curl -sS -o - https://dl-ssl.google.com/linux/linux_signing_key.pub | apt-key add RUN echo "deb http://dl.google.com/linux/chrome/deb/ stable main" >> /etc/apt/sources.list.d/google-chrome.list RUN apt-get -y update RUN apt-get -y install google-chrome-stable

Install ChromeDriver.

RUN wget -N http://chromedriver.storage.googleapis.com/$CHROME_DRIVER_VERSION/chromedriver_linux64.zip -P ~/ RUN unzip ~/chromedriver_linux64.zip -d ~/ RUN rm ~/chromedriver_linux64.zip RUN mv -f ~/chromedriver /usr/local/bin/chromedriver RUN chown root:root /usr/local/bin/chromedriver RUN chmod 0755 /usr/local/bin/chromedriver

Install Selenium.

RUN wget -N http://selenium-release.storage.googleapis.com/$SELENIUM_SUBDIR/selenium-server-standalone-$SELENIUM_STANDALONE_VERSION.jar -P ~/ RUN mv -f ~/selenium-server-standalone-$SELENIUM_STANDALONE_VERSION.jar /usr/local/bin/selenium-server-standalone.jar RUN chown root:root /usr/local/bin/selenium-server-standalone.jar RUN chmod 0755 /usr/local/bin/selenium-server-standalone.jar `

[meltsufin]

What happens when you access the application from an external browser? One thing to check is whether you have enough memory on the VM.

[rdolce]

Hi Mike, when I try to access from an external browser it start to load for an infinite time the page, and the loading phase will never finish.

I checked the logs of jetty and the war packages is successfully deployed without any errors.

I have already increased the memory, now the instance is : 4 vCPU and 8 GB. My app.yaml files contains this: resources: cpu: 4 memory_gb: 8 disk_size_gb: 10

What do you suggest?

Thanks a lot in advance for your help, Best Regards riccardo

[meltsufin]

What does the request log / nginx log show? I would check all of the logs in the Log Viewer for the app.

[rdolce]

Hi, I got this: (I’m not very expert about ngnix , are you able to understand some from the log below provided? )

37.186.209.186 - "GET /" 499 undefined "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36" Espandi tutto | Comprimi tutto { httpRequest: { latency: "150.154s" referer: "-" remoteIp: "37.186.209.186" requestMethod: "GET" requestUrl: "/" status: 499 userAgent: "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36" } insertId: "1qzqsj8g21rkgnq" jsonPayload: { appLatencySeconds: "-" httpRequest: { protocol: "HTTP/1.1" } latencySeconds: "150.154" trace: "71d7c802d4966192fdef550b04a93f8a" } labels: { appengine.googleapis.com/instance_name: "aef-wimem-1-jm88" appengine.googleapis.com/trace_id: "71d7c802d4966192fdef550b04a93f8a" compute.googleapis.com/resource_id: "7006002908047422042" compute.googleapis.com/resource_name: "17917f325bb4" compute.googleapis.com/zone: "europe-west3-a" } logName: "projects/rdolce-gcp-test/logs/appengine.googleapis.com%2Fnginx.request" receiveTimestamp: "2018-06-19T14:27:13.285421512Z" resource: { labels: { module_id: "wimem" project_id: "rdolce-gcp-test" version_id: "1" } type: "gae_app" } timestamp: "2018-06-19T14:27:10.320Z" }

Thanks riccardo

Da: Mike Eltsufin [mailto:notifications@github.com] Inviato: martedì 19 giugno 2018 16:22 A: GoogleCloudPlatform/jetty-runtime Cc: Riccardo Dolce; Author Oggetto: Re: [GoogleCloudPlatform/jetty-runtime] Custom runtime for GAE based on gcr.io/google-appengine/jetty (#235)

What does the request log / nginx log show? I would check all of the logs in the Log Viewer for the app.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/GoogleCloudPlatform/jetty-runtime/issues/235#issuecomment-398416578, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AmhiGBNkX44yXiS6QZd6FvMXgsDOPNsdks5t-QkBgaJpZM4UtlBa.

---

Questo messaggio ed i suoi allegati sono indirizzati esclusivamente alle persone indicate. La diffusione, copia o qualsiasi altra azione derivante dalla conoscenza di queste informazioni sono rigorosamente vietate. Qualora abbiate ricevuto questo documento per errore siete cortesemente pregati di darne immediata comunicazione al mittente e di provvedere alla sua distruzione, Grazie. This e-mail and any attachment are confidential and may contain privileged information intended for the addressee(s) only. Dissemination, copying, printing or use by anybody else is unauthorized. If you are not the intended recipient, please delete this message and any attachment and notify the sender by returning it, Thanks.

[rdolce]

According to my understanding ngnix is meeting the same issue I discovered while trying to connect on port 8080 from the instance to jetty ( that is inside the docker ). Jetty inside the docker is not responding.

[meltsufin]

It looks like the application is not responding, and the browser closed the connection after 150.154s causing the 499 HTTP code. Since you also cannot connect to the app from inside the docker container, I suspect there's something wrong with the app container itself. Maybe some problem with Jetty + your code. Maybe try runtime: custom and build your own app container, and test it locally.

[rdolce]

I have already built my custom runtime. The Dockerfile I have attached in the initial post is the one provided to appengine.

This is my yaml file:

########CUSTOM RUNTIME BASE ON JAVA8+JETTY9 service: wimem # Id of the service env: flex # Flex environment runtime: custom # Java runtime

runtime_config:

jdk: openjdk8 # use OpenJDK 8

server: jetty9

handlers:

- url: /.*

script: this field is required, but ignored

env_variables: 'SPRING_PROFILES_ACTIVE': 'common,cloud-gae'

network: name: default

manual_scaling: instances: 1

resources: cpu: 4 memory_gb: 8 disk_size_gb: 10 volumes:

• name: ramdisk1 volume_type: tmpfs size_gb: 0.5

While the custom dockerfile used is:

FROM gcr.io/google-appengine/jetty

ADD wimem-0.0.1-SNAPSHOT.war $JETTY_BASE/webapps/root.war

Versions

ADD sources.list /etc/apt/sources.list

RUN apt-get update

RUN apt-get -y install curl gnupg

RUN export CHROME_DRIVER_VERSION=curl -sS chromedriver.storage.googleapis.com/LATEST_RELEASE

ENV CHROME_DRIVER_VERSION 2.40

ENV SELENIUM_STANDALONE_VERSION 3.4.0

RUN SELENIUM_SUBDIR=$(echo "$SELENIUM_STANDALONE_VERSION" | cut -d"." -f-2)

ENV SELENIUM_SUBDIR 3.4

Remove existing downloads and binaries so we can start from scratch.

RUN apt-get remove google-chrome-stable

RUN rm -f ~/selenium-server-standalone-*.jar

RUN rm -f ~/chromedriver_linux64.zip

RUN rm -f /usr/local/bin/chromedriver

RUN rm -f /usr/local/bin/selenium-server-standalone.jar

Install dependencies.

RUN apt-get update

RUN apt-get install -y unzip openjdk-8-jre-headless xvfb libxi6 libgconf-2-4

Install Chrome.

RUN curl -sS -o - https://dl-ssl.google.com/linux/linux_signing_key.pub | apt-key add

RUN echo "deb http://dl.google.com/linux/chrome/deb/ stable main" >> /etc/apt/sources.list.d/google-chrome.list

RUN apt-get -y update

RUN apt-get -y install google-chrome-stable

Install ChromeDriver.

RUN wget -N http://chromedriver.storage.googleapis.com/$CHROME_DRIVER_VERSION/chromedriver_linux64.zip -P ~/

RUN unzip ~/chromedriver_linux64.zip -d ~/

RUN rm ~/chromedriver_linux64.zip

RUN mv -f ~/chromedriver /usr/local/bin/chromedriver

RUN chown root:root /usr/local/bin/chromedriver

RUN chmod 0755 /usr/local/bin/chromedriver

Install Selenium.

RUN wget -N http://selenium-release.storage.googleapis.com/$SELENIUM_SUBDIR/selenium-server-standalone-$SELENIUM_STANDALONE_VERSION.jar -P ~/

RUN mv -f ~/selenium-server-standalone-$SELENIUM_STANDALONE_VERSION.jar /usr/local/bin/selenium-server-standalone.jar

RUN chown root:root /usr/local/bin/selenium-server-standalone.jar

RUN chmod 0755 /usr/local/bin/selenium-server-standalone.jar

Da: Mike Eltsufin [mailto:notifications@github.com] Inviato: martedì 19 giugno 2018 16:39 A: GoogleCloudPlatform/jetty-runtime Cc: Riccardo Dolce; Author Oggetto: Re: [GoogleCloudPlatform/jetty-runtime] Custom runtime for GAE based on gcr.io/google-appengine/jetty (#235)

It looks like the application is not responding, and the browser closed the connection after 150.154s causing the 499 HTTP code. Since you also cannot connect to the app from inside the docker container, I suspect there's something wrong with the app container itself. Maybe some problem with Jetty + your code. Maybe try runtime: custom and build your own app container, and test it locally.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/GoogleCloudPlatform/jetty-runtime/issues/235#issuecomment-398423201, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AmhiGNZc6AOUHlP2hCJP-Q7ZU1qXGpNRks5t-Q0YgaJpZM4UtlBa.

---

Questo messaggio ed i suoi allegati sono indirizzati esclusivamente alle persone indicate. La diffusione, copia o qualsiasi altra azione derivante dalla conoscenza di queste informazioni sono rigorosamente vietate. Qualora abbiate ricevuto questo documento per errore siete cortesemente pregati di darne immediata comunicazione al mittente e di provvedere alla sua distruzione, Grazie. This e-mail and any attachment are confidential and may contain privileged information intended for the addressee(s) only. Dissemination, copying, printing or use by anybody else is unauthorized. If you are not the intended recipient, please delete this message and any attachment and notify the sender by returning it, Thanks.

[rdolce]

Please consider that I have also tried to build locally the docker in the cloudshell, I run the docker from cloudshell and it works, if I run a simple wget , it works , jetty is managing the request.

[meltsufin]

In that case, it doesn't look like a problem with the runtime. As far as the application container is concerned, the requirement is that it exposes port 8080, and the rest is taken care of by the App Engine Flex environment. I would suggest reaching out the Google Cloud support.