getting 504 Gateway Time-out when created report for dashboard with multiple panels

i have installed pdf reported in my k8s cluster using below yaml

apiVersion: apps/v1
kind: Deployment
metadata:
  creationTimestamp: null
  labels:
    app: pdf-reporter
    app.kubernetes.io/component: reporter
    app.kubernetes.io/instance: pdf-reporter
    app.kubernetes.io/name: pdf-reporter
  name: pdf-reporer
spec:
  replicas: 1
  selector:
    matchLabels:
      app: pdf-reporter
      app.kubernetes.io/component: reporter
      app.kubernetes.io/instance: pdf-reporter
      app.kubernetes.io/name: pdf-reporter

  strategy: {}
  template:
    metadata:
      creationTimestamp: null
      labels:
        app: pdf-reporter
        app.kubernetes.io/component: reporter
        app.kubernetes.io/instance: pdf-reporter
        app.kubernetes.io/name: pdf-reporter
    spec:
      containers:
      - image: izakmarais/grafana-reporter
        name: pdf-reporer
        command: ["grafana-reporter", "-ssl-check=false", "-ip", "xxxxx","-proto", "https://"]
        imagePullPolicy: IfNotPresent
        resources:
          limits:
            cpu: 300m
            memory: 512Mi
          requests:
            cpu: 300m
            memory: 512Mi
      restartPolicy: Always

Error in pdf-reporter pod

2021/05/19 10:18:17 Error creating image for panel: error getting panel {Id:38 Type:singlestat Title:Containers Running GridPos:{H:3 W:6 X:0 Y:28}}: Error obtaining render: 500 Internal Server Error
2021/05/19 10:18:17 Downloading image  42 https://xxxx/render/d-solo/4XuMd2Iiz/_?from=now-30m&height=150&panelId=42&theme=light&to=now&var-datasource=&var-namespace=.%2A&var-node=.%2A&width=300
2021/05/19 10:18:18 Error obtaining render for panel {Id:34 Type:singlestat Title:Pods Unknown GridPos:{H:3 W:8 X:16 Y:24}}, Status: 500, Retrying after 10s...
2021/05/19 10:18:18 Error obtaining render for panel {Id:42 Type:singlestat Title:Memory Requested By Containers GridPos:{H:3 W:12 X:12 Y:31}}, Status: 500, Retrying after 10s...
2021/05/19 10:18:19 Error obtaining render for panel {Id:16 Type:table-old Title:Deployment Replicas - Up To Date GridPos:{H:5 W:6 X:0 Y:11}}, Status: 500, Retrying after 20s...
2021/05/19 10:18:19 Error obtaining render for panel {Id:18 Type:singlestat Title:Deployment Replicas GridPos:{H:5 W:6 X:6 Y:11}}, Status: 500, Retrying after 20s...
2021/05/19 10:18:20 Error obtaining render for panel {Id:30 Type:singlestat Title:Pods Running GridPos:{H:3 W:12 X:0 Y:21}}, Status: 500, Retrying after 20s...
2021/05/19 10:18:21 Error obtaining render for panel {Id:31 Type:singlestat Title:Pods Pending GridPos:{H:3 W:12 X:12 Y:21}}, Status: 500, Retrying after 20s...
2021/05/19 10:18:21 Error obtaining render for panel {Id:32 Type:singlestat Title:Pods Failed GridPos:{H:3 W:8 X:0 Y:24}}, Status: 500, Retrying after 20s...
2021/05/19 10:18:22 Error obtaining render: <!DOCTYPE html>
<html lang="en">
  <head>
    <meta charset="utf-8">
    <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
    <meta name="viewport" content="width=device-width">
    <meta name="theme-color" content="#000">

    <title>Grafana - Error</title>

    <base href="/" />

    <link rel="stylesheet" href="public/build/grafana.dark.d3489276abe5fda2bd26.css">

    <link rel="icon" type="image/png" href="public/img/fav32.png">
    <link rel="mask-icon" href="public/img/grafana_mask_icon.svg" color="#F05A28">

  </head>

Below are the error logs from grafana server

  t=2021-05-19T10:20:44+0000 lvl=eror msg="Remote rendering request failed" logger=rendering renderer=http error="500 Internal Server Error"
t=2021-05-19T10:20:44+0000 lvl=eror msg="Rendering failed." logger=context userId=0 orgId=4 uname= error="Remote rendering request failed. 500: 500 Internal Server Error"
t=2021-05-19T10:20:44+0000 lvl=eror msg="Request Completed" logger=context userId=0 orgId=4 uname= method=GET path=/render/d-solo/4XuMd2Iiz/_ status=500 remote_addr=xxxxx time_ms=505 size=1723 referer=
t=2021-05-19T10:20:46+0000 lvl=info msg=Rendering logger=rendering renderer=http path="d-solo/4XuMd2Iiz/_?from=now-30m&height=150&panelId=49&theme=light&to=now&var-datasource=&var-namespace=.%2A&var-node=.%2A&width=300"
t=2021-05-19T10:20:46+0000 lvl=dbug msg="calling remote rendering service" logger=rendering renderer=http url="http://localhost:8081/render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=150&renderKey=QN1ShnL1HBSL8yj7Tnd4O6OBQKze9Rkh&timeout=60&timezone=&url=http%3A%2F%2Flocalhost%3A80%2Fd-solo%2F4XuMd2Iiz%2F_%3Ffrom%3Dnow-30m%26height%3D150%26panelId%3D49%26theme%3Dlight%26to%3Dnow%26var-datasource%3D%26var-namespace%3D.%252A%26var-node%3D.%252A%26width%3D300%26render%3D1&width=300"

Please let me know if you need any other details. Any help on this is greately appreciated.

IzakMarais / reporter

getting 504 Gateway Time-out when created report for dashboard with multiple panels #297