search

oslabs-beta / dockwell

https://dockwell.tech/
MIT License
52 stars 5 forks source link

dockwell not working inside VM #81

Open usmangt opened 1 year ago

usmangt commented 1 year ago

Hi,

I was really impressed with this tool info on Github and wanted to give it a try. I used the guide to deploy it.

I am running Docker inside the VM CentOS 7 and for that created the daemon.json inside the /etc/docker as instructed in the guide.

Then restarted the service so that the changes take effect

When I do docker compose, all seems to be fine

[root@docker dockwell-SetupInstall]# docker compose up -d
[+] Running 7/7
 ⠿ Network dockwell-setupinstall_default           Created                                                                                                                                                    0.0s
 ⠿ Volume "dockwell-setupinstall_grafana-data"     Created                                                                                                                                                    0.0s
 ⠿ Volume "dockwell-setupinstall_prometheus-data"  Created                                                                                                                                                    0.0s
 ⠿ Container grafana                               Started                                                                                                                                                    0.6s
 ⠿ Container cadvisor                              Started                                                                                                                                                    0.6s
 ⠿ Container prometheus                            Started                                                                                                                                                    0.8s
 ⠿ Container dockwell                              Started                                                                                                                                                    1.0s

And docker compose also looks good:

[root@docker dockwell-SetupInstall]# docker ps
CONTAINER ID   IMAGE                              COMMAND                  CREATED         STATUS                   PORTS                                       NAMES
fa5a1d81dc4c   dockwellhub/dwh-prod:latest        "/bin/sh -c 'node ./…"   6 minutes ago   Up 6 minutes             0.0.0.0:3535->3535/tcp, :::3535->3535/tcp   dockwell
9a510bef8d3b   prom/prometheus:latest             "/bin/prometheus --c…"   6 minutes ago   Up 6 minutes             0.0.0.0:9090->9090/tcp, :::9090->9090/tcp   prometheus
294afb179f0d   grafana/grafana-oss:latest         "/run.sh"                6 minutes ago   Up 6 minutes             0.0.0.0:3000->3000/tcp, :::3000->3000/tcp   grafana
773e1917f900   gcr.io/cadvisor/cadvisor:v0.45.0   "/usr/bin/cadvisor -…"   6 minutes ago   Up 6 minutes (healthy)   0.0.0.0:8080->8080/tcp, :::8080->8080/tcp   cadvisor

However, when I try to reach port 3535, the page seems to be stuck and not able to further:

image

I waited for a while but no result.

Checking the logs, found this:

[root@docker dockwell-SetupInstall]# docker compose logs

Attaching to dockwell, prometheus, grafana, cadvisor
dockwell      | Listening on 3535
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
dockwell      | ERROR:  promQLController.memoryQuery - error in the promQL MEMORY query: [object Object]
prometheus    | ts=2023-02-07T23:19:32.883Z caller=main.go:512 level=info msg="No time or size retention was set so using the default time retention" duration=15d
prometheus    | ts=2023-02-07T23:19:32.883Z caller=main.go:556 level=info msg="Starting Prometheus Server" mode=server version="(version=2.42.0, branch=HEAD, revision=225c61122d88b01d1f0eaaee0e05b6f3e0567ac0)"
prometheus    | ts=2023-02-07T23:19:32.883Z caller=main.go:561 level=info build_context="(go=go1.19.5, platform=linux/amd64, user=root@c67d48967507, date=20230201-07:53:32)"
prometheus    | ts=2023-02-07T23:19:32.883Z caller=main.go:562 level=info host_details="(Linux 3.10.0-1160.71.1.el7.x86_64 #1 SMP Tue Jun 28 15:37:28 UTC 2022 x86_64 327484a9c9e9 (none))"
prometheus    | ts=2023-02-07T23:19:32.884Z caller=main.go:563 level=info fd_limits="(soft=1048576, hard=1048576)"
prometheus    | ts=2023-02-07T23:19:32.884Z caller=main.go:564 level=info vm_limits="(soft=unlimited, hard=unlimited)"
prometheus    | ts=2023-02-07T23:19:32.886Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=0.0.0.0:9090
prometheus    | ts=2023-02-07T23:19:32.886Z caller=main.go:993 level=info msg="Starting TSDB ..."
prometheus    | ts=2023-02-07T23:19:32.887Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9090
prometheus    | ts=2023-02-07T23:19:32.887Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9090
prometheus    | ts=2023-02-07T23:19:32.891Z caller=head.go:564 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any"
prometheus    | ts=2023-02-07T23:19:32.891Z caller=head.go:608 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=3.632µs
prometheus    | ts=2023-02-07T23:19:32.891Z caller=head.go:614 level=info component=tsdb msg="Replaying WAL, this may take a while"
prometheus    | ts=2023-02-07T23:19:32.892Z caller=head.go:685 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3
prometheus    | ts=2023-02-07T23:19:32.892Z caller=head.go:685 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3
prometheus    | ts=2023-02-07T23:19:32.893Z caller=head.go:685 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3
prometheus    | ts=2023-02-07T23:19:32.893Z caller=head.go:685 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3
prometheus    | ts=2023-02-07T23:19:32.894Z caller=head.go:722 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=38.116µs wal_replay_duration=2.402151ms wbl_replay_duration=185ns total_replay_duration=2.456406ms
prometheus    | ts=2023-02-07T23:19:32.894Z caller=main.go:1014 level=info fs_type=EXT4_SUPER_MAGIC
prometheus    | ts=2023-02-07T23:19:32.894Z caller=main.go:1017 level=info msg="TSDB started"
prometheus    | ts=2023-02-07T23:19:32.894Z caller=main.go:1197 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml
prometheus    | ts=2023-02-07T23:19:32.895Z caller=main.go:1234 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=478.001µs db_storage=2.405µs remote_storage=2.397µs web_handler=307ns query_engine=1.597µs scrape=195.219µs scrape_sd=46.786µs notify=869ns notify_sd=2.41µs rules=2.34µs tracing=9.186µs
prometheus    | ts=2023-02-07T23:19:32.895Z caller=main.go:978 level=info msg="Server is ready to receive web requests."
prometheus    | ts=2023-02-07T23:19:32.895Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..."
grafana       | logger=settings t=2023-02-07T23:19:32.590071869Z level=info msg="Starting Grafana" version=9.3.2 commit=21c1d14e91 branch=HEAD compiled=2022-12-14T10:40:18Z
grafana       | logger=settings t=2023-02-07T23:19:32.590188908Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini
grafana       | logger=settings t=2023-02-07T23:19:32.590193431Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini
grafana       | logger=settings t=2023-02-07T23:19:32.590195935Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana"
grafana       | logger=settings t=2023-02-07T23:19:32.590198337Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana"
grafana       | logger=settings t=2023-02-07T23:19:32.590200532Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins"
grafana       | logger=settings t=2023-02-07T23:19:32.590202841Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning"
grafana       | logger=settings t=2023-02-07T23:19:32.590205008Z level=info msg="Config overridden from command line" arg="default.log.mode=console"
grafana       | logger=settings t=2023-02-07T23:19:32.590207306Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana"
grafana       | logger=settings t=2023-02-07T23:19:32.590209612Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana"
grafana       | logger=settings t=2023-02-07T23:19:32.590212096Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins"
grafana       | logger=settings t=2023-02-07T23:19:32.590214243Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning"
grafana       | logger=settings t=2023-02-07T23:19:32.590216474Z level=info msg="Path Home" path=/usr/share/grafana
grafana       | logger=settings t=2023-02-07T23:19:32.59021875Z level=info msg="Path Data" path=/var/lib/grafana
grafana       | logger=settings t=2023-02-07T23:19:32.590220998Z level=info msg="Path Logs" path=/var/log/grafana
grafana       | logger=settings t=2023-02-07T23:19:32.590223088Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins
grafana       | logger=settings t=2023-02-07T23:19:32.590225336Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning
grafana       | logger=settings t=2023-02-07T23:19:32.590227511Z level=info msg="App mode production"
grafana       | logger=sqlstore t=2023-02-07T23:19:32.590274093Z level=info msg="Connecting to DB" dbtype=sqlite3
grafana       | logger=migrator t=2023-02-07T23:19:32.604000628Z level=info msg="Starting DB migrations"
grafana       | logger=migrator t=2023-02-07T23:19:32.612120024Z level=info msg="migrations completed" performed=0 skipped=464 duration=233.954µs
grafana       | logger=plugin.loader t=2023-02-07T23:19:32.711291507Z level=info msg="Plugin registered" pluginID=input
grafana       | logger=secrets t=2023-02-07T23:19:32.711846224Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1
grafana       | logger=query_data t=2023-02-07T23:19:32.717546487Z level=info msg="Query Service initialization"
grafana       | logger=live.push_http t=2023-02-07T23:19:32.719708513Z level=info msg="Live Push Gateway initialization"
grafana       | logger=infra.usagestats.collector t=2023-02-07T23:19:32.863974232Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2
grafana       | logger=provisioning.alerting t=2023-02-07T23:19:32.864904665Z level=info msg="starting to provision alerting"
grafana       | logger=provisioning.alerting t=2023-02-07T23:19:32.864917026Z level=info msg="finished to provision alerting"
grafana       | logger=http.server t=2023-02-07T23:19:32.869293662Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=http subUrl= socket=
grafana       | logger=ngalert.state.manager t=2023-02-07T23:19:32.869338978Z level=info msg="Warming state cache for startup"
grafana       | logger=grafanaStorageLogger t=2023-02-07T23:19:32.88483713Z level=info msg="storage starting"
grafana       | logger=ngalert.state.manager t=2023-02-07T23:19:32.930563638Z level=info msg="State cache has been initialized" states=0 duration=61.222487ms
grafana       | logger=ticker t=2023-02-07T23:19:32.930608957Z level=info msg=starting first_tick=2023-02-07T23:19:40Z
grafana       | logger=ngalert.multiorg.alertmanager t=2023-02-07T23:19:32.930616892Z level=info msg="starting MultiOrg Alertmanager"
cadvisor      | W0207 23:19:32.508451       1 machine_libipmctl.go:64] There are no NVM devices!
cadvisor      | W0207 23:19:32.538237       1 manager.go:289] Could not configure a source for OOM detection, disabling OOM events: open /dev/kmsg: no such file or directory
samessai14 commented 1 year ago

Hello! Thank you for notifying us about this issue. The Dockwell team will dig into this issue and update you once we have found a resolution!

usmangt commented 1 year ago

Any updates on this?