Open PeerConradi opened 4 years ago
maybe check following:
./scripts/compose ps
shows all containers with state "Up"curl http://localhost:8080/bigbluebutton/api
-> curl https://yourhost.name/bigbluebutton/api
SHARED_SECRET
, does it work?if yes to all, than BBB is running fine -> the problem lies at greenlight itself.
Yes I think everything is running:
Name Command State Ports
-------------------------------------------------------------------------------------------------------------------
bbb-docker_core_1 /entrypoint.sh Up
bbb-docker_coturn_1 docker-entrypoint.sh --ext ... Up
bbb-docker_etherpad_1 /entrypoint.sh Up 9001/tcp
bbb-docker_freeswitch_1 /bin/sh -c /entrypoint.sh Up
bbb-docker_html5_1 /entrypoint.sh Up
bbb-docker_https_proxy_1 /entrypoint.sh /usr/local/ ... Up 0.0.0.0:443->443/tcp, 0.0.0.0:80->80/tcp
bbb-docker_kurento_1 /entrypoint.sh Up (healthy)
bbb-docker_mongodb_1 docker-entrypoint.sh mongod Up 27017/tcp
bbb-docker_nginx_1 /docker-entrypoint.sh ngin ... Up 0.0.0.0:8080->80/tcp
bbb-docker_periodic_1 /entrypoint.sh Up
bbb-docker_postgres_1 docker-entrypoint.sh postgres Up 5432/tcp
bbb-docker_redis_1 docker-entrypoint.sh redis ... Up 127.0.0.1:6379->6379/tcp
bbb-docker_webrtc-sfu_1 ./docker-entrypoint.sh npm ... Up 127.0.0.1:3008->3008/tcp
greenlight bin/start Up 10.7.7.1:5000->80/tcp
It seems to be that the BBB API is not reachable:
curl http://localhost:8080/bigbluebutton/api
<html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.19.1</center>
</body>
</html>
Actually, the webhooks container doesn't seem to be running on your machine. With your setup it should be called "bbb-docker_webhooks_1". Had a similar issue a while ago, that the webhook container kept restarting and there was a duplicate line in one of the configs (mod/webhooks/config.yml). The fix was merged yesterday. See: https://github.com/alangecker/bigbluebutton-docker/pull/34/commits/5a7b6f7c4b3b3d5d5c52bf4a6f5987626ab86087
Hey,
so I made a cheout on the develop branch. Made a ./script/compose down
deleted the .env file and made a ./scripts/setup
and compose up.
I am still on this list:
bbb-docker_core_1 /entrypoint.sh Up
bbb-docker_coturn_1 docker-entrypoint.sh --ext ... Up
bbb-docker_etherpad_1 /entrypoint.sh Up 9001/tcp
bbb-docker_freeswitch_1 /bin/sh -c /entrypoint.sh Up
bbb-docker_html5_1 /entrypoint.sh Up
bbb-docker_https_proxy_1 /entrypoint.sh /usr/local/ ... Up 0.0.0.0:443->443/tcp, 0.0.0.0:80->80/tcp
bbb-docker_kurento_1 /entrypoint.sh Up (healthy)
bbb-docker_mongodb_1 docker-entrypoint.sh mongod Up 27017/tcp
bbb-docker_nginx_1 /docker-entrypoint.sh ngin ... Up 0.0.0.0:8080->80/tcp
bbb-docker_periodic_1 /entrypoint.sh Up
bbb-docker_postgres_1 docker-entrypoint.sh postgres Up 5432/tcp
bbb-docker_redis_1 docker-entrypoint.sh redis ... Up 127.0.0.1:6379->6379/tcp
bbb-docker_webrtc-sfu_1 ./docker-entrypoint.sh npm ... Up 127.0.0.1:3008->3008/tcp
greenlight bin/start Up 10.7.7.1:5000->80/tcp
the difference is that now when I navigate to my URL I get a 502 Bad Gateway, so its getting worse...
still no "bbb-docker_webhooks_1" .. did you set the flag in den .env file? https://github.com/alangecker/bigbluebutton-docker/blob/8b921bc624fd2fb3fdc3465974067615c1ef7c52/sample.env#L20
@cjhille probably the webhooks are disabled. most people won't need them, so can also be intended ;)
./script/upgrade
which triggers rebuilding of the images$ ./scripts/compose logs
(is quite a lot...)$ ./scripts/compose logs core | grep bbb-web
$ ./scripts/compose logs -f --tail=20
502 Bad Gateway
if you call $ curl http://localhost:8080/bigbluebutton/api
$ curl http://10.7.7.2:8090/bigbluebutton/api
@alangecker I should really read the issues more carefully. I was somehow convinced that the "Endpoint and Secret" issue was referring to webhooks and an obviously unrelated error message I encountered. Sorry
./scripts/compose logs core | grep bbb-web Returns: https://pastebin.com/ZyGAEiyu
curl http://localhost:8080/bigbluebutton/api
<html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.19.1</center>
</body>
</html>
curl: (7) Failed to connect to 10.7.7.2 port 8090: Connection refuesed
Whats stange is that I deleted the images manually and made a new setup. And end up the the 502 Gateway error.
When I reinstall the whole server and build everything I at least get to open greenlight.
Ok nevermind greenlight is running again and Im back at:
Server Error
Invalid BigBlueButton Endpoint and Secret
Please make sure the proper steps have been taken. Learn more
there are quite a lot of java.lang.OutOfMemoryError
errors.
how much RAM do you have? 😄 (you can check the total and free amount with $ free -h
)
https://docs.bigbluebutton.org/2.2/install.html#minimum-server-requirements
8 GB is the required minimum for BBB.
Should have 16GB
Maybe docker can't use it all?
Gesamt belegt frei gemns. Puffer/Cache verfügbar
Speicher: 16G 1,8G 12G 23M 2,1G 14G
Auslagerungsspeicher: 0B 0B 0B
okay, thats wird.
which OS do you use and are there other services running on that machine?
could you send us the output of following commands:
ulimit -a
docker exec -it bbb-docker_core_1 bash -c 'ulimit -a'
cat /proc/sys/kernel/threads-max
cat /proc/loadavg
there is a nice guide about debugging this error: http://www.mastertheboss.com/jboss-server/jboss-monitoring/how-to-solve-javalangoutofmemoryerror-unable-to-create-new-native-thread
It's an Ubuntu 18.04 V-Server Nothing else installed except git and docker
Welcome to Ubuntu 18.04.4 LTS (GNU/Linux 4.15.0 x86_64)
ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 1545097
max locked memory (kbytes, -l) 16384
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 62987
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
root@h2868180:~# docker exec -it bbb-docker_core_1 bash -c 'ulimit -a'
runtime/cgo: pthread_create failed: Resource temporarily unavailable
runtime/cgo: pthread_create failed: Resource temporarily unavailable
SIGABRT: abort
PC=0x7f2865dfff47 m=3 sigcode=18446744073709551610
goroutine 0 [idle]:
runtime: unknown pc 0x7f2865dfff47
stack: frame={sp:0x7f28633ad840, fp:0x0} stack=[0x7f2862bae288,0x7f28633ade88)
00007f28633ad740: 0000000000000000 0000000000000000
00007f28633ad750: 0000000000000000 0000000000000000
00007f28633ad760: 0000000000000000 0000000000000000
00007f28633ad770: 0000000000000000 0000000000000000
00007f28633ad780: 0000000000000000 0000000000000000
00007f28633ad790: 0000000000000000 0000000000000000
00007f28633ad7a0: 0000000000000000 0000000000000000
00007f28633ad7b0: 0000000000000000 0000000000000000
00007f28633ad7c0: 0000000000000000 0000000000000000
00007f28633ad7d0: 0000000000000000 0000000000000000
00007f28633ad7e0: 0000000000000000 0000000000000000
00007f28633ad7f0: 0000000000000000 0000000000000000
00007f28633ad800: 0000000000000000 0000000000000000
00007f28633ad810: 0000000000000000 0000000000000000
00007f28633ad820: 0000000000000000 0000000000000000
00007f28633ad830: 00007f28633ad860 0000556f4fba1dfe <runtime.(*mTreap).end+78>
00007f28633ad840: <0000000000000000 0000000000000001
00007f28633ad850: 0000000000000000 0000000100000000
00007f28633ad860: 00007f28633ad8f0 0000556f4fbab7af <runtime.(*mheap).scavengeLocked+559>
00007f28633ad870: 00007f28633ad8a0 0000556f4fba1dfe <runtime.(*mTreap).end+78>
00007f28633ad880: 0000000000000000 0000556f00000001
00007f28633ad890: 0000000000000000 0000000100000038
00007f28633ad8a0: 00007f28633ad930 0000556f4fbab7af <runtime.(*mheap).scavengeLocked+559>
00007f28633ad8b0: 0000556f52d0b2c8 00007f28667b0003
00007f28633ad8c0: fffffffe7fffffff ffffffffffffffff
00007f28633ad8d0: ffffffffffffffff ffffffffffffffff
00007f28633ad8e0: ffffffffffffffff ffffffffffffffff
00007f28633ad8f0: ffffffffffffffff ffffffffffffffff
00007f28633ad900: ffffffffffffffff ffffffffffffffff
00007f28633ad910: ffffffffffffffff ffffffffffffffff
00007f28633ad920: ffffffffffffffff ffffffffffffffff
00007f28633ad930: ffffffffffffffff ffffffffffffffff
runtime: unknown pc 0x7f2865dfff47
stack: frame={sp:0x7f28633ad840, fp:0x0} stack=[0x7f2862bae288,0x7f28633ade88)
00007f28633ad740: 0000000000000000 0000000000000000
00007f28633ad750: 0000000000000000 0000000000000000
00007f28633ad760: 0000000000000000 0000000000000000
00007f28633ad770: 0000000000000000 0000000000000000
00007f28633ad780: 0000000000000000 0000000000000000
00007f28633ad790: 0000000000000000 0000000000000000
00007f28633ad7a0: 0000000000000000 0000000000000000
00007f28633ad7b0: 0000000000000000 0000000000000000
00007f28633ad7c0: 0000000000000000 0000000000000000
00007f28633ad7d0: 0000000000000000 0000000000000000
00007f28633ad7e0: 0000000000000000 0000000000000000
00007f28633ad7f0: 0000000000000000 0000000000000000
00007f28633ad800: 0000000000000000 0000000000000000
00007f28633ad810: 0000000000000000 0000000000000000
00007f28633ad820: 0000000000000000 0000000000000000
00007f28633ad830: 00007f28633ad860 0000556f4fba1dfe <runtime.(*mTreap).end+78>
00007f28633ad840: <0000000000000000 0000000000000001
00007f28633ad850: 0000000000000000 0000000100000000
00007f28633ad860: 00007f28633ad8f0 0000556f4fbab7af <runtime.(*mheap).scavengeLocked+559>
00007f28633ad870: 00007f28633ad8a0 0000556f4fba1dfe <runtime.(*mTreap).end+78>
00007f28633ad880: 0000000000000000 0000556f00000001
00007f28633ad890: 0000000000000000 0000000100000038
00007f28633ad8a0: 00007f28633ad930 0000556f4fbab7af <runtime.(*mheap).scavengeLocked+559>
00007f28633ad8b0: 0000556f52d0b2c8 00007f28667b0003
00007f28633ad8c0: fffffffe7fffffff ffffffffffffffff
00007f28633ad8d0: ffffffffffffffff ffffffffffffffff
00007f28633ad8e0: ffffffffffffffff ffffffffffffffff
00007f28633ad8f0: ffffffffffffffff ffffffffffffffff
00007f28633ad900: ffffffffffffffff ffffffffffffffff
00007f28633ad910: ffffffffffffffff ffffffffffffffff
00007f28633ad920: ffffffffffffffff ffffffffffffffff
00007f28633ad930: ffffffffffffffff ffffffffffffffff
goroutine 1 [chan receive, locked to thread]:
runtime.gopark(0x556f51d75998, 0xc00009a058, 0x170e, 0x3)
/usr/local/go/src/runtime/proc.go:304 +0xe6
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:310
runtime.chanrecv(0xc00009a000, 0x0, 0xc000000101, 0x556f4fb90101)
/usr/local/go/src/runtime/chan.go:524 +0x2ec
runtime.chanrecv1(0xc00009a000, 0x0)
/usr/local/go/src/runtime/chan.go:406 +0x2b
runtime.gcenable()
/usr/local/go/src/runtime/mgc.go:213 +0xae
runtime.main()
/usr/local/go/src/runtime/proc.go:166 +0x129
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1357 +0x1
rax 0x0
rbx 0x7f28661ad840
rcx 0xffffffffffffffff
rdx 0x0
rdi 0x2
rsi 0x7f28633ad840
rbp 0x556f513c4b54
rsp 0x7f28633ad840
r8 0x0
r9 0x7f28633ad840
r10 0x8
r11 0x246
r12 0x556f543c63f0
r13 0x0
r14 0x556f5136c3ac
r15 0x0
rip 0x7f2865dfff47
rflags 0x246
cs 0x33
fs 0x0
gs 0x0
root@h2868180:~#
root@h2868180:~# cat /proc/sys/kernel/threads-max
3090194
Current count
2524
I had the html5 version running once, when I switched from 18.04 to 16.04 problem is, that docker is not supported when installing Ubuntu 16.04 so greenlight wasn't working well, I was able to install greenlight with rubyOnRails and without the docker once and the whole thing worked but only for a short time (tried to open some ports and everything went down from there it lost the rails version etc). So the server is technically able to host BBB.
@PeerConradi provided me with ssh access, so I could have a look into it:
bash: fork: retry: Resource temporarily unavailable
. executing any commands fail most of the time.ulimit
didn't resolve the problemreboot
anymore, I had to kill some random process first.Seems like it isn't a direct issue of BBB / bbb-docker. maybe ubuntu 18.04 (which is used here) has some wired settings? can you imagine reinstalling it with debian 10? (more modern and approved to work with bbb-docker?)
Would still be nice to understand the issue, but currently I'm not able to do that.
So I installed Debian 10 now. Back at the same issue:
Compose ps
bbb-docker_core_1 /entrypoint.sh Up bbb-docker_coturn_1 docker-entrypoint.sh Up --ext ... bbb-docker_etherpad_1 /entrypoint.sh Up 9001/tcp bbb- /bin/sh -c Up docker_freeswitch_1 /entrypoint.sh bbb-docker_html5_1 /entrypoint.sh Up bbb- /entrypoint.sh Up 0.0.0.0:443->443/tcpdocker_https_proxy_1 /usr/local/ ... , 0.0.0.0:80->80/tcpbbb-docker_kurento_1 /entrypoint.sh Up (healthy) bbb-docker_mongodb_1 docker-entrypoint.sh Up 27017/tcp mongod bbb-docker_nginx_1 /docker-entrypoint.sh Up 0.0.0.0:8080->80/tcp ngin ... bbb-docker_periodic_1 /entrypoint.sh Up bbb-docker_postgres_1 docker-entrypoint.sh Up 5432/tcp postgres bbb-docker_redis_1 docker-entrypoint.sh Up 127.0.0.1:6379->6379 redis ... /tcp bbb-docker_webrtc- ./docker- Up 127.0.0.1:3008->3008sfu_1 entrypoint.sh npm ... /tcp greenlight bin/start Up 10.7.7.1:5000->80/tcp
curl http://localhost:8080/bigbluebutton/api
<html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
<hr><center>nginx/1.19.1</center>
</body>
</html>
curl http://10.7.7.2:8090/bigbluebutton/api
curl: (7) Failed to connect to 10.7.7.2 port 8090: Verbindungsaufbau abgelehnt
root@h2868180:~/bbb-docker# docker exec -it bbb-docker_core_1 bash -c 'ulimit -a
>
> '
core file size (blocks, -c) unlimited
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 1545097
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1048576
pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited ```
root@h2868180:~/bbb-docker# ./scripts/compose logs core | grep bbb-web
core_1 | 2020-07-21 11:28:57,064 INFO spawned: 'bbb-web' with pid 34
core_1 | 2020-07-21 11:28:58,065 INFO success: bbb-web entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
core_1 | bbb-web | 11:29:00,588 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
core_1 | bbb-web | 11:29:00,588 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
core_1 | bbb-web | 11:29:00,588 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [file:/usr/share/bbb-web/WEB-INF/classes/logback.xml]
core_1 | bbb-web | 11:29:00,700 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set core_1 | bbb-web | 11:29:00,702 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] core_1 | bbb-web | 11:29:00,718 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] core_1 | bbb-web | 11:29:00,817 |-WARN in ch.qos.logback.core.ConsoleAppender[STDOUT] - This appender no longer admits a layout as a sub-component, set an encoder instead. core_1 | bbb-web | 11:29:00,817 |-WARN in ch.qos.logback.core.ConsoleAppender[STDOUT] - To ensure compatibility, wrapping your layout in LayoutWrappingEncoder. core_1 | bbb-web | 11:29:00,817 |-WARN in ch.qos.logback.core.ConsoleAppender[STDOUT] - See also http://logback.qos.ch/codes.html#layoutInsteadOfEncoder for details core_1 | bbb-web | 11:29:00,818 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] core_1 | bbb-web | 11:29:00,823 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE] core_1 | bbb-web | 11:29:00,839 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@953742666 - No compression will be used core_1 | bbb-web | 11:29:00,852 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@953742666 - Will use the pattern /var/log/bigbluebutton/bbb-web.%d{yyyy-MM-dd}.log for the active file
core_1 | bbb-web | 11:29:00,859 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - The date pattern is 'yyyy-MM-dd' from file name pattern '/var/log/bigbluebutton/bbb-web.%d{yyyy-MM-dd}.log'.
core_1 | bbb-web | 11:29:00,859 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Roll-over at midnight.
core_1 | bbb-web | 11:29:00,866 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Setting initial period to Tue Jul 21 11:19:19 UTC 2020
core_1 | bbb-web | 11:29:00,870 |-WARN in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - This appender no longer admits a layout as a sub-component, set an encoder instead.
core_1 | bbb-web | 11:29:00,870 |-WARN in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - To ensure compatibility, wrapping your layout in LayoutWrappingEncoder.
core_1 | bbb-web | 11:29:00,870 |-WARN in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - See also http://logback.qos.ch/codes.html#layoutInsteadOfEncoder for details
core_1 | bbb-web | 11:29:00,872 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - Active log file name: logs/bbb-web.log
core_1 | bbb-web | 11:29:00,872 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[FILE] - File property is set to [logs/bbb-web.log]
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [akka] to INFO
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [io.lettuce] to INFO
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.bigbluebutton] to DEBUG
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [grails.app.controllers] to DEBUG
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [grails.app.services] to DEBUG
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.grails.web.servlet] to ERROR
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.grails.web.pages] to ERROR
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.grails.web.sitemesh] to ERRORcore_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.grails.web.mapping.filter] to ERROR
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.grails.web.mapping] to ERROR
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.grails.commons] to ERROR
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.springframework] to ERROR
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to ERROR
core_1 | bbb-web | 11:29:00,875 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
core_1 | bbb-web | 11:29:00,876 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
core_1 | bbb-web | 11:29:00,876 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
core_1 | bbb-web | 11:29:00,876 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@49e53c76 - Registering current configuration as safe fallback point
core_1 | bbb-web |
core_1 | bbb-web | 2020-07-21T11:29:05.454Z INFO org.bigbluebutton.web.Application - Starting Application on 1877b9d3f2b9 with PID 57 (/usr/share/bbb-web/WEB-INF/classes started by bigbluebutton in /usr/share/bbb-web)
core_1 | bbb-web | 2020-07-21T11:29:05.493Z DEBUG org.bigbluebutton.web.Application - Running with Spring Boot v1.5.18.RELEASE, Spring v4.3.21.RELEASE
core_1 | bbb-web | 2020-07-21T11:29:05.495Z INFO org.bigbluebutton.web.Application - The following profiles are active: production
core_1 | bbb-web | 2020-07-21T11:29:12.767Z ERROR o.s.boot.SpringApplication - Application startup failed
core_1 | bbb-web | org.springframework.context.ApplicationContextException: Unable to start embedded container; nested exception is java.lang.OutOfMemoryError: unable to create new native thread
core_1 | bbb-web | at org.springframework.boot.context.embedded.EmbeddedWebApplicationContext.onRefresh(EmbeddedWebApplicationContext.java:139)
core_1 | bbb-web | at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:537)
core_1 | bbb-web | at org.springframework.boot.context.embedded.EmbeddedWebApplicationContext.refresh(EmbeddedWebApplicationContext.java:124)
core_1 | bbb-web | at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:693)
core_1 | bbb-web | at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:360)
core_1 | bbb-web | at org.springframework.boot.SpringApplication.run(SpringApplication.java:303)
core_1 | bbb-web | at grails.boot.GrailsApp.run(GrailsApp.groovy:84)
core_1 | bbb-web | at grails.boot.GrailsApp.run(GrailsApp.groovy:393)
core_1 | bbb-web | at grails.boot.GrailsApp.run(GrailsApp.groovy:380)
core_1 | bbb-web | at grails.boot.GrailsApp$run.call(Unknown Source)
core_1 | bbb-web | at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)
core_1 | bbb-web | at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116)
core_1 | bbb-web | at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:136)
core_1 | bbb-web | at org.bigbluebutton.web.Application.main(Application.groovy:8)
core_1 | bbb-web | at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
core_1 | bbb-web | at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
core_1 | bbb-web | at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
core_1 | bbb-web | at java.lang.reflect.Method.invoke(Method.java:498)
core_1 | bbb-web | at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
core_1 | bbb-web | at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
core_1 | bbb-web | at org.springframework.boot.loader.Launcher.launch(Launcher.java:50)
core_1 | bbb-web | at org.springframework.boot.loader.WarLauncher.main(WarLauncher.java:59)
core_1 | bbb-web | Caused by: java.lang.OutOfMemoryError: unable to create new native thread
core_1 | bbb-web | at java.lang.Thread.start0(Native Method)
core_1 | bbb-web | at java.lang.Thread.start(Thread.java:717)
core_1 | bbb-web | at java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:957)
core_1 | bbb-web | at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1367)
core_1 | bbb-web | at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
core_1 | bbb-web | at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:935)
core_1 | bbb-web | at org.apache.catalina.core.StandardEngine.startInternal(StandardEngine.java:262)
core_1 | bbb-web | at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
core_1 | bbb-web | at org.apache.catalina.core.StandardService.startInternal(StandardService.java:422)
core_1 | bbb-web | at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
core_1 | bbb-web | at org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:793)
core_1 | bbb-web | at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
core_1 | bbb-web | at org.apache.catalina.startup.Tomcat.start(Tomcat.java:366)
core_1 | bbb-web | at org.springframework.boot.context.embedded.tomcat.TomcatEmbeddedServletContainer.initialize(TomcatEmbeddedServletContainer.java:114)
core_1 | bbb-web | at org.springframework.boot.context.embedded.tomcat.TomcatEmbeddedServletContainer.
I already restarted the server and Docker. Maybe it's my server at this point I don't know :D
I had exactly the same problem.
My Server was behind a NAT so I had to add to the server the public ip address to the same interface.
see https://github.com/alangecker/bigbluebutton-docker/blob/v2.2.x/docs/behind-nat.md
I had the same problem. domain.net/bigbluebutton/api is not accessible. I tracked this down into the core docker. If I ran:
docker exec -it bbb-docker_core_1 /bin/bash
netstat -plnt | grep LISTEN
Port 8090 wasn't in use (the port nginx forwards to).
After switching from branch v2.2.x to v2.2.22 and then to v2.2.24 and running the "./scripts/upgrade" script the problem disappeared. I am still not sure what caused this as I ran into this problem a few times with a clean ubuntu 16.04 installation
Thanks @devluz . That also did the trick for me.
I had the same problem. domain.net/bigbluebutton/api is not accessible. I tracked this down into the core docker. If I ran:
docker exec -it bbb-docker_core_1 /bin/bash netstat -plnt | grep LISTEN
Port 8090 wasn't in use (the port nginx forwards to).
After switching from branch v2.2.x to v2.2.22 and then to v2.2.24 and running the "./scripts/upgrade" script the problem disappeared. I am still not sure what caused this as I ran into this problem a few times with a clean ubuntu 16.04 installation
I had the same problem and port 8090 wasn't in use in bb-docker_core. Switching to v2.2.24 branch and running "./scripts/upgrade" fixed the problem. Host OS: Centos 8
I can also confirm that v2.2.24
fixes the problem.
@goekce, @mghadam, @jwijffels and @devluz
the v2.2.24 changes got now merged to the "master" branch v2.2.x
including all other changes up to v2.2.26, it should work again with this branch ;)
/bbb-docker# curl http://localhost:8080/bigbluebutton/api
docker run --rm --env-file .env bigbluebutton/greenlight:v2 bundle exec rake conf:check
rake aborted!
ArgumentError: Missing secret_key_base
for 'production' environment, set this string with rails credentials:edit
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/railties-5.2.4.4/lib/rails/application.rb:585:in validate_secret_key_base' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/railties-5.2.4.4/lib/rails/application.rb:432:in
secret_key_base'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/railties-5.2.4.4/lib/rails/application.rb:176:in key_generator' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/railties-5.2.4.4/lib/rails/application.rb:205:in
message_verifier'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/activestorage-5.2.4.4/lib/active_storage/engine.rb:81:in block (2 levels) in <class:Engine>' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:69:in
block in execute_hook'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:62:in with_execution_control' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:67:in
execute_hook'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:52:in block in run_load_hooks' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:51:in
each'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.4.4/lib/active_support/lazy_load_hooks.rb:51:in run_load_hooks' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/railties-5.2.4.4/lib/rails/application/finisher.rb:75:in
block in instance_exec' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/railties-5.2.4.4/lib/rails/initializable.rb:32:in
run'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/railties-5.2.4.4/lib/rails/initializable.rb:61:in block in run_initializers' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/railties-5.2.4.4/lib/rails/initializable.rb:60:in
run_initializers'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/railties-5.2.4.4/lib/rails/application.rb:361:in initialize!' /usr/src/app/config/environment.rb:23:in
<top (required)>'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/bootsnap-1.4.6/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:23:in require' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/bootsnap-1.4.6/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:23:in
block in require_with_bootsnap_lfi'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/bootsnap-1.4.6/lib/bootsnap/load_path_cache/loaded_features_index.rb:92:in register' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/bootsnap-1.4.6/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:22:in
require_with_bootsnap_lfi'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/bootsnap-1.4.6/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:31:in require' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.4.4/lib/active_support/dependencies.rb:291:in
block in require'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.4.4/lib/active_support/dependencies.rb:257:in load_dependency' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/activesupport-5.2.4.4/lib/active_support/dependencies.rb:291:in
require'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/railties-5.2.4.4/lib/rails/application.rb:337:in require_environment!' /usr/src/app/vendor/bundle/ruby/2.5.0/gems/railties-5.2.4.4/lib/rails/application.rb:520:in
block in run_tasks_blocks'
/usr/src/app/vendor/bundle/ruby/2.5.0/gems/rake-13.0.1/exe/rake:27:in <top (required)>' /usr/local/bin/bundle:23:in
load'
/usr/local/bin/bundle:23:in `
I think this is the same as #18 but the answer:
"It was a DNS Mapping error" was not very helpful. I have a clean Ubuntu 18.04 and just followed the tutorial (haven't changed the secrets) and ran into this error.
then I made a decompose changed the secrets inside the .env file and made another compose, same issue.