Open spmishra121 opened 1 year ago
Seems that latest release is not stable. Getting 500 error at so many location.
What's the stack trace you see in the logs?
I am getting below logs only.... uwsgi_1 | [pid: 31|app: -|req: -/-] 172.24.65.224 (admin) {44 vars in 985 bytes} [Wed Nov 16 10:24:01 2022] GET /system_settings => generated 145 bytes in 45 msecs (HTTP/1.1 500) 6 headers in 184 bytes (1 switches on core 0) nginx_1 | 172.24.65.224 - - [16/Nov/2022:10:24:01 +0000] "GET /system_settings HTTP/1.1" 500 145 "http://defectdojo-dev.devdlt.com:3000/critical_product_metrics" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" "-" nginx_1 | 172.24.86.3 - - [16/Nov/2022:10:24:02 +0000] "GET /alerts/count HTTP/1.1" 200 13 "http://defectdojo-dev.devdlt.com:3000/dashboard" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" "-" uwsgi_1 | [pid: 31|app: -|req: -/-] 172.24.86.3 (admin) {44 vars in 828 bytes} [Wed Nov 16 10:24:02 2022] GET /alerts/count => generated 13 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 171 bytes (1 switches on core 1) nginx_1 | 172.24.86.3 - - [16/Nov/2022:10:24:12 +0000] "GET /alerts/count HTTP/1.1" 200 13 "http://defectdojo-dev.devdlt.com:3000/dashboard" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" "-" uwsgi_1 | [pid: 1|app: -|req: -/-] 172.24.86.3 (admin) {44 vars in 828 bytes} [Wed Nov 16 10:24:12 2022] GET /alerts/count => generated 13 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 171 bytes (1 switches on core 1)
@Maffooch @valentijnscholten Any suggestion on this? I am also getting same error while deleting the engagement also.
docker-compose log while clicking on regulation:
nginx_1 | 172.24.69.12 - - [23/Nov/2022:09:54:57 +0000] "GET /system_settings HTTP/1.1" 500 145 "http://defectdojo-dev.devdlt.com:3000/regulations" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" "-"
uwsgi_1 | [pid: 32|app: -|req: -/-] 172.24.69.12 (admin) {44 vars in 971 bytes} [Wed Nov 23 09:54:57 2022] GET /system_settings => generated 145 bytes in 40 msecs (HTTP/1.1 500) 6 headers in 184 bytes (1 switches on core 0)
nginx_1 | 172.24.69.12 - - [23/Nov/2022:09:55:00 +0000] "GET /alerts/count HTTP/1.1" 200 14 "http://defectdojo-dev.devdlt.com:3000/product" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" "-"
uwsgi_1 | [pid: 1|app: -|req: -/-] 172.24.69.12 (admin) {44 vars in 833 bytes} [Wed Nov 23 09:55:00 2022] GET /alerts/count => generated 14 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 171 bytes (1 switches on core 1)
nginx_1 | 172.24.86.2 - - [23/Nov/2022:09:55:04 +0000] "GET /alerts/count HTTP/1.1" 200 14 "http://defectdojo-dev.devdlt.com:3000/engagement/81/delete" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36" "-"
uwsgi_1 | [pid: 1|app: -|req: -/-] 172.24.86.2 (admin) {44 vars in 839 bytes} [Wed Nov 23 09:55:04 2022] GET /alerts/count => generated 14 bytes in 10 msecs (HTTP/1.1 200) 6 headers in 171 bytes (1 switches on core 0)
celerybeat_1 | [23/Nov/2022 09:55:08] INFO [celery.beat:285] Scheduler: Sending due task dedupe-delete (dojo.tasks.async_dupe_delete)
celerybeat_1 | [23/Nov/2022 09:55:08] ERROR [celery.beat:289] Message Error: Couldn't apply scheduled task dedupe-delete: Invalid SQLite URL: sqlite://guest:guest@/dojo.celerydb.sqlite
celerybeat_1 | Valid SQLite URL forms are:
celerybeat_1 | sqlite:///:memory: (or, sqlite://)
celerybeat_1 | sqlite:///relative/path/to/file.db
celerybeat_1 | sqlite:////absolute/path/to/file.db
celerybeat_1 | [' File "/usr/local/bin/celery", line 8, in
From those logs, it looks like your celery is misconfigured or not working. I'd validate you're setting the DDCELERY[something] environment variables for celery correctly based on:
celerybeat_1 | celery.beat.SchedulingError: Couldn't apply scheduled task dedupe-delete: Invalid SQLite URL: sqlite://guest:guest@/dojo.celerydb.sqlite celerybeat_1 | Valid SQLite URL forms are: celerybeat_1 | sqlite:///:memory: (or, sqlite://) celerybeat_1 | sqlite:///relative/path/to/file.db celerybeat_1 | sqlite:////absolute/path/to/file.db
I'd look at those at https://github.com/DefectDojo/django-DefectDojo/blob/master/dojo/settings/settings.dist.py#L55 and make sure they match your environment. With compose, you could be running RabbitMQ or Redis so maybe try something like:
For rabbitmq DD_CELERY_BROKER_URL="amqp://rabbitmq:5672//" Or for redis: DD_CELERY_BROKER_URL="redis://redis:6379/0"
In the key parts of your docker-compose for uwsgi, celery beat, celery worker and initializer e.g. https://github.com/DefectDojo/django-DefectDojo/blob/master/docker-compose.yml#L56
@mtesauro, Thanks for addressing the issue. But, why is this happening while it was working fine for 2.13 and if I am updating the DD as per latest version all required setting should be placed as per requirement?
Before from latest release, everything was working as expected.
Docker-compose file we are using:
version: '3.7' services: nginx: build: context: ./ dockerfile: Dockerfile.nginx image: "defectdojo/defectdojo-nginx:${NGINX_VERSION:-latest}" depends_on:
@spmishra121 Quickly glancing over your docker-compose, I don't see DD_CELERY_BROKER_URL anywhere in there.
I've only used DD_CELERY_BROKER_URL so don't have any experience with upgrades and using the user/password versions of the DD_CELERY_X env variables.
FWIW, "URL-izing" connection strings was part of "12 Factoring" DefectDojo years ago - see https://12factor.net/backing-services
Having the same issue, we've set DD_CELERY_BROKER_URL to redis://redis_endpoint_address:6379/0
Redis server is operational and I can see connections from DefectDojo containers to it
I had updated defect dojo with latest release 2.16. Before this I was using 2.XX. Now, If I am clicking on system settings, I am getting 500 error while in previous one, it was working as expected.
Steps: Installed DD using docker-compose file. Login into the application. Click on Configuration>>System Settings
Output: Server Error (500)