search

cvat-ai / cvat

Annotate better with CVAT, the industry-leading data engine for machine learning. Used and trusted by teams at any scale, for data of any scale.
https://cvat.ai
MIT License
12.48k stars 2.99k forks source link

Import 3.8G project dataset always failed with internal server error 500 #6044

Closed shaojun closed 1 year ago

shaojun commented 1 year ago

My actions before raising this issue

Steps to Reproduce (for bugs)

I have a project dataset exported with size 3.8G (full of kitti format object detection annotations) from my old cvat server:

Server version: 1.7 Core version: 3.17.0 Canvas version: 2.8.0 UI version: 1.25.0

and now I want import it into my new cvat server:

Server version: 2.5 Core version: 9.0.1 Canvas version: 2.16.3 UI version: 1.50.7

I just created a project in new cvat server, select import dataset, choose the local file, the uploading can reach 50%, and then always popup exception in web say internal server error 500： image

this is the docker logs cvat_server from server side (run by docker compose up -d):

2023-05-07 03:25:16,554 WARN Failed to clean up '/home/django/logs/ssh-agent-stdout---supervisor-gayzbrkn.log' 2023-05-07 03:25:16,554 WARN Failed to clean up '/home/django/logs/runserver-stderr---supervisor-4s6jcoxn.log' 2023-05-07 03:25:16,554 WARN Failed to clean up '/home/django/logs/rqworker_export_0-stderr---supervisor-mklaxkds.log' 2023-05-07 03:25:16,555 WARN Failed to clean up '/home/django/logs/ssh-agent-stderr---supervisor-ao3ed_h7.log' 2023-05-07 03:25:16,580 INFO RPC interface 'supervisor' initialized 2023-05-07 03:25:16,580 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2023-05-07 03:25:16,580 INFO supervisord started with pid 1 2023-05-07 03:25:17,583 INFO spawned: 'ssh-agent' with pid 7 2023-05-07 03:25:17,586 INFO spawned: 'clamav_update' with pid 8 2023-05-07 03:25:17,594 INFO spawned: 'runserver' with pid 9 2023-05-07 03:25:17,671 DEBG fd 14 closed, stopped monitoring <POutputDispatcher at 140098044781760 for <Subprocess at 140098045000096 with name clamav_update in state STARTING> (stderr)> 2023-05-07 03:25:17,672 DEBG fd 10 closed, stopped monitoring <POutputDispatcher at 140098045000768 for <Subprocess at 140098045000096 with name clamav_update in state STARTING> (stdout)> 2023-05-07 03:25:17,702 DEBG 'runserver' stderr output: wait-for-it.sh: waiting for cvat_db:5432 without a timeout

2023-05-07 03:25:17,702 INFO exited: clamav_update (exit status 0; not expected) 2023-05-07 03:25:17,703 DEBG received SIGCHLD indicating a child quit 2023-05-07 03:25:17,717 DEBG 'ssh-agent' stdout output: SSH_AUTH_SOCK=/tmp/ssh-agent.sock; export SSH_AUTH_SOCK; echo Agent pid 7;

2023-05-07 03:25:17,717 DEBG 'ssh-agent' stderr output: debug2: fd 3 setting O_NONBLOCK

2023-05-07 03:25:17,733 DEBG 'runserver' stderr output: wait-for-it.sh: cvat_db:5432 is available after 0 seconds

2023-05-07 03:25:17,734 DEBG 'runserver' stderr output: bash: cannot set terminal process group (-1): Inappropriate ioctl for device bash: no job control in this shell

2023-05-07 03:25:18,735 INFO success: ssh-agent entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2023-05-07 03:25:18,737 INFO spawned: 'clamav_update' with pid 22 2023-05-07 03:25:18,738 INFO success: runserver entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2023-05-07 03:25:18,749 DEBG fd 16 closed, stopped monitoring <POutputDispatcher at 140098044781712 for <Subprocess at 140098045000096 with name clamav_update in state STARTING> (stderr)> 2023-05-07 03:25:18,752 DEBG fd 10 closed, stopped monitoring <POutputDispatcher at 140098044781904 for <Subprocess at 140098045000096 with name clamav_update in state STARTING> (stdout)> 2023-05-07 03:25:19,576 DEBG 'ssh-agent' stderr output: debug2: fd 4 setting O_NONBLOCK

2023-05-07 03:25:19,576 INFO exited: clamav_update (exit status 0; not expected) 2023-05-07 03:25:19,576 DEBG received SIGCHLD indicating a child quit 2023-05-07 03:25:19,581 DEBG 'ssh-agent' stderr output: debug2: fd 4 setting O_NONBLOCK debug1: process_message: socket 1 (fd=4) type 11

2023-05-07 03:25:19,587 DEBG 'ssh-agent' stderr output: debug2: fd 4 setting O_NONBLOCK

2023-05-07 03:25:19,589 DEBG 'ssh-agent' stderr output: debug1: process_message: socket 1 (fd=4) type 17

2023-05-07 03:25:19,592 DEBG 'ssh-agent' stderr output: debug1: process_add_identity: add ssh-rsa SHA256:pJvXpklAsuDhYAtM9+YW6DsjbpNzDkQmR13/XhCW5Kk "django@cf0ee1cad52d" (life: 0) (confirm: 0) (provider: none)

2023-05-07 03:25:19,592 DEBG 'runserver' stderr output: Identity added: /home/django/.ssh/id_rsa (django@cf0ee1cad52d)

2023-05-07 03:25:21,597 INFO spawned: 'clamav_update' with pid 28 2023-05-07 03:25:21,603 DEBG fd 10 closed, stopped monitoring <POutputDispatcher at 140098044781904 for <Subprocess at 140098045000096 with name clamav_update in state STARTING> (stdout)> 2023-05-07 03:25:21,603 DEBG fd 16 closed, stopped monitoring <POutputDispatcher at 140098044781760 for <Subprocess at 140098045000096 with name clamav_update in state STARTING> (stderr)> 2023-05-07 03:25:21,603 INFO exited: clamav_update (exit status 0; not expected) 2023-05-07 03:25:21,603 DEBG received SIGCHLD indicating a child quit 2023-05-07 03:25:24,608 INFO spawned: 'clamav_update' with pid 35 2023-05-07 03:25:24,614 DEBG fd 10 closed, stopped monitoring <POutputDispatcher at 140098044781904 for <Subprocess at 140098045000096 with name clamav_update in state STARTING> (stdout)> 2023-05-07 03:25:24,614 DEBG fd 16 closed, stopped monitoring <POutputDispatcher at 140098044781952 for <Subprocess at 140098045000096 with name clamav_update in state STARTING> (stderr)> 2023-05-07 03:25:24,614 INFO exited: clamav_update (exit status 0; not expected) 2023-05-07 03:25:24,614 DEBG received SIGCHLD indicating a child quit 2023-05-07 03:25:25,615 INFO gave up: clamav_update entered FATAL state, too many start retries too quickly 2023-05-07 03:25:55,435 DEBG 'runserver' stdout output: SSH keys were not found Copying them from keys volume Operations to perform: Apply all migrations: account, admin, auth, authtoken, contenttypes, dataset_repo, db, engine, organizations, sessions, sites, socialaccount, webhooks Running migrations: No migrations to apply.

2023-05-07 03:25:56,448 DEBG 'ssh-agent' stderr output: debug2: fd 4 setting O_NONBLOCK

2023-05-07 03:25:56,448 DEBG 'ssh-agent' stderr output: debug1: process_message: socket 1 (fd=4) type 17

2023-05-07 03:25:56,450 DEBG 'ssh-agent' stderr output: debug1: process_add_identity: add ssh-rsa SHA256:pJvXpklAsuDhYAtM9+YW6DsjbpNzDkQmR13/XhCW5Kk "django@cf0ee1cad52d" (life: 0) (confirm: 0) (provider: none)

2023-05-07 03:25:56,457 DEBG 'ssh-agent' stderr output: debug2: fd 4 setting O_NONBLOCK debug1: process_message: socket 1 (fd=4) type 11

2023-05-07 03:25:57,999 DEBG 'runserver' stdout output:

165 static files copied to '/home/django/static'.

2023-05-07 03:25:58,501 DEBG 'ssh-agent' stderr output: debug2: fd 4 setting O_NONBLOCK

2023-05-07 03:25:58,503 DEBG 'ssh-agent' stderr output: debug1: process_message: socket 1 (fd=4) type 17

2023-05-07 03:25:58,505 DEBG 'ssh-agent' stderr output: debug1: process_add_identity: add ssh-rsa SHA256:pJvXpklAsuDhYAtM9+YW6DsjbpNzDkQmR13/XhCW5Kk "django@cf0ee1cad52d" (life: 0) (confirm: 0) (provider: none)

2023-05-07 03:25:58,509 DEBG 'ssh-agent' stderr output: debug2: fd 4 setting O_NONBLOCK debug1: process_message: socket 1 (fd=4) type 11

2023-05-07 03:26:04,174 DEBG 'runserver' stdout output: Successfully ran command. Server URL : http://localhost:8080/ Server Root : /tmp/cvat-server Server Conf : /tmp/cvat-server/httpd.conf Error Log File : /dev/stderr (INFO) Operating Mode : daemon Request Capacity : 5 (1 process * 5 threads) Request Timeout : 60 (seconds) Startup Timeout : 15 (seconds) Queue Backlog : 100 (connections) Queue Timeout : 45 (seconds) Server Capacity : 20 (event/worker), 20 (prefork) Server Backlog : 500 (connections) Locale Setting : C.UTF-8

2023-05-07 03:26:04,291 DEBG 'runserver' stderr output: [Sun May 07 03:26:04.290370 2023] [wsgi:info] [pid 82:tid 140005792050240] mod_wsgi (pid=82): Starting process 'localhost:8080' with threads=5. [Sun May 07 03:26:04.290430 2023] [mpm_event:notice] [pid 9:tid 140005792050240] AH00489: Apache/2.4.41 (Ubuntu) mod_wsgi/4.9.4 Python/3.8 configured -- resuming normal operations [Sun May 07 03:26:04.290519 2023] [mpm_event:info] [pid 9:tid 140005792050240] AH00490: Server built: 2023-03-08T17:32:54 [Sun May 07 03:26:04.290526 2023] [core:notice] [pid 9:tid 140005792050240] AH00094: Command line: 'apache2 (mod_wsgi-express) -f /tmp/cvat-server/httpd.conf -D MOD_WSGI_KEEP_ALIVE -D MOD_WSGI _MPM_ENABLE_EVENT_MODULE -D MOD_WSGI_MPM_EXISTS_EVENT_MODULE -D MOD_WSGI_MPM_EXISTS_WORKER_MODULE -D MOD_WSGI_MPM_EXISTS_PREFORK_MODULE -D FOREGROUND'

2023-05-07 03:26:04,292 DEBG 'runserver' stderr output: [Sun May 07 03:26:04.292462 2023] [wsgi:info] [pid 82:tid 140005792050240] mod_wsgi (pid=82): Python home /opt/venv.

2023-05-07 03:26:04,294 DEBG 'runserver' stderr output: [Sun May 07 03:26:04.294615 2023] [wsgi:info] [pid 82:tid 140005792050240] mod_wsgi (pid=82): Initializing Python.

2023-05-07 03:26:04,351 DEBG 'runserver' stderr output: [Sun May 07 03:26:04.351291 2023] [wsgi:info] [pid 82:tid 140005792050240] mod_wsgi (pid=82): Attach interpreter ''.

2023-05-07 03:26:04,356 DEBG 'runserver' stderr output: [Sun May 07 03:26:04.356127 2023] [wsgi:info] [pid 82:tid 140005792050240] mod_wsgi (pid=82): Imported 'mod_wsgi'.

2023-05-07 03:26:04,356 DEBG 'runserver' stderr output: [Sun May 07 03:26:04.356172 2023] [wsgi:info] [pid 82:tid 140005792050240] mod_wsgi (pid=82, process='localhost:8080', application=''): Loading Python script file '/tmp/cvat-server/handler.wsg i'.

2023-05-07 03:26:04,737 DEBG 'ssh-agent' stderr output: debug2: fd 4 setting O_NONBLOCK

2023-05-07 03:26:04,739 DEBG 'ssh-agent' stderr output: debug1: process_message: socket 1 (fd=4) type 17

2023-05-07 03:26:04,740 DEBG 'ssh-agent' stderr output: debug1: process_add_identity: add ssh-rsa SHA256:pJvXpklAsuDhYAtM9+YW6DsjbpNzDkQmR13/XhCW5Kk "django@cf0ee1cad52d" (life: 0) (confirm: 0) (provider: none)

2023-05-07 03:26:04,745 DEBG 'ssh-agent' stderr output: debug2: fd 4 setting O_NONBLOCK debug1: process_message: socket 1 (fd=4) type 11

2023-05-07 03:26:05,822 DEBG 'runserver' stderr output: [Sun May 07 03:26:05.822364 2023] [wsgi:info] [pid 82:tid 140005514413824] mod_wsgi (pid=82): Application startup timer triggered 'localhost:8080'. [Sun May 07 03:26:05.822450 2023] [wsgi:info] [pid 82:tid 140005514413824] mod_wsgi (pid=82): Application startup timer cancelled 'localhost:8080'.

2023-05-07 03:26:10,519 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.518886 2023] [wsgi:error] [pid 82:tid 140005078980352] ERROR:health-check:unknown error: 500 Server Error: Internal Server Error for url: http://opa:8181/health?bundles

2023-05-07 03:26:10,519 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.519441 2023] [wsgi:error] [pid 82:tid 140005078980352] Traceback (most recent call last):

2023-05-07 03:26:10,521 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.521007 2023] [wsgi:error] [pid 82:tid 140005078980352] File "/home/django/cvat/apps/health/backends.py", line 25, in check_status

2023-05-07 03:26:10,521 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.521228 2023] [wsgi:error] [pid 82:tid 140005078980352] response.raise_for_status()

2023-05-07 03:26:10,521 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.521373 2023] [wsgi:error] [pid 82:tid 140005078980352] File "/opt/venv/lib/python3.8/site-packages/requests/models.py", line 953, in raise_for_status

2023-05-07 03:26:10,521 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.521495 2023] [wsgi:error] [pid 82:tid 140005078980352] raise HTTPError(http_error_msg, response=self)

2023-05-07 03:26:10,521 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.521614 2023] [wsgi:error] [pid 82:tid 140005078980352] requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://opa:8181/health?bundles

2023-05-07 03:26:10,521 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.521771 2023] [wsgi:error] [pid 82:tid 140005078980352]

2023-05-07 03:26:10,521 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.521901 2023] [wsgi:error] [pid 82:tid 140005078980352] During handling of the above exception, another exception occurred:

2023-05-07 03:26:10,522 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.522019 2023] [wsgi:error] [pid 82:tid 140005078980352]

2023-05-07 03:26:10,522 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.522161 2023] [wsgi:error] [pid 82:tid 140005078980352] Traceback (most recent call last):

2023-05-07 03:26:10,522 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.522321 2023] [wsgi:error] [pid 82:tid 140005078980352] File "/opt/venv/lib/python3.8/site-packages/health_check/backends.py", line 30, in run_check

2023-05-07 03:26:10,522 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.522457 2023] [wsgi:error] [pid 82:tid 140005078980352] self.check_status()

2023-05-07 03:26:10,523 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.523434 2023] [wsgi:error] [pid 82:tid 140005078980352] File "/home/django/cvat/apps/health/backends.py", line 27, in check_status [Sun May 07 03:26:10.523444 2023] [wsgi:error] [pid 82:tid 140005078980352] raise HealthCheckException(str(e)) [Sun May 07 03:26:10.523447 2023] [wsgi:error] [pid 82:tid 140005078980352] health_check.exceptions.HealthCheckException: unknown error: 500 Server Error: Internal Server Error for url: http:/ /opa:8181/health?bundles

2023-05-07 03:26:10,629 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.629895 2023] [wsgi:error] [pid 82:tid 140005514413824] [remote 192.168.144.7:57056] [2023-05-07 03:26:10,629] ERROR django.request: Internal Server Error: /api/server/heal th/

2023-05-07 03:26:10,631 DEBG 'runserver' stderr output: [Sun May 07 03:26:10.631077 2023] [wsgi:error] [pid 82:tid 140005514413824] [remote 192.168.144.7:57056] ERROR:django.request:Internal Server Error: /api/server/health/

2023-05-07 03:26:12,955 DEBG 'runserver' stderr output: [Sun May 07 03:26:12.955378 2023] [wsgi:error] [pid 82:tid 140003694692096] ERROR:health-check:unknown error: 500 Server Error: Internal Server Error for url: http://opa:8181/health?bundles

2023-05-07 03:26:12,955 DEBG 'runserver' stderr output: [Sun May 07 03:26:12.955468 2023] [wsgi:error] [pid 82:tid 140003694692096] Traceback (most recent call last):

2023-05-07 03:26:12,956 DEBG 'runserver' stderr output: [Sun May 07 03:26:12.956368 2023] [wsgi:error] [pid 82:tid 140003694692096] File "/home/django/cvat/apps/health/backends.py", line 25, in check_status [Sun May 07 03:26:12.956382 2023] [wsgi:error] [pid 82:tid 140003694692096] response.raise_for_status() [Sun May 07 03:26:12.956401 2023] [wsgi:error] [pid 82:tid 140003694692096] File "/opt/venv/lib/python3.8/site-packages/requests/models.py", line 953, in raise_for_status [Sun May 07 03:26:12.956418 2023] [wsgi:error] [pid 82:tid 140003694692096] raise HTTPError(http_error_msg, response=self)

2023-05-07 03:26:12,956 DEBG 'runserver' stderr output: [Sun May 07 03:26:12.956432 2023] [wsgi:error] [pid 82:tid 140003694692096] requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://opa:8181/health?bundles

2023-05-07 03:26:12,956 DEBG 'runserver' stderr output: [Sun May 07 03:26:12.956715 2023] [wsgi:error] [pid 82:tid 140003694692096] [Sun May 07 03:26:12.956742 2023] [wsgi:error] [pid 82:tid 140003694692096] During handling of the above exception, another exception occurred: [Sun May 07 03:26:12.956752 2023] [wsgi:error] [pid 82:tid 140003694692096]

2023-05-07 03:26:12,956 DEBG 'runserver' stderr output: [Sun May 07 03:26:12.956866 2023] [wsgi:error] [pid 82:tid 140003694692096] Traceback (most recent call last):

2023-05-07 03:26:12,957 DEBG 'runserver' stderr output: [Sun May 07 03:26:12.957422 2023] [wsgi:error] [pid 82:tid 140003694692096] File "/opt/venv/lib/python3.8/site-packages/health_check/backends.py", line 30, in run_check [Sun May 07 03:26:12.957434 2023] [wsgi:error] [pid 82:tid 140003694692096] self.check_status()

2023-05-07 03:26:12,957 DEBG 'runserver' stderr output: [Sun May 07 03:26:12.957710 2023] [wsgi:error] [pid 82:tid 140003694692096] File "/home/django/cvat/apps/health/backends.py", line 27, in check_status [Sun May 07 03:26:12.957780 2023] [wsgi:error] [pid 82:tid 140003694692096] raise HealthCheckException(str(e))

2023-05-07 03:26:12,958 DEBG 'runserver' stderr output: [Sun May 07 03:26:12.958010 2023] [wsgi:error] [pid 82:tid 140003694692096] health_check.exceptions.HealthCheckException: unknown error: 500 Server Error: Internal Server Error for url: http:/ /opa:8181/health?bundles

2023-05-07 03:26:13,028 DEBG 'runserver' stderr output: [Sun May 07 03:26:13.028139 2023] [wsgi:error] [pid 82:tid 140005264684800] [remote 192.168.144.7:57098] [2023-05-07 03:26:13,027] ERROR django.request: Internal Server Error: /api/server/heal th/

2023-05-07 03:26:13,028 DEBG 'runserver' stderr output: [Sun May 07 03:26:13.028230 2023] [wsgi:error] [pid 82:tid 140005264684800] [remote 192.168.144.7:57098] ERROR:django.request:Internal Server Error: /api/server/health/

2023-05-07 03:26:16,061 DEBG 'runserver' stderr output: [Sun May 07 03:26:16.061498 2023] [wsgi:error] [pid 82:tid 140003694692096] ERROR:health-check:unknown error: 500 Server Error: Internal Server Error for url: http://opa:8181/health?bundles [Sun May 07 03:26:16.061513 2023] [wsgi:error] [pid 82:tid 140003694692096] Traceback (most recent call last): [Sun May 07 03:26:16.061516 2023] [wsgi:error] [pid 82:tid 140003694692096] File "/home/django/cvat/apps/health/backends.py", line 25, in check_status [Sun May 07 03:26:16.061518 2023] [wsgi:error] [pid 82:tid 140003694692096] response.raise_for_status() [Sun May 07 03:26:16.061520 2023] [wsgi:error] [pid 82:tid 140003694692096] File "/opt/venv/lib/python3.8/site-packages/requests/models.py", line 953, in raise_for_status [Sun May 07 03:26:16.061522 2023] [wsgi:error] [pid 82:tid 140003694692096] raise HTTPError(http_error_msg, response=self) [Sun May 07 03:26:16.061524 2023] [wsgi:error] [pid 82:tid 140003694692096] requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://opa:8181/health?bundles [Sun May 07 03:26:16.061526 2023] [wsgi:error] [pid 82:tid 140003694692096] [Sun May 07 03:26:16.061528 2023] [wsgi:error] [pid 82:tid 140003694692096] During handling of the above exception, another exception occurred: [Sun May 07 03:26:16.061529 2023] [wsgi:error] [pid 82:tid 140003694692096] [Sun May 07 03:26:16.061532 2023] [wsgi:error] [pid 82:tid 140003694692096] Traceback (most recent call last): [Sun May 07 03:26:16.061534 2023] [wsgi:error] [pid 82:tid 140003694692096] File "/opt/venv/lib/python3.8/site-packages/health_check/backends.py", line 30, in run_check [Sun May 07 03:26:16.061536 2023] [wsgi:error] [pid 82:tid 140003694692096] self.check_status() [Sun May 07 03:26:16.061539 2023] [wsgi:error] [pid 82:tid 140003694692096] File "/home/django/cvat/apps/health/backends.py", line 27, in check_status [Sun May 07 03:26:16.061541 2023] [wsgi:error] [pid 82:tid 140003694692096] raise HealthCheckException(str(e)) [Sun May 07 03:26:16.061543 2023] [wsgi:error] [pid 82:tid 140003694692096] health_check.exceptions.HealthCheckException: unknown error: 500 Server Error: Internal Server Error for url: http:/ /opa:8181/health?bundles

2023-05-07 03:26:16,150 DEBG 'runserver' stderr output: [Sun May 07 03:26:16.150276 2023] [wsgi:error] [pid 82:tid 140005264684800] [remote 192.168.144.7:57124] [2023-05-07 03:26:16,150] ERROR django.request: Internal Server Error: /api/server/heal th/

2023-05-07 03:26:16,150 DEBG 'runserver' stderr output: [Sun May 07 03:26:16.150361 2023] [wsgi:error] [pid 82:tid 140005264684800] [remote 192.168.144.7:57124] ERROR:django.request:Internal Server Error: /api/server/health/

2023-05-07 03:26:19,677 DEBG 'runserver' stderr output: [Sun May 07 03:26:19.676962 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57172] [2023-05-07 03:26:19,676] WARNING django.request: Not Found: /api/user-agreements

2023-05-07 03:26:19,677 DEBG 'runserver' stderr output: [Sun May 07 03:26:19.677045 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57172] WARNING:django.request:Not Found: /api/user-agreements

2023-05-07 03:26:19,890 DEBG 'runserver' stderr output: [Sun May 07 03:26:19.890177 2023] [wsgi:error] [pid 82:tid 140005264684800] [remote 192.168.144.7:57172] [2023-05-07 03:26:19,890] WARNING django.request: Not Found: /api/functions/requests/

2023-05-07 03:26:19,890 DEBG 'runserver' stderr output: [Sun May 07 03:26:19.890294 2023] [wsgi:error] [pid 82:tid 140005264684800] [remote 192.168.144.7:57172] WARNING:django.request:Not Found: /api/functions/requests/

2023-05-07 03:26:26,545 DEBG 'runserver' stderr output: [Sun May 07 03:26:26.545628 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57244] [2023-05-07 03:26:26,545] WARNING django.request: Not Found: /api/projects/5/preview

2023-05-07 03:26:26,546 DEBG 'runserver' stderr output: [Sun May 07 03:26:26.546087 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57244] WARNING:django.request:Not Found: /api/projects/5/preview

2023-05-07 04:29:37,266 DEBG 'runserver' stderr output: [Sun May 07 04:29:37.265624 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] [2023-05-07 04:29:37,262] ERROR django.request: Internal Server Error: /api/projects/5/ dataset/19ba707c-25f2-4903-9a18-7c29dbfde3be [Sun May 07 04:29:37.265648 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] Traceback (most recent call last): [Sun May 07 04:29:37.265651 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/django/core/handlers/exception.py", line 47, in inner [Sun May 07 04:29:37.265654 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] response = get_response(request) [Sun May 07 04:29:37.265656 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/django/core/handlers/base.py", line 181, in _get_response [Sun May 07 04:29:37.265658 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] response = wrapped_callback(request, *callback_args, callback_kwargs) [Sun May 07 04:29:37.265660 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/django/views/decorators/csrf.py", line 54 , in wrapped_view [Sun May 07 04:29:37.265662 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] return view_func(*args, *kwargs) [Sun May 07 04:29:37.265664 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/rest_framework/viewsets.py", line 125, in view [Sun May 07 04:29:37.265666 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] return self.dispatch(request, args, kwargs) [Sun May 07 04:29:37.265668 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/rest_framework/views.py", line 509, in di spatch [Sun May 07 04:29:37.265670 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] response = self.handle_exception(exc) [Sun May 07 04:29:37.265672 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/rest_framework/views.py", line 469, in ha ndle_exception [Sun May 07 04:29:37.265674 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] self.raise_uncaught_exception(exc) [Sun May 07 04:29:37.265676 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/rest_framework/views.py", line 480, in ra ise_uncaught_exception [Sun May 07 04:29:37.265677 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] raise exc [Sun May 07 04:29:37.265679 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/rest_framework/views.py", line 506, in di spatch [Sun May 07 04:29:37.265681 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] response = handler(request, *args, **kwargs) [Sun May 07 04:29:37.265683 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/home/django/cvat/apps/engine/views.py", line 372, in append_dataset_chunk [Sun May 07 04:29:37.265685 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] return self.append_tus_chunk(request, file_id) [Sun May 07 04:29:37.265686 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/home/django/cvat/apps/engine/mixins.py", line 210, in append_tus_chunk [Sun May 07 04:29:37.265688 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] tus_file.write_chunk(chunk) [Sun May 07 04:29:37.265690 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/home/django/cvat/apps/engine/mixins.py", line 43, in write_chunk [Sun May 07 04:29:37.265692 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] self.offset = cache.incr("tus-uploads/{}/offset".format(self.file_id), chunk.size) [Sun May 07 04:29:37.265696 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/django/core/cache/backends/locmem.py", li ne 75, in incr [Sun May 07 04:29:37.265698 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] raise ValueError("Key '%s' not found" % key) [Sun May 07 04:29:37.265699 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] ValueError: Key ':1:tus-uploads/19ba707c-25f2-4903-9a18-7c29dbfde3be/offset' not found

2023-05-07 04:29:37,266 DEBG 'runserver' stderr output: [Sun May 07 04:29:37.266394 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] ERROR:django.request:Internal Server Error: /api/projects/5/dataset/19ba707c-25f2-4903- 9a18-7c29dbfde3be [Sun May 07 04:29:37.266404 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] Traceback (most recent call last): [Sun May 07 04:29:37.266407 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/django/core/handlers/exception.py", line 47, in inner [Sun May 07 04:29:37.266410 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] response = get_response(request) [Sun May 07 04:29:37.266412 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/django/core/handlers/base.py", line 181, in _get_response [Sun May 07 04:29:37.266415 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] response = wrapped_callback(request, *callback_args, callback_kwargs) [Sun May 07 04:29:37.266417 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/django/views/decorators/csrf.py", line 54 , in wrapped_view [Sun May 07 04:29:37.266420 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] return view_func(*args, *kwargs) [Sun May 07 04:29:37.266422 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/rest_framework/viewsets.py", line 125, in view [Sun May 07 04:29:37.266425 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] return self.dispatch(request, args, kwargs) [Sun May 07 04:29:37.266428 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/rest_framework/views.py", line 509, in di spatch [Sun May 07 04:29:37.266430 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] response = self.handle_exception(exc) [Sun May 07 04:29:37.266431 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/rest_framework/views.py", line 469, in ha ndle_exception [Sun May 07 04:29:37.266433 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] self.raise_uncaught_exception(exc) [Sun May 07 04:29:37.266435 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/rest_framework/views.py", line 480, in ra ise_uncaught_exception [Sun May 07 04:29:37.266437 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] raise exc [Sun May 07 04:29:37.266439 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/rest_framework/views.py", line 506, in di spatch [Sun May 07 04:29:37.266441 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] response = handler(request, *args, **kwargs) [Sun May 07 04:29:37.266443 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/home/django/cvat/apps/engine/views.py", line 372, in append_dataset_chunk [Sun May 07 04:29:37.266444 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] return self.append_tus_chunk(request, file_id) [Sun May 07 04:29:37.266446 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/home/django/cvat/apps/engine/mixins.py", line 210, in append_tus_chunk [Sun May 07 04:29:37.266448 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] tus_file.write_chunk(chunk) [Sun May 07 04:29:37.266450 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/home/django/cvat/apps/engine/mixins.py", line 43, in write_chunk [Sun May 07 04:29:37.266452 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] self.offset = cache.incr("tus-uploads/{}/offset".format(self.file_id), chunk.size) [Sun May 07 04:29:37.266455 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] File "/opt/venv/lib/python3.8/site-packages/django/core/cache/backends/locmem.py", li ne 75, in incr [Sun May 07 04:29:37.266457 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] raise ValueError("Key '%s' not found" % key) [Sun May 07 04:29:37.266459 2023] [wsgi:error] [pid 82:tid 140005273077504] [remote 192.168.144.7:57448] ValueError: Key ':1:tus-uploads/19ba707c-25f2-4903-9a18-7c29dbfde3be/offset' not found

Expected Behaviour

the import should work.

Current Behaviour

popup exception in web say internal server error 500.

Possible Solution

Context

Your Environment

bsekachev commented 1 year ago

Please, provide logs from the new server.

docker logs cvat_server.

shaojun commented 1 year ago

@bsekachev I've updated more details at original questions. pls help to take a look.

bsekachev commented 1 year ago

@klakhov Looks like issue with tus implementation. Could you please take a look?

azhavoro commented 1 year ago

@shaojun which version of CVAT are you using? In version 2.4.2 tus uploading is slightly changed and probably your issue is fixed. Please try using version >=2.4.2

shaojun commented 1 year ago

@azhavoro this is my cvat application version info:

Server version: 2.5
Core version: 9.0.1
Canvas version: 2.16.3
UI version: 1.50.7

does this indicate the version >=2.4.2 ?

azhavoro commented 1 year ago

I suppose you are using old commit from develop branch accroding to the trace, please update your CVAT images with docker compose pull or build images yourself with docker compose -f docker-compose.yml -f docker-compose.dev.yml build