search

OpenDroneMap / WebODM

User-friendly, commercial-grade software for processing aerial imagery. 🛩
https://www.opendronemap.org/webodm/
GNU Affero General Public License v3.0
2.83k stars 944 forks source link

WARNING Session data corrupted #1326

Closed ichsan2895 closed 1 year ago

ichsan2895 commented 1 year ago

How did you install WebODM (docker, installer, etc.)? With Docker

$ docker --version
Docker version 20.10.8, build 3967b7d

What's your browser and operating system? Opera 78 on Linux

What is the problem? WARNING Session data corrupted

How can we reproduce this? (What steps trigger the problem? What parameters are you using for processing?

This is happen after I updated to newest WebODM

# download newest git then extracted it to a folder named "WebODM-master"
$ cd WebODM-master

# update WebODM with GPU supports
$ ./webodm.sh update --gpu
01:00.0 3D controller: NVIDIA Corporation GP108M [GeForce MX150] (rev a1)
GPU_NVIDIA has been found
Checking for docker...   OK
Checking for docker-compose...  OK
docker-compose -f docker-compose.yml -f docker-compose.nodeodm.gpu.nvidia.yml -f docker-compose.nodemicmac.yml down --remove-orphans
Removing webapp                   ... done
Removing worker                   ... done
Removing webodm-master_node-odm_1 ... done
Removing db                       ... done
Removing broker                   ... done
Removing network webodm-master_default
Updating WebODM...
Skipping source update (.git directory not found)
docker-compose -f docker-compose.yml -f docker-compose.nodeodm.gpu.nvidia.yml pull
Pulling broker   ... done
Pulling db       ... done
Pulling worker   ... done
Pulling node-odm ... done
Pulling webapp   ... done
Done! You can now start WebODM by running ./webodm.sh start

# start it with GPU
$ ./webodm.sh start --gpu
01:00.0 3D controller: NVIDIA Corporation GP108M [GeForce MX150] (rev a1)
GPU_NVIDIA has been found
Checking for docker...   OK
Checking for docker-compose...  OK
Starting WebODM...

Using the following environment:
================================
Host: localhost
Port: 8000
Media directory: appmedia
Postgres DB directory: dbdata
SSL: NO
SSL key: 
SSL certificate: 
SSL insecure port redirect: 80
Celery Broker: redis://broker
Default Nodes: 1
================================
Make sure to issue a ./webodm.sh down if you decide to change the environment.

docker-compose -f docker-compose.yml -f docker-compose.nodeodm.gpu.nvidia.yml up --scale node-odm=1
Creating broker                   ... done
Creating db                       ... done
Creating webodm-master_node-odm_1 ... done
Creating worker                   ... done
Creating webapp                   ... done
Attaching to broker, db, webodm-master_node-odm_1, worker, webapp
broker      | 1:C 15 Apr 2023 00:37:12.930 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
broker      | 1:C 15 Apr 2023 00:37:12.930 # Redis version=7.0.10, bits=64, commit=00000000, modified=0, pid=1, just started
broker      | 1:C 15 Apr 2023 00:37:12.930 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
db          | 
db          | PostgreSQL Database directory appears to contain a database; Skipping initialization
db          | 
db          | LOG:  database system was shut down at 2023-04-15 00:36:31 UTC
broker      | 1:M 15 Apr 2023 00:37:12.930 * monotonic clock: POSIX clock_gettime
broker      | 1:M 15 Apr 2023 00:37:12.931 * Running mode=standalone, port=6379.
db          | LOG:  MultiXact member wraparound protections are now enabled
node-odm_1  | (node:1) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023.
node-odm_1  | 
node-odm_1  | Please migrate your code to use AWS SDK for JavaScript (v3).
node-odm_1  | For more information, check the migration guide at https://a.co/7PzMCcy
node-odm_1  | (Use `node --trace-warnings ...` to show where the warning was created)
broker      | 1:M 15 Apr 2023 00:37:12.931 # Server initialized
worker      | Postgres is up - executing command
db          | LOG:  database system is ready to accept connections
db          | LOG:  autovacuum launcher started
worker      | wait-for-it.sh: waiting for broker:6379 without a timeout
worker      | wait-for-it.sh: broker:6379 is available after 0 seconds
broker      | 1:M 15 Apr 2023 00:37:12.931 # WARNING Memory overcommit must be enabled! Without it, a background save or replication may fail under low memory condition. Being disabled, it can can also cause failures without low memory condition, see https://github.com/jemalloc/jemalloc/issues/1328. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
worker      | wait-for-it.sh: waiting for webapp:8000 without a timeout
broker      | 1:M 15 Apr 2023 00:37:12.931 * Ready to accept connections
webapp      | Postgres is up - executing command
webapp      | wait-for-it.sh: waiting for broker:6379 without a timeout
webapp      | wait-for-it.sh: broker:6379 is available after 0 seconds
webapp      | 
webapp      |  _       __     __    ____  ____  __  ___
webapp      | | |     / /__  / /_  / __ \/ __ \/  |/  /
webapp      | | | /| / / _ \/ __ \/ / / / / / / /|_/ / 
webapp      | | |/ |/ /  __/ /_/ / /_/ / /_/ / /  / /  
webapp      | |__/|__/\___/_.___/\____/_____/_/  /_/   
webapp      | 
webapp      | 
webapp      | Checking python version... 3.x, good!
webapp      | Checking GDAL version... GDAL 3.2.2, released 2021/03/05, excellent!
webapp      | Running migrations
node-odm_1  | info: Authentication using NoTokenRequired
node-odm_1  | info: Listening on 0.0.0.0:6367 UDP for progress updates
node-odm_1  | info: No tasks dump found
node-odm_1  | info: Checking for orphaned directories to be removed...
node-odm_1  | info: Server has started on port 3000
webapp      | Generated secret key
webapp      | Operations to perform:
webapp      |   Apply all migrations: admin, app, auth, contenttypes, guardian, nodeodm, sessions
webapp      | Running migrations:
webapp      |   No migrations to apply.
webapp      | Checking for celery...   OK
webapp      | Scheduler is not running.
webapp      | Generating nginx configurations from templates...
webapp      | - nginx/nginx-ssl.conf
webapp      | - nginx/nginx.conf
webapp      | celery beat v4.4.0 (cliffs) is starting.
worker      | wait-for-it.sh: webapp:8000 is available after 7 seconds
worker      | Checking for celery...   OK
worker      | Starting worker using broker at redis://broker
webapp      | [2023-04-15 00:37:20 +0000] [112] [INFO] Starting gunicorn 19.7.1
webapp      | [2023-04-15 00:37:20 +0000] [112] [INFO] Listening at: unix:/tmp/gunicorn.sock (112)
webapp      | [2023-04-15 00:37:20 +0000] [112] [INFO] Using worker: sync
webapp      | /usr/lib/python3.9/os.py:1023: RuntimeWarning: line buffering (buffering=1) isn't supported in binary mode, the default buffer size will be used
webapp      |   return io.open(fd, *args, **kwargs)
webapp      | [2023-04-15 00:37:20 +0000] [147] [INFO] Booting worker with pid: 147
webapp      | [2023-04-15 00:37:20 +0000] [148] [INFO] Booting worker with pid: 148
webapp      | [2023-04-15 00:37:20 +0000] [149] [INFO] Booting worker with pid: 149
webapp      | [2023-04-15 00:37:21 +0000] [150] [INFO] Booting worker with pid: 150
webapp      | __    -    ... __   -        _
webapp      | LocalTime -> 2023-04-15 00:37:21
webapp      | Configuration ->
webapp      |     . broker -> redis://broker:6379//
webapp      |     . loader -> celery.loaders.app.AppLoader
webapp      |     . scheduler -> celery.beat.PersistentScheduler
webapp      |     . db -> celerybeat-schedule
webapp      |     . logfile -> [stderr]@%WARNING
webapp      |     . maxinterval -> 5.00 minutes (300s)
webapp      | [2023-04-15 00:37:21 +0000] [151] [INFO] Booting worker with pid: 151
webapp      | [2023-04-15 00:37:21 +0000] [152] [INFO] Booting worker with pid: 152
webapp      | [2023-04-15 00:37:21 +0000] [153] [INFO] Booting worker with pid: 153
webapp      | [2023-04-15 00:37:21 +0000] [154] [INFO] Booting worker with pid: 154
webapp      | [2023-04-15 00:37:21 +0000] [155] [INFO] Booting worker with pid: 155
webapp      | [2023-04-15 00:37:21 +0000] [156] [INFO] Booting worker with pid: 156
webapp      | [2023-04-15 00:37:21 +0000] [157] [INFO] Booting worker with pid: 157
webapp      | [2023-04-15 00:37:21 +0000] [158] [INFO] Booting worker with pid: 158
webapp      | [2023-04-15 00:37:21 +0000] [159] [INFO] Booting worker with pid: 159
webapp      | [2023-04-15 00:37:21 +0000] [160] [INFO] Booting worker with pid: 160
webapp      | [2023-04-15 00:37:21 +0000] [161] [INFO] Booting worker with pid: 161
webapp      | [2023-04-15 00:37:21 +0000] [162] [INFO] Booting worker with pid: 162
webapp      | [2023-04-15 00:37:21 +0000] [163] [INFO] Booting worker with pid: 163
worker      | /usr/local/lib/python3.9/dist-packages/celery/platforms.py:800: RuntimeWarning: You're running the worker with superuser privileges: this is
worker      | absolutely not recommended!
worker      | 
worker      | Please specify a different user using the --uid option.
worker      | 
worker      | User information: uid=0 euid=0 gid=0 egid=0
worker      | 
worker      |   warnings.warn(RuntimeWarning(ROOT_DISCOURAGED.format(
webapp      | 
webapp      | Trying to establish communication...
webapp      | INFO Booting WebODM 2.0.1
webapp      | INFO Registered [coreplugins.fullscreen.plugin]
webapp      | INFO Registered [coreplugins.diagnostic.plugin]
webapp      | INFO Registered [coreplugins.lightning.plugin]
webapp      | INFO Registered [coreplugins.posm-gcpi.plugin]
webapp      | INFO Registered [coreplugins.measure.plugin]
webapp      | INFO Registered [coreplugins.contours.plugin]
webapp      | 
webapp      | Congratulations! └@(･◡･)@┐
webapp      | ==========================
webapp      | 
webapp      | If there are no errors, WebODM should be up and running!
webapp      | 
webapp      | Open a web browser and navigate to http://localhost:8000
webapp      | 
webapp      | WARNING Session data corrupted
webapp      | WARNING Session data corrupted
webapp      | WARNING Session data corrupted
webapp      | WARNING Session data corrupted
webapp      | WARNING Session data corrupted
webapp      | WARNING Session data corrupted
webapp      | WARNING Session data corrupted

This error also happen in WebODM interface with different error message. Here it is image

Additional information

$ neofetch
MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNMMMMMMMMM   ichsan@ichsan 
MMMMMMMMMMNs..yMMMMMMMMMMMMMm: +NMMMMMMM   ------------- 
MMMMMMMMMN+    :mMMMMMMMMMNo` -dMMMMMMMM   OS: MX x86_64 
MMMMMMMMMMMs.   `oNMMMMMMh- `sNMMMMMMMMM   Host: Aspire E5-476G V1.05 
MMMMMMMMMMMMN/    -hMMMN+  :dMMMMMMMMMMM   Kernel: 5.10.0-5mx-amd64 
MMMMMMMMMMMMMMh-    +ms. .sMMMMMMMMMMMMM   Uptime: 11 hours, 9 mins 
MMMMMMMMMMMMMMMN+`   `  +NMMMMMMMMMMMMMM   Shell: bash 5.0.3 
MMMMMMMMMMMMMMNMMd:    .dMMMMMMMMMMMMMMM   Resolution: 1366x768 
MMMMMMMMMMMMm/-hMd-     `sNMMMMMMMMMMMMM   DE: Plasma 5.14.5 
MMMMMMMMMMNo`   -` :h/    -dMMMMMMMMMMMM   WM: KWin 
MMMMMMMMMd:       /NMMh-   `+NMMMMMMMMMM   Theme: Breeze [Plasma], Breeze [GTK2/3] 
MMMMMMMNo`         :mMMN+`   `-hMMMMMMMM   Icons: Papirus [Plasma], breeze [GTK2/3] 
MMMMMMh.            `oNMMd:    `/mMMMMMM   Terminal: konsole 
MMMMm/                -hMd-      `sNMMMM   CPU: Intel i5-8250U (8) @ 3.400GHz 
MMNs`                   -          :dMMM   GPU: NVIDIA GeForce MX150 
Mm:                                 `oMM   GPU: Intel UHD Graphics 620 
MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM   Memory: 11568MiB / 23930MiB

$ docker images
REPOSITORY                        TAG         IMAGE ID       CREATED         SIZE
redis                             latest      33e3db53b328   2 days ago      117MB
opendronemap/nodeodm              gpu         9f35cf88538d   8 days ago      6.07GB
opendronemap/webodm_webapp        latest      96a8bb742eee   11 days ago     1.64GB
opendronemap/webodm_db            latest      e40c0f274bba   19 months ago   695MB

$ docker ps
CONTAINER ID   IMAGE                               COMMAND                  CREATED          STATUS          PORTS                                                         NAMES
28ff90da39ae   opendronemap/webodm_webapp          "/bin/bash -c 'chmod…"   16 minutes ago   Up 16 minutes   0.0.0.0:8000->8000/tcp, :::8000->8000/tcp                     webapp
9d83804a33a2   opendronemap/webodm_webapp          "/bin/bash -c '/webo…"   16 minutes ago   Up 16 minutes                                                                 worker
bfaecc7a272a   opendronemap/nodeodm:gpu            "/usr/bin/node /var/…"   16 minutes ago   Up 16 minutes   0.0.0.0:49166->3000/tcp, :::49166->3000/tcp                   webodm-master_node-odm_1
027e3cdaf0ae   redis                               "docker-entrypoint.s…"   16 minutes ago   Up 16 minutes   6379/tcp                                                      broker
9fcfa257f65d   opendronemap/webodm_db              "docker-entrypoint.s…"   16 minutes ago   Up 16 minutes   0.0.0.0:49165->5432/tcp, :::49165->5432/tcp                   db
pierotofy commented 1 year ago

Hi @ichsan2895,

It looks like there is some information missing from your issue that will be needed in order to diagnose and fix the problem at hand. Please take a look at the Issue Template, which will tell you exactly what your issue has to contain in order to be processable.

Also, double check that this is the right place. If you are just asking for information, reporting feedback or proposing a few feature, the right place to ask is the Community Forum, not here.

I'm marking this one now as needing some more information. Please understand that if you do not provide that information within the next week (until 2023-04-15 20:55) I'll close this issue so it doesn't clutter the bug tracker.

Cheers! ~ Your friendly GitIssueBot

PS: I'm just an automated script, not a human being.

ichsan2895 commented 1 year ago

Sorry if I forget to mention something.

Regarding closed thread in https://github.com/OpenDroneMap/NodeODM/issues/202, I want to clarify:

image

Where is the menu as stated by error message? image There is no available Administration > Processing nodes menu

Also checked Processing Nodes > node-odm-1, but I don't find Object Permissions menu.

The correct one is Processing Nodes > node-odm-1 > edit > Object Permissions. image

Accept all permission but problem still exist

pierotofy commented 1 year ago

Could we move this conversation over to the forum at https://community.opendronemap.org? :pray: The forum is the right place to ask questions (we try to keep the GitHub issue tracker for feature requests and bugs only). Thank you! :+1:

ichsan2895 commented 1 year ago

Could we move this conversation over to the forum at https://community.opendronemap.org? pray The forum is the right place to ask questions (we try to keep the GitHub issue tracker for feature requests and bugs only). Thank you! +1

Great :+1: , I create this thread in there https://community.opendronemap.org/t/warning-session-data-corrupted/15573

ichsan2895 commented 1 year ago

Could we move this conversation over to the forum at https://community.opendronemap.org? pray The forum is the right place to ask questions (we try to keep the GitHub issue tracker for feature requests and bugs only). Thank you! +1

Good news Problem Solved

Here is the way to fix it

# remove all container that ODM has.
>> docker container rm -f  28ff90da39ae 9d83804a33a2 bfaecc7a272a 027e3cdaf0ae 9fcfa257f65d

# remove all images that ODM has
>> docker rmi -f 33e3db53b328 9f35cf88538d 96a8bb742eee e40c0f274bba

# redownload WebODM with github clone
>> git clone https://github.com/OpenDroneMap/WebODM

# install it again
>> cd WebODM
>> ./webodm.sh start --gpu