tteck / Proxmox

Proxmox VE Helper-Scripts
https://Helper-Scripts.com
MIT License
14.31k stars 2.34k forks source link

Update for Paperless NGX is not functioning anymore #2925

Closed pafade89 closed 6 months ago

pafade89 commented 6 months ago

Please verify that you have read and understood the guidelines.

yes

A clear and concise description of the issue.

The update function of the script for paperless-ngx is no longer working.

✓ Stopped Paperless-ngx ✓ paperless-task-queue.service Exists. ✓ Updated to v2.8.1 ✓ Cleaned ✓ Started Paperless-ngx ✓ Updated Successfully!

but still:

image

Changes of paperless-ngx

What settings are you currently utilizing?

Default Settings

Which Linux distribution are you employing?

Debian 12

If relevant, including screenshots or a code block can be helpful in clarifying the issue.

No response

Please provide detailed steps to reproduce the issue.

No response

tteck commented 6 months ago

Seems to work here

    ____                        __                                     
   / __ \____ _____  ___  _____/ /__  __________    ____  ____ __  __
  / /_/ / __ `/ __ \/ _ \/ ___/ / _ \/ ___/ ___/___/ __ \/ __ `/ |/_/
 / ____/ /_/ / /_/ /  __/ /  / /  __(__  |__  )___/ / / / /_/ />  <  
/_/    \__,_/ .___/\___/_/  /_/\___/____/____/   /_/ /_/\__, /_/|_|  
           /_/                                         /____/        

 ✓ Stopped Paperless-ngx
 ✓ paperless-task-queue.service Exists.
 ✓ Updated to v2.8.1
 ✓ Cleaned
 ✓ Started Paperless-ngx
 ✓ Updated Successfully!

root@paperless-ngx:~# 

Screenshot 2024-05-07 6 55 55 AM

Will wait to see if more reports come in.

tteck commented 6 months ago

Browser cache?

satienza commented 6 months ago

Mine throws an error, leave files in the current folder and, after reboot, there are migrations pending.

Captura de pantalla 2024-05-07 a las 13 37 01 Captura de pantalla 2024-05-07 a las 13 37 34

tteck commented 6 months ago

A completely different issue. But, it shows that it did update to the latest version.

pafade89 commented 6 months ago

Browser cache?

Unfortunately not, did I remember it.

mwckr commented 6 months ago

I do have the same error: grafik

When i try the update, paperless-ngx is not reachable anymore. When I reboot the LXC, paperless is-ngx online, but still on the old version: grafik

My documents are still there, but my dashboard is not loading: grafik

Updates before this worked fine on the same LXC.

tteck commented 6 months ago

Try running this snippet in the LXC console

cd /opt/paperless/src
/usr/bin/python3 manage.py migrate
mwckr commented 6 months ago

No luck:

root@paperless-ngx:~# cd /opt/paperless/src
/usr/bin/python3 manage.py migrate
Operations to perform:
  Apply all migrations: account, admin, auditlog, auth, authtoken, contenttypes, django_celery_results, documents, guardian, paperless, paperless_mail, sessions, socialaccount
Running migrations:
  Applying auditlog.0015_alter_logentry_changes...Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 87, in _execute
    return self.cursor.execute(sql)
           ^^^^^^^^^^^^^^^^^^^^^^^^
psycopg2.errors.FeatureNotSupported: conversion between UTF8 and SQL_ASCII is not supported

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/opt/paperless/src/manage.py", line 10, in <module>
    execute_from_command_line(sys.argv)
  File "/usr/local/lib/python3.11/dist-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
    utility.execute()
  File "/usr/local/lib/python3.11/dist-packages/django/core/management/__init__.py", line 436, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/usr/local/lib/python3.11/dist-packages/django/core/management/base.py", line 412, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/usr/local/lib/python3.11/dist-packages/django/core/management/base.py", line 458, in execute
    output = self.handle(*args, **options)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/core/management/base.py", line 106, in wrapper
    res = handle_func(*args, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/core/management/commands/migrate.py", line 356, in handle
    post_migrate_state = executor.migrate(
                         ^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/migrations/executor.py", line 135, in migrate
    state = self._migrate_all_forwards(
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/migrations/executor.py", line 167, in _migrate_all_forwards
    state = self.apply_migration(
            ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/migrations/executor.py", line 252, in apply_migration
    state = migration.apply(state, schema_editor)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/migrations/migration.py", line 132, in apply
    operation.database_forwards(
  File "/usr/local/lib/python3.11/dist-packages/django/db/migrations/operations/fields.py", line 235, in database_forwards
    schema_editor.alter_field(from_model, from_field, to_field)
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/base/schema.py", line 831, in alter_field
    self._alter_field(
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/postgresql/schema.py", line 288, in _alter_field
    super()._alter_field(
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/base/schema.py", line 1056, in _alter_field
    self.execute(
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/postgresql/schema.py", line 48, in execute
    return super().execute(sql, None)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/base/schema.py", line 201, in execute
    cursor.execute(sql, params)
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 67, in execute
    return self._execute_with_wrappers(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
    return executor(sql, params, many, context)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 84, in _execute
    with self.db.wrap_database_errors:
  File "/usr/local/lib/python3.11/dist-packages/django/db/utils.py", line 91, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 87, in _execute
    return self.cursor.execute(sql)
           ^^^^^^^^^^^^^^^^^^^^^^^^
django.db.utils.NotSupportedError: conversion between UTF8 and SQL_ASCII is not supported
tteck commented 6 months ago

django.db.utils.NotSupportedError: conversion between UTF8 and SQL_ASCII is not supported

You'll have to Google that one to find a fix.

mwckr commented 6 months ago

django.db.utils.NotSupportedError: conversion between UTF8 and SQL_ASCII is not supported

You'll have to Google that one to find a fix.

If it's not related I can do that. But the update is still failing, unfortunately. Same error, same issues present.

tteck commented 6 months ago

Still not the issue that @pafade89 is facing.

tteck commented 6 months ago

@mwckr seems this was resolved with new installs: https://github.com/tteck/Proxmox/commit/47b581ee38eca2f6952fb5d5e58843a9f5cbdbc5

mwckr commented 6 months ago

@mwckr seems this was resolved with new installs: 47b581e

Okay, so I have to re-install paperless? I'd rather not do that.

Still not the issue that @pafade89 is facing.

I can open a separate issue if you prefer.

Either way, I appreciate the hard work with these scripts, helping the community and the quick replies.

tteck commented 6 months ago

Maybe ask @alxvlkr how they converted their DB https://github.com/paperless-ngx/paperless-ngx/issues/5837#issuecomment-1956012586

Or Google "convert your PostgreSQL database to UTF-8 encoding"

I'm sure you can find a closed issue that pertains to your problem, please leave a comment on that issue instead of creating a new one.

lenne0815 commented 6 months ago

Facing exactly the same error as @mwckr :( installed Paperless last week for the first time.

tteck commented 6 months ago

installed Paperless last week for the first time.

via SSH or Proxmox GUI?

lenne0815 commented 6 months ago

Proxmox gui i suppose, I used the pve console to run the script.

epcos71 commented 6 months ago

same issue here. After using the script for update from 2.7.2 to 2.8.1, script ends with succesful update, but when updating the ui (incl. clearing of the cache), version is still 2.7.2, but update option from paperless is no longer available. Update via proxmox console.

emillassen commented 6 months ago

Same issue as @mwckr and @lenne0815 here; I did a clean install yesterday, so definitely not working with the latest script. I installed the LXC through the Proxmox GUI.

tteck commented 6 months ago

Guess we can start here https://github.com/tteck/Proxmox/commit/b950a06b5f1ef01e4500589502c708e3aa9b794e with cleaning up some code and making the update verbose so it's easier to see what is going on.

pafade89 commented 6 months ago

Here the result:

Stopping all Paperless-ngx Services
 ✓ Stopped all Paperless-ngx Services
Updating to v2.8.1
--2024-05-07 17:51:18--  https://github.com/paperless-ngx/paperless-ngx/releases/download/v2.8.1/paperless-ngx-v2.8.1.tar.xz
Resolving github.com (github.com)... 140.82.121.4
Connecting to github.com (github.com)|140.82.121.4|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/458648791/7537390c-4034-4d82-85e3-378b3f39403c?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240507%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240507T155118Z&X-Amz-Expires=300&X-Amz-Signature=ef397424a17658ba077a86a55591f33aeb4cd9e8b5c1f3df6a4989524d747e2c&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=458648791&response-content-disposition=attachment%3B%20filename%3Dpaperless-ngx-v2.8.1.tar.xz&response-content-type=application%2Foctet-stream [following]
--2024-05-07 17:51:18--  https://objects.githubusercontent.com/github-production-release-asset-2e65be/458648791/7537390c-4034-4d82-85e3-378b3f39403c?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240507%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240507T155118Z&X-Amz-Expires=300&X-Amz-Signature=ef397424a17658ba077a86a55591f33aeb4cd9e8b5c1f3df6a4989524d747e2c&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=458648791&response-content-disposition=attachment%3B%20filename%3Dpaperless-ngx-v2.8.1.tar.xz&response-content-type=application%2Foctet-stream
Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.108.133, 185.199.109.133, 185.199.110.133, ...
Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.108.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 30149344 (29M) [application/octet-stream]
Saving to: 'paperless-ngx-v2.8.1.tar.xz'

paperless-ngx-v2.8.1.tar.xz             100%[===============================================================================>]  28.75M  12.5MB/s    in 2.3s    

2024-05-07 17:51:21 (12.5 MB/s) - 'paperless-ngx-v2.8.1.tar.xz' saved [30149344/30149344]

Looking in indexes: https://pypi.python.org/simple
Ignoring exceptiongroup: markers 'python_version < "3.11"' don't match your environment
Ignoring typing-extensions: markers 'python_version < "3.11"' don't match your environment
Requirement already satisfied: amqp==5.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 2)) (5.2.0)
Requirement already satisfied: anyio==4.3.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 3)) (4.3.0)
Requirement already satisfied: asgiref==3.8.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 4)) (3.8.1)
Requirement already satisfied: async-timeout==4.0.3 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 5)) (4.0.3)
Requirement already satisfied: billiard==4.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 6)) (4.2.0)
Requirement already satisfied: bleach==6.1.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 7)) (6.1.0)
Requirement already satisfied: brotli==1.1.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 8)) (1.1.0)
Requirement already satisfied: celery==5.4.0 in /usr/local/lib/python3.11/dist-packages (from celery[redis]==5.4.0->-r requirements.txt (line 9)) (5.4.0)
Requirement already satisfied: certifi==2024.2.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 10)) (2024.2.2)
Requirement already satisfied: cffi==1.16.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 11)) (1.16.0)
Requirement already satisfied: channels==4.1.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 12)) (4.1.0)
Requirement already satisfied: channels-redis==4.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 13)) (4.2.0)
Requirement already satisfied: chardet==5.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 14)) (5.2.0)
Requirement already satisfied: charset-normalizer==3.3.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 15)) (3.3.2)
Requirement already satisfied: click==8.1.7 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 16)) (8.1.7)
Requirement already satisfied: click-didyoumean==0.3.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 17)) (0.3.1)
Requirement already satisfied: click-plugins==1.1.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 18)) (1.1.1)
Requirement already satisfied: click-repl==0.3.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 19)) (0.3.0)
Requirement already satisfied: concurrent-log-handler==0.9.25 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 20)) (0.9.25)
Requirement already satisfied: cryptography==42.0.5 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 21)) (42.0.5)
Requirement already satisfied: dateparser==1.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 22)) (1.2.0)
Requirement already satisfied: deprecated==1.2.14 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 23)) (1.2.14)
Requirement already satisfied: deprecation==2.1.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 24)) (2.1.0)
Requirement already satisfied: django==4.2.11 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 25)) (4.2.11)
Requirement already satisfied: django-allauth==0.62.1 in /usr/local/lib/python3.11/dist-packages (from django-allauth[socialaccount]==0.62.1->-r requirements.txt (line 26)) (0.62.1)
Requirement already satisfied: django-auditlog==3.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 27)) (3.0.0)
Requirement already satisfied: django-celery-results==2.5.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 28)) (2.5.1)
Requirement already satisfied: django-compression-middleware==0.5.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 29)) (0.5.0)
Requirement already satisfied: django-cors-headers==4.3.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 30)) (4.3.1)
Requirement already satisfied: django-extensions==3.2.3 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 31)) (3.2.3)
Requirement already satisfied: django-filter==24.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 32)) (24.2)
Requirement already satisfied: django-guardian==2.4.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 33)) (2.4.0)
Requirement already satisfied: django-multiselectfield==0.1.12 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 34)) (0.1.12)
Requirement already satisfied: djangorestframework==3.14.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 35)) (3.14.0)
Requirement already satisfied: djangorestframework-guardian==0.3.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 36)) (0.3.0)
Requirement already satisfied: drf-writable-nested==0.7.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 37)) (0.7.0)
Requirement already satisfied: filelock==3.14.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 39)) (3.14.0)
Requirement already satisfied: flower==2.0.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 40)) (2.0.1)
Requirement already satisfied: gotenberg-client==0.5.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 41)) (0.5.0)
Requirement already satisfied: gunicorn==22.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 42)) (22.0.0)
Requirement already satisfied: h11==0.14.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 43)) (0.14.0)
Requirement already satisfied: h2==4.1.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 44)) (4.1.0)
Requirement already satisfied: hiredis==2.3.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 45)) (2.3.2)
Requirement already satisfied: hpack==4.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 46)) (4.0.0)
Requirement already satisfied: httpcore==1.0.5 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 47)) (1.0.5)
Requirement already satisfied: httptools==0.6.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 48)) (0.6.1)
Requirement already satisfied: httpx==0.27.0 in /usr/local/lib/python3.11/dist-packages (from httpx[http2]==0.27.0->-r requirements.txt (line 49)) (0.27.0)
Requirement already satisfied: humanize==4.9.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 50)) (4.9.0)
Requirement already satisfied: hyperframe==6.0.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 51)) (6.0.1)
Requirement already satisfied: idna==3.7 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 52)) (3.7)
Requirement already satisfied: imap-tools==1.6.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 53)) (1.6.0)
Requirement already satisfied: img2pdf==0.5.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 54)) (0.5.1)
Requirement already satisfied: inotify-simple==1.3.5 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 55)) (1.3.5)
Requirement already satisfied: inotifyrecursive==0.3.5 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 56)) (0.3.5)
Requirement already satisfied: joblib==1.4.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 57)) (1.4.2)
Requirement already satisfied: kombu==5.3.7 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 58)) (5.3.7)
Requirement already satisfied: langdetect==1.0.9 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 59)) (1.0.9)
Requirement already satisfied: lxml==5.2.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 60)) (5.2.1)
Requirement already satisfied: markdown-it-py==3.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 61)) (3.0.0)
Requirement already satisfied: mdurl==0.1.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 62)) (0.1.2)
Requirement already satisfied: msgpack==1.0.8 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 63)) (1.0.8)
Requirement already satisfied: mysqlclient==2.2.4 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 64)) (2.2.4)
Requirement already satisfied: nltk==3.8.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 65)) (3.8.1)
Requirement already satisfied: numpy==1.26.4 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 66)) (1.26.4)
Requirement already satisfied: oauthlib==3.2.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 67)) (3.2.2)
Requirement already satisfied: ocrmypdf==15.4.4 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 68)) (15.4.4)
Requirement already satisfied: packaging==24.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 69)) (24.0)
Requirement already satisfied: pathvalidate==3.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 70)) (3.2.0)
Requirement already satisfied: pdf2image==1.17.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 71)) (1.17.0)
Requirement already satisfied: pdfminer.six==20231228 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 72)) (20231228)
Requirement already satisfied: pikepdf==8.15.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 73)) (8.15.1)
Requirement already satisfied: pillow==10.3.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 74)) (10.3.0)
Requirement already satisfied: pluggy==1.5.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 75)) (1.5.0)
Requirement already satisfied: portalocker==2.8.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 76)) (2.8.2)
Requirement already satisfied: prometheus-client==0.20.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 77)) (0.20.0)
Requirement already satisfied: prompt-toolkit==3.0.43 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 78)) (3.0.43)
Requirement already satisfied: psycopg2==2.9.9 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 79)) (2.9.9)
Requirement already satisfied: pycparser==2.22 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 80)) (2.22)
Requirement already satisfied: pygments==2.18.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 81)) (2.18.0)
Requirement already satisfied: pyjwt==2.8.0 in /usr/local/lib/python3.11/dist-packages (from pyjwt[crypto]==2.8.0->-r requirements.txt (line 82)) (2.8.0)
Requirement already satisfied: python-dateutil==2.9.0.post0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 83)) (2.9.0.post0)
Requirement already satisfied: python-dotenv==1.0.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 84)) (1.0.1)
Requirement already satisfied: python-gnupg==0.5.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 85)) (0.5.2)
Requirement already satisfied: python-ipware==3.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 86)) (3.0.0)
Requirement already satisfied: python-magic==0.4.27 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 87)) (0.4.27)
Requirement already satisfied: pytz==2024.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 88)) (2024.1)
Requirement already satisfied: pyyaml==6.0.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 89)) (6.0.1)
Requirement already satisfied: pyzbar==0.1.9 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 90)) (0.1.9)
Requirement already satisfied: rapidfuzz==3.9.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 91)) (3.9.0)
Requirement already satisfied: redis==5.0.4 in /usr/local/lib/python3.11/dist-packages (from redis[hiredis]==5.0.4->-r requirements.txt (line 92)) (5.0.4)
Requirement already satisfied: regex==2024.4.28 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 93)) (2024.4.28)
Requirement already satisfied: reportlab==4.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 94)) (4.2.0)
Requirement already satisfied: requests==2.31.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 95)) (2.31.0)
Requirement already satisfied: requests-oauthlib==2.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 96)) (2.0.0)
Requirement already satisfied: rich==13.7.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 97)) (13.7.1)
Requirement already satisfied: scikit-learn==1.4.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 98)) (1.4.2)
Requirement already satisfied: scipy==1.13.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 99)) (1.13.0)
Requirement already satisfied: setproctitle==1.3.3 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 100)) (1.3.3)
Requirement already satisfied: six==1.16.0 in /usr/lib/python3/dist-packages (from -r requirements.txt (line 101)) (1.16.0)
Requirement already satisfied: sniffio==1.3.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 102)) (1.3.1)
Requirement already satisfied: sqlparse==0.5.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 103)) (0.5.0)
Requirement already satisfied: threadpoolctl==3.5.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 104)) (3.5.0)
Requirement already satisfied: tika-client==0.5.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 105)) (0.5.0)
Requirement already satisfied: tornado==6.4 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 106)) (6.4)
Requirement already satisfied: tqdm==4.66.4 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 107)) (4.66.4)
Requirement already satisfied: tzdata==2024.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 109)) (2024.1)
Requirement already satisfied: tzlocal==5.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 110)) (5.2)
Requirement already satisfied: urllib3==2.2.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 111)) (2.2.1)
Requirement already satisfied: uvicorn==0.25.0 in /usr/local/lib/python3.11/dist-packages (from uvicorn[standard]==0.25.0->-r requirements.txt (line 112)) (0.25.0)
Requirement already satisfied: uvloop==0.19.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 113)) (0.19.0)
Requirement already satisfied: vine==5.1.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 114)) (5.1.0)
Requirement already satisfied: watchdog==4.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 115)) (4.0.0)
Requirement already satisfied: watchfiles==0.21.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 116)) (0.21.0)
Requirement already satisfied: wcwidth==0.2.13 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 117)) (0.2.13)
Requirement already satisfied: webencodings==0.5.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 118)) (0.5.1)
Requirement already satisfied: websockets==12.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 119)) (12.0)
Requirement already satisfied: whitenoise==6.6.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 120)) (6.6.0)
Requirement already satisfied: whoosh==2.7.4 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 121)) (2.7.4)
Requirement already satisfied: wrapt==1.16.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 122)) (1.16.0)
Requirement already satisfied: zstandard==0.22.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 123)) (0.22.0)
Requirement already satisfied: zxing-cpp==2.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 124)) (2.2.0)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

[notice] A new release of pip is available: 23.3.1 -> 24.0
[notice] To update, run: python3 -m pip install --upgrade pip
Operations to perform:
  Apply all migrations: account, admin, auditlog, auth, authtoken, contenttypes, django_celery_results, documents, guardian, paperless, paperless_mail, sessions, socialaccount
Running migrations:
  No migrations to apply.
 ✓ Updated to v2.8.1
Cleaning up
 ✓ Cleaned
Starting all Paperless-ngx Services
 ✓ Started all Paperless-ngx Services
 ✓ Updated Successfully!
lenne0815 commented 6 months ago

Result: ( Everything else is fine)

File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 84, in _execute with self.db.wrap_database_errors: File "/usr/local/lib/python3.11/dist-packages/django/db/utils.py", line 91, in exit raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 87, in _execute return self.cursor.execute(sql) ^^^^^^^^^^^^^^^^^^^^^^^^ django.db.utils.NotSupportedError: conversion between UTF8 and SQL_ASCII is not supported

[ERROR] in line 82: exit code 0: while executing command /usr/bin/python3 manage.py migrate

root@paperless-ngx:/opt/paperless/src#

Is this a language thing ? My paperless frontend is German.

tteck commented 6 months ago

Removed migrate as a test https://github.com/tteck/Proxmox/commit/3e6c0944fbec08c0e2cc3047d555bc20b0066719

pafade89 commented 6 months ago

Next one:

Stopping all Paperless-ngx Services
 ✓ Stopped all Paperless-ngx Services
Updating to v2.8.1
--2024-05-07 18:29:04--  https://github.com/paperless-ngx/paperless-ngx/releases/download/v2.8.1/paperless-ngx-v2.8.1.tar.xz
Resolving github.com (github.com)... 140.82.121.4
Connecting to github.com (github.com)|140.82.121.4|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/458648791/7537390c-4034-4d82-85e3-378b3f39403c?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240507%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240507T162904Z&X-Amz-Expires=300&X-Amz-Signature=274505e4530214da48badcd5ed9018b8c45ee472eceedf9643d5f441205afcc5&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=458648791&response-content-disposition=attachment%3B%20filename%3Dpaperless-ngx-v2.8.1.tar.xz&response-content-type=application%2Foctet-stream [following]
--2024-05-07 18:29:04--  https://objects.githubusercontent.com/github-production-release-asset-2e65be/458648791/7537390c-4034-4d82-85e3-378b3f39403c?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240507%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240507T162904Z&X-Amz-Expires=300&X-Amz-Signature=274505e4530214da48badcd5ed9018b8c45ee472eceedf9643d5f441205afcc5&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=458648791&response-content-disposition=attachment%3B%20filename%3Dpaperless-ngx-v2.8.1.tar.xz&response-content-type=application%2Foctet-stream
Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.108.133, 185.199.109.133, ...
Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 30149344 (29M) [application/octet-stream]
Saving to: 'paperless-ngx-v2.8.1.tar.xz'

paperless-ngx-v2.8.1.tar.xz             100%[===============================================================================>]  28.75M  12.5MB/s    in 2.3s    

2024-05-07 18:29:07 (12.5 MB/s) - 'paperless-ngx-v2.8.1.tar.xz' saved [30149344/30149344]

Looking in indexes: https://pypi.python.org/simple
Ignoring exceptiongroup: markers 'python_version < "3.11"' don't match your environment
Ignoring typing-extensions: markers 'python_version < "3.11"' don't match your environment
Requirement already satisfied: amqp==5.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 2)) (5.2.0)
Requirement already satisfied: anyio==4.3.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 3)) (4.3.0)
Requirement already satisfied: asgiref==3.8.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 4)) (3.8.1)
Requirement already satisfied: async-timeout==4.0.3 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 5)) (4.0.3)
Requirement already satisfied: billiard==4.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 6)) (4.2.0)
Requirement already satisfied: bleach==6.1.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 7)) (6.1.0)
Requirement already satisfied: brotli==1.1.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 8)) (1.1.0)
Requirement already satisfied: celery==5.4.0 in /usr/local/lib/python3.11/dist-packages (from celery[redis]==5.4.0->-r requirements.txt (line 9)) (5.4.0)
Requirement already satisfied: certifi==2024.2.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 10)) (2024.2.2)
Requirement already satisfied: cffi==1.16.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 11)) (1.16.0)
Requirement already satisfied: channels==4.1.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 12)) (4.1.0)
Requirement already satisfied: channels-redis==4.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 13)) (4.2.0)
Requirement already satisfied: chardet==5.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 14)) (5.2.0)
Requirement already satisfied: charset-normalizer==3.3.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 15)) (3.3.2)
Requirement already satisfied: click==8.1.7 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 16)) (8.1.7)
Requirement already satisfied: click-didyoumean==0.3.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 17)) (0.3.1)
Requirement already satisfied: click-plugins==1.1.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 18)) (1.1.1)
Requirement already satisfied: click-repl==0.3.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 19)) (0.3.0)
Requirement already satisfied: concurrent-log-handler==0.9.25 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 20)) (0.9.25)
Requirement already satisfied: cryptography==42.0.5 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 21)) (42.0.5)
Requirement already satisfied: dateparser==1.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 22)) (1.2.0)
Requirement already satisfied: deprecated==1.2.14 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 23)) (1.2.14)
Requirement already satisfied: deprecation==2.1.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 24)) (2.1.0)
Requirement already satisfied: django==4.2.11 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 25)) (4.2.11)
Requirement already satisfied: django-allauth==0.62.1 in /usr/local/lib/python3.11/dist-packages (from django-allauth[socialaccount]==0.62.1->-r requirements.txt (line 26)) (0.62.1)
Requirement already satisfied: django-auditlog==3.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 27)) (3.0.0)
Requirement already satisfied: django-celery-results==2.5.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 28)) (2.5.1)
Requirement already satisfied: django-compression-middleware==0.5.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 29)) (0.5.0)
Requirement already satisfied: django-cors-headers==4.3.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 30)) (4.3.1)
Requirement already satisfied: django-extensions==3.2.3 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 31)) (3.2.3)
Requirement already satisfied: django-filter==24.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 32)) (24.2)
Requirement already satisfied: django-guardian==2.4.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 33)) (2.4.0)
Requirement already satisfied: django-multiselectfield==0.1.12 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 34)) (0.1.12)
Requirement already satisfied: djangorestframework==3.14.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 35)) (3.14.0)
Requirement already satisfied: djangorestframework-guardian==0.3.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 36)) (0.3.0)
Requirement already satisfied: drf-writable-nested==0.7.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 37)) (0.7.0)
Requirement already satisfied: filelock==3.14.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 39)) (3.14.0)
Requirement already satisfied: flower==2.0.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 40)) (2.0.1)
Requirement already satisfied: gotenberg-client==0.5.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 41)) (0.5.0)
Requirement already satisfied: gunicorn==22.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 42)) (22.0.0)
Requirement already satisfied: h11==0.14.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 43)) (0.14.0)
Requirement already satisfied: h2==4.1.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 44)) (4.1.0)
Requirement already satisfied: hiredis==2.3.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 45)) (2.3.2)
Requirement already satisfied: hpack==4.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 46)) (4.0.0)
Requirement already satisfied: httpcore==1.0.5 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 47)) (1.0.5)
Requirement already satisfied: httptools==0.6.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 48)) (0.6.1)
Requirement already satisfied: httpx==0.27.0 in /usr/local/lib/python3.11/dist-packages (from httpx[http2]==0.27.0->-r requirements.txt (line 49)) (0.27.0)
Requirement already satisfied: humanize==4.9.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 50)) (4.9.0)
Requirement already satisfied: hyperframe==6.0.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 51)) (6.0.1)
Requirement already satisfied: idna==3.7 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 52)) (3.7)
Requirement already satisfied: imap-tools==1.6.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 53)) (1.6.0)
Requirement already satisfied: img2pdf==0.5.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 54)) (0.5.1)
Requirement already satisfied: inotify-simple==1.3.5 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 55)) (1.3.5)
Requirement already satisfied: inotifyrecursive==0.3.5 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 56)) (0.3.5)
Requirement already satisfied: joblib==1.4.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 57)) (1.4.2)
Requirement already satisfied: kombu==5.3.7 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 58)) (5.3.7)
Requirement already satisfied: langdetect==1.0.9 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 59)) (1.0.9)
Requirement already satisfied: lxml==5.2.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 60)) (5.2.1)
Requirement already satisfied: markdown-it-py==3.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 61)) (3.0.0)
Requirement already satisfied: mdurl==0.1.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 62)) (0.1.2)
Requirement already satisfied: msgpack==1.0.8 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 63)) (1.0.8)
Requirement already satisfied: mysqlclient==2.2.4 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 64)) (2.2.4)
Requirement already satisfied: nltk==3.8.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 65)) (3.8.1)
Requirement already satisfied: numpy==1.26.4 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 66)) (1.26.4)
Requirement already satisfied: oauthlib==3.2.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 67)) (3.2.2)
Requirement already satisfied: ocrmypdf==15.4.4 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 68)) (15.4.4)
Requirement already satisfied: packaging==24.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 69)) (24.0)
Requirement already satisfied: pathvalidate==3.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 70)) (3.2.0)
Requirement already satisfied: pdf2image==1.17.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 71)) (1.17.0)
Requirement already satisfied: pdfminer.six==20231228 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 72)) (20231228)
Requirement already satisfied: pikepdf==8.15.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 73)) (8.15.1)
Requirement already satisfied: pillow==10.3.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 74)) (10.3.0)
Requirement already satisfied: pluggy==1.5.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 75)) (1.5.0)
Requirement already satisfied: portalocker==2.8.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 76)) (2.8.2)
Requirement already satisfied: prometheus-client==0.20.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 77)) (0.20.0)
Requirement already satisfied: prompt-toolkit==3.0.43 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 78)) (3.0.43)
Requirement already satisfied: psycopg2==2.9.9 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 79)) (2.9.9)
Requirement already satisfied: pycparser==2.22 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 80)) (2.22)
Requirement already satisfied: pygments==2.18.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 81)) (2.18.0)
Requirement already satisfied: pyjwt==2.8.0 in /usr/local/lib/python3.11/dist-packages (from pyjwt[crypto]==2.8.0->-r requirements.txt (line 82)) (2.8.0)
Requirement already satisfied: python-dateutil==2.9.0.post0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 83)) (2.9.0.post0)
Requirement already satisfied: python-dotenv==1.0.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 84)) (1.0.1)
Requirement already satisfied: python-gnupg==0.5.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 85)) (0.5.2)
Requirement already satisfied: python-ipware==3.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 86)) (3.0.0)
Requirement already satisfied: python-magic==0.4.27 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 87)) (0.4.27)
Requirement already satisfied: pytz==2024.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 88)) (2024.1)
Requirement already satisfied: pyyaml==6.0.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 89)) (6.0.1)
Requirement already satisfied: pyzbar==0.1.9 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 90)) (0.1.9)
Requirement already satisfied: rapidfuzz==3.9.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 91)) (3.9.0)
Requirement already satisfied: redis==5.0.4 in /usr/local/lib/python3.11/dist-packages (from redis[hiredis]==5.0.4->-r requirements.txt (line 92)) (5.0.4)
Requirement already satisfied: regex==2024.4.28 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 93)) (2024.4.28)
Requirement already satisfied: reportlab==4.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 94)) (4.2.0)
Requirement already satisfied: requests==2.31.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 95)) (2.31.0)
Requirement already satisfied: requests-oauthlib==2.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 96)) (2.0.0)
Requirement already satisfied: rich==13.7.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 97)) (13.7.1)
Requirement already satisfied: scikit-learn==1.4.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 98)) (1.4.2)
Requirement already satisfied: scipy==1.13.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 99)) (1.13.0)
Requirement already satisfied: setproctitle==1.3.3 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 100)) (1.3.3)
Requirement already satisfied: six==1.16.0 in /usr/lib/python3/dist-packages (from -r requirements.txt (line 101)) (1.16.0)
Requirement already satisfied: sniffio==1.3.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 102)) (1.3.1)
Requirement already satisfied: sqlparse==0.5.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 103)) (0.5.0)
Requirement already satisfied: threadpoolctl==3.5.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 104)) (3.5.0)
Requirement already satisfied: tika-client==0.5.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 105)) (0.5.0)
Requirement already satisfied: tornado==6.4 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 106)) (6.4)
Requirement already satisfied: tqdm==4.66.4 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 107)) (4.66.4)
Requirement already satisfied: tzdata==2024.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 109)) (2024.1)
Requirement already satisfied: tzlocal==5.2 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 110)) (5.2)
Requirement already satisfied: urllib3==2.2.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 111)) (2.2.1)
Requirement already satisfied: uvicorn==0.25.0 in /usr/local/lib/python3.11/dist-packages (from uvicorn[standard]==0.25.0->-r requirements.txt (line 112)) (0.25.0)
Requirement already satisfied: uvloop==0.19.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 113)) (0.19.0)
Requirement already satisfied: vine==5.1.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 114)) (5.1.0)
Requirement already satisfied: watchdog==4.0.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 115)) (4.0.0)
Requirement already satisfied: watchfiles==0.21.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 116)) (0.21.0)
Requirement already satisfied: wcwidth==0.2.13 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 117)) (0.2.13)
Requirement already satisfied: webencodings==0.5.1 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 118)) (0.5.1)
Requirement already satisfied: websockets==12.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 119)) (12.0)
Requirement already satisfied: whitenoise==6.6.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 120)) (6.6.0)
Requirement already satisfied: whoosh==2.7.4 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 121)) (2.7.4)
Requirement already satisfied: wrapt==1.16.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 122)) (1.16.0)
Requirement already satisfied: zstandard==0.22.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 123)) (0.22.0)
Requirement already satisfied: zxing-cpp==2.2.0 in /usr/local/lib/python3.11/dist-packages (from -r requirements.txt (line 124)) (2.2.0)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

[notice] A new release of pip is available: 23.3.1 -> 24.0
[notice] To update, run: python3 -m pip install --upgrade pip
 ✓ Updated to v2.8.1
Cleaning up
 ✓ Cleaned
Starting all Paperless-ngx Services
 ✓ Started all Paperless-ngx Services
 ✓ Updated Successfully!
tteck commented 6 months ago

Apply all migrations: account, admin, auditlog, auth, authtoken, contenttypes, django_celery_results, documents, guardian, paperless, paperless_mail, sessions, socialaccount Running migrations: No migrations to apply.

migrate was commented out, caching...

lenne0815 commented 6 months ago

Removed migrate as a test 3e6c094

This ran through successfully but left 3 Migrations pending, the dashboard non functional and weirdly the bottom left version indicator still says 2.7.2, system status shows 2.8.1 now though.

pafade89 commented 6 months ago

Apply all migrations: account, admin, auditlog, auth, authtoken, contenttypes, django_celery_results, documents, guardian, paperless, paperless_mail, sessions, socialaccount Running migrations: No migrations to apply.

migrate was commented out, caching...

Sorry. I still had it in the clipboard, I've updated the log above now.

tteck commented 6 months ago

Fixed for future installs https://github.com/tteck/Proxmox/commit/afd070a691460afeb2f0e31f835f1551a1585fe6

tteck commented 6 months ago

So, the solutions are as follows

  1. convert your PostgreSQL database to UTF8 encoding (Google)
  2. Create a new Paperless-ngx LXC

Sorry for any inconvenience.

epcos71 commented 6 months ago

I ran the script for update again, system version in menu is still 2.7.2, system status environment says it is 2.8.1 BUT all the the new functionality of 2.8.1 (e.g. views that can be customized) is not available. It is still 2.7.2 functionality, so I think update still does not work. btw. thanks for your support :)

pafade89 commented 6 months ago

Same here as @epcos71 and get the following answer at paperless:

https://github.com/paperless-ngx/paperless-ngx/issues/6618

tteck commented 6 months ago

I'm thinking it's all DB related. So, with the proposed solutions, I'm closing this issue for now.

jusicgn commented 6 months ago

@tteck I also had problems updating from 2.7.2 to 2.8.1. Then I read this issue and as I was still in testing phase I completely removed my 2.7.2 LCX and recreated a new one with you script. It installed 2.7.2 but updated smothly via the script inside the LXC. But when trying to add any documents I always get this error: The following error occurred while storing document ABC-31012311089914.pdf after parsing: conversion between UTF8 and SQL_ASCII is not supported Any ideas?

tteck commented 6 months ago

recreated a new one with you script. It installed 2.7.2 but updated smothly via the script inside the LXC.

Impossible the script installed 2.7.2 if you just now created a new LXC

jusicgn commented 6 months ago

OK thx. Maybe I had the old script cached anywhere. Trashing the LXC an try again. Will report.

kwiat commented 6 months ago

Built a fresh LXC with Advanced mode and selected Debian 12 instead of 11 and ended up with the the newest version of paperless 2.8.1 automatically. @jusicgn For me, "parsing: conversion between UTF8 and SQL_ASCII is not supported" errors appear with certain PDFs (of which I have many) but not with others. Might actually be an issue with the PDF files instead.

pafade89 commented 6 months ago

Built a fresh LXC with Advanced mode and selected Debian 12 instead of 11 and ended up with the the newest version of paperless 2.8.1 automatically. @jusicgn For me, "parsing: conversion between UTF8 and SQL_ASCII is not supported" errors appear with certain PDFs (of which I have many) but not with others. Might actually be an issue with the PDF files instead.

@tteck

Same for me. Paperless-ngx do not support utf8:

The following error occurred while storing document 20240508_123441_000570.pdf after parsing: conversion between UTF8 and SQL_ASCII is not supported
LINE 1: ...'2024-02-17 20240508_123441_000570', NULL, 0, '', '{"notes":...
jusicgn commented 6 months ago

OK folks, just had the time to dig a little deeper into this:

@tteck in fact the install went straight to 2.8.1 even the first time. But: your script offers the update to 2.8.2 anyway. This was why I thought it installed 2.7.2 first. Maybe the version check of the script needs a little love here ;)

@kwiat and @pafade89 I found this https://www.bytehero.io/posts/paperless-postgres-encoding-error/paperless-postgres-encoding-error/ tutorial and gave it a shot. I had to adapt the commands a little but it turned out that you can convert the db to utf8 and the the same documents are consumed without any errors.

@tteck maybe your script could create the db as utf8 in the first place to avoid that hussle for new installs?

tteck commented 6 months ago

maybe your script could create the db as utf8 in the first place to avoid that hussle for new installs?

@jusicgn https://github.com/tteck/Proxmox/issues/2925#issuecomment-2098887872

tteck commented 6 months ago

Maybe the version check of the script needs a little love here ;)

@jusicgn the script uses the below command to check the latest version

wget -q https://github.com/paperless-ngx/paperless-ngx/releases/latest -O - | grep "title>Release" | cut -d " " -f 5

as of right now is outputs v2.8.2

https://github.com/tteck/Proxmox/blob/0a392dc70ae4b0b337e7a03617d0385d31728c83/install/paperless-ngx-install.sh#L77

jusicgn commented 6 months ago

maybe your script could create the db as utf8 in the first place to avoid that hussle for new installs?

@jusicgn #2925 (comment)

Yeah, I also understood your post like it should do that and as mentioned did a completed new install but it seems to have created the db as SQL_ASCII instead. So I searched for a solution as I thought i misunderstood this post somehow.

After following the conversion tutorial in my post the problem with the complete new install is gone for me.

jusicgn commented 6 months ago

as of right now is outputs v2.8.2

My fault. I didn't see it's offering 2.8.2 after installing 2.8.1 and not the same version. Sorry for that confusion.

tteck commented 6 months ago

@jusicgn would you create a new LXC to test this https://github.com/tteck/Proxmox/commit/c13b868ddaf4ac13a589c6176bd383a0fa2c3aed change

jusicgn commented 6 months ago

@tteck sure thing, that's the minimum to support your effort here 🥇

Advanced install with Debian 12 worked like a charm. No hack of the db needed anymore 👍 👍

Installed Version 2.8.2 right away. But script still offers to update to 2.8.2 and performs the update when selected 🤷‍♂️

If I exit the script I get this error:

[ERROR] in line 66: exit code 0: while executing command UPD=$(whiptail --backtitle "Proxmox VE Helper Scripts" --title "SUPPORT" --radiolist --cancel-button Exit-Script "Spacebar = Select" 11 58 2 "1" "Update Paperless-ngx to $RELEASE" ON "2" "Paperless-ngx Credentials" OFF 3>&1 1>&2 2>&3)
tteck commented 6 months ago

But script still offers to update to 2.8.2 and performs the update when selected

It doesn't have a check against current version yet. Should never interrupt an update, even though it doesn't need it. It may break the application.

tteck commented 6 months ago

@jusicgn I added a version check. https://github.com/tteck/Proxmox/commit/5204ad7e16cd9c7cbed5850e89a04ea8e52c07cb

Edit: only works with a fresh install, or after a new update process

jusicgn commented 6 months ago

@tteck

Should never interrupt an update, even though it doesn't need it. It may break the application.

Didn't interrupt the update, just hit esc in the dialog after triggering the script again to see if it still offers the update ;)

@jusicgn I added a version check. https://github.com/tteck/Proxmox/commit/5204ad7e16cd9c7cbed5850e89a04ea8e52c07cb

Edit: only works with a fresh install, or after a new update process

Will do another install and report back.

tteck commented 6 months ago

Oops I forgot a key component https://github.com/tteck/Proxmox/commit/ef4d18f8705a22d1b8f2e8152bd5b4a2b60cfc5b

tteck commented 6 months ago
    ____                        __                                     
   / __ \____ _____  ___  _____/ /__  __________    ____  ____ __  __
  / /_/ / __ `/ __ \/ _ \/ ___/ / _ \/ ___/ ___/___/ __ \/ __ `/ |/_/
 / ____/ /_/ / /_/ /  __/ /  / /  __(__  |__  )___/ / / / /_/ />  <  
/_/    \__,_/ .___/\___/_/  /_/\___/____/____/   /_/ /_/\__, /_/|_|  
           /_/                                         /____/        

 ✓ No update required. Paperless-ngx is already at v2.8.2
root@paperless-ngx:~# 
jusicgn commented 6 months ago

Seems to work perfectly 👍