search

globaleaks / globaleaks-whistleblowing-software

GlobaLeaks is a free and open-source whistleblowing software enabling anyone to easily set up and maintain a secure reporting platform.
https://www.globaleaks.org
Other
1.24k stars 274 forks source link

Onion sites rupture after upgrade #3556

Closed j3pc0m closed 1 year ago

j3pc0m commented 1 year ago

What version of GlobaLeaks are you using?

4.12.5

What browser(s) are you seeing the problem on?

Tor Browser

What operating system(s) are you seeing the problem on?

Windows

Describe the issue

The problem with Tor sites has gotten worse. Now, Tor Browser say:

Unable to connect

An error occurred during a connection to pcpieoz6gayo4vntghh7nws5ijmnea5fqemxqpct4whmd7dei5xlz2qd.onion.

The site could be temporarily unavailable or too busy. Try again in a few moments.
If you are unable to load any pages, check your computer’s network connection.
If your computer or network is protected by a firewall or proxy, make sure that Tor Browser is permitted to access the Web.

Proposed solution

No response

evilaliv3 commented 1 year ago

Thank you, we are rechecking and we will let you know our evaluations.

j3pc0m commented 1 year ago

Thanks a lot Giovanni.

De: Giovanni Pellerano @.> Enviado: martes, 25 de julio de 2023 19:52 Para: globaleaks/GlobaLeaks @.> Cc: Javier Eduardo @.>; Author @.> Asunto: Re: [globaleaks/GlobaLeaks] Onion sites rupture after upgrade (Issue #3556)

Thank you, we are rechecking and we will let you know our evaluations.

— Reply to this email directly, view it on GitHubhttps://github.com/globaleaks/GlobaLeaks/issues/3556#issuecomment-1650286144, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AMZHJHQYJZF36RR3NYPQJQTXSABXJANCNFSM6AAAAAA2WR5QJU. You are receiving this because you authored the thread.Message ID: @.***>

evilaliv3 commented 1 year ago

@j3pc0m : i've just retested on 4.12.5 and i'm actually not encountering any issue.

If it possible for you to share an exctract of the file /var/globaleaks/log/globaleaks.log?

You should look at lines like the following: 2023-07-25T20:10:52+0200 [stdout#info] [E] Successfully connected to Tor control port 2023-07-25T20:10:52+0200 [stdout#info] [E] [1] Setting up the onion service v5n76yyfw7t2jygp2sfkoow4vtoi5tnkvfwx5425f737ppbie2zdinad.onion 2023-07-25T20:10:54+0200 [stdout#info] [E] [1] Initialization of onion-service v5n76yyfw7t2jygp2sfkoow4vtoi5tnkvfwx5425f737ppbie2zdinad.onion completed.

Tor does not require open ports but it requires that you allow outbound traffic.

gabllux commented 1 year ago

Hello, I can give mine if it's useful (see #3554 for my environment on Debian 12):

2023-07-25 19:05:46+0000 [-] twistd 22.4.0 (/usr/bin/python3 3.11.2) starting up.
2023-07-25 19:05:46+0000 [-] reactor class: twisted.internet.epollreactor.EPollReactor.
2023-07-25 19:05:47+0000 [-] Starting factory <Site object at 0x7f6d49e19050>
2023-07-25 19:05:47+0000 [-] GlobaLeaks is now running and accessible at the following urls:
2023-07-25 19:05:47+0000 [-] - [HTTP]   --> http://0.0.0.0
2023-07-25 19:05:47+0000 [-] - [Tor]:   --> http://yoytylk2ujcvomgx2kadrwueg7cny5syzeiz2mq5v46clh6cfn73m5ad.onion
2023-07-25 19:05:47+0000 [-] Starting factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection.<locals>.quiescentCallback at 0x7f6d49d080e0>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7f6d49ac61d0>)
2023-07-25 19:05:47+0000 [-] [E] Successfully connected to Tor control port
2023-07-25 19:05:47+0000 [-] [E] [1] Setting up the onion service yoytylk2ujcvomgx2kadrwueg7cny5syzeiz2mq5v46clh6cfn73m5ad.onion
2023-07-25 19:05:47+0000 [-] Stopping factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection.<locals>.quiescentCallback at 0x7f6d49d080e0>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7f6d49ac61d0>)
2023-07-25 19:05:59+0000 [-] [E] [1] Initialization of onion-service yoytylk2ujcvomgx2kadrwueg7cny5syzeiz2mq5v46clh6cfn73m5ad.onion completed.
j3pc0m commented 1 year ago

Thanks for your help @evilaliv3, here you have globaleaks.log in two versions.

The next lines are in globaleaks.log (4.11.5) 2023-07-25 06:19:57+0000 [-] [E] Successfully connected to Tor control port 2023-07-25 06:19:57+0000 [-] [E] [1] Setting up the onion service pcpieoz6gayo4vntghh7nws5ijmnea5fqemxqpct4whmd7dei5xlz2qd.onion 2023-07-25 06:19:57+0000 [-] [E] [2] Setting up the onion service rczjoww4q7h5v6gz2jnaqbm7jzqieef7gw4dn3bibdmt2fmgdwtfbhyd.onion 2023-07-25 06:19:57+0000 [-] [E] [6] Setting up the onion service hfkbjizi5yd2uriafgx3iqtsamy2zllj5uzrh4azactjezfhfcnygzad.onion 2023-07-25 06:19:59+0000 [-] [E] [1] Initialization of onion-service pcpieoz6gayo4vntghh7nws5ijmnea5fqemxqpct4whmd7dei5xlz2qd.onion completed. 2023-07-25 06:20:00+0000 [-] [E] [2] Initialization of onion-service rczjoww4q7h5v6gz2jnaqbm7jzqieef7gw4dn3bibdmt2fmgdwtfbhyd.onion completed. 2023-07-25 06:20:01+0000 [-] [E] [6] Initialization of onion-service hfkbjizi5yd2uriafgx3iqtsamy2zllj5uzrh4azactjezfhfcnygzad.onion completed.

And these in globaleaks.log (4.12.5) 2023-07-25 20:23:17+0000 [-] [E] Successfully connected to Tor control port 2023-07-25 20:23:17+0000 [-] [E] [1] Setting up the onion service pcpieoz6gayo4vntghh7nws5ijmnea5fqemxqpct4whmd7dei5xlz2qd.onion 2023-07-25 20:23:17+0000 [-] [E] [2] Setting up the onion service rczjoww4q7h5v6gz2jnaqbm7jzqieef7gw4dn3bibdmt2fmgdwtfbhyd.onion 2023-07-25 20:23:17+0000 [-] [E] [6] Setting up the onion service hfkbjizi5yd2uriafgx3iqtsamy2zllj5uzrh4azactjezfhfcnygzad.onion 2023-07-25 20:23:19+0000 [-] [E] [1] Initialization of onion-service pcpieoz6gayo4vntghh7nws5ijmnea5fqemxqpct4whmd7dei5xlz2qd.onion completed. 2023-07-25 20:23:20+0000 [-] [E] [6] Initialization of onion-service hfkbjizi5yd2uriafgx3iqtsamy2zllj5uzrh4azactjezfhfcnygzad.onion completed. 2023-07-25 20:23:20+0000 [-] [E] [2] Initialization of onion-service rczjoww4q7h5v6gz2jnaqbm7jzqieef7gw4dn3bibdmt2fmgdwtfbhyd.onion completed. 2023-07-25 20:24:01+0000 [-] Exception during reset or similar 2023-07-25 20:24:01+0000 [-] Traceback (most recent call last): 2023-07-25 20:24:01+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/pool/base.py", line 680, in _finalize_fairy 2023-07-25 20:24:01+0000 [-] fairy._reset(pool) 2023-07-25 20:24:01+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/pool/base.py", line 867, in _reset 2023-07-25 20:24:01+0000 [-] pool._dialect.do_rollback(self) 2023-07-25 20:24:01+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 531, in do_rollback 2023-07-25 20:24:01+0000 [-] dbapi_connection.rollback() 2023-07-25 20:24:01+0000 [-] sqlite3.ProgrammingError: SQLite objects created in a thread can only be used in that same thread. The object was created in thread id 140422589822784 and this is thread id 140422475368192. 2023-07-25 20:24:01+0000 [-] Exception closing connection <sqlite3.Connection object at 0x7fb6a8ee84e0> 2023-07-25 20:24:01+0000 [-] Traceback (most recent call last): 2023-07-25 20:24:01+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/pool/base.py", line 680, in _finalize_fairy 2023-07-25 20:24:01+0000 [-] fairy._reset(pool) 2023-07-25 20:24:01+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/pool/base.py", line 867, in _reset 2023-07-25 20:24:01+0000 [-] pool._dialect.do_rollback(self) 2023-07-25 20:24:01+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 531, in do_rollback 2023-07-25 20:24:01+0000 [-] dbapi_connection.rollback() 2023-07-25 20:24:01+0000 [-] sqlite3.ProgrammingError: SQLite objects created in a thread can only be used in that same thread. The object was created in thread id 140422589822784 and this is thread id 140422475368192. 2023-07-25 20:24:01+0000 [-] 2023-07-25 20:24:01+0000 [-] During handling of the above exception, another exception occurred: 2023-07-25 20:24:01+0000 [-] 2023-07-25 20:24:01+0000 [-] Traceback (most recent call last): 2023-07-25 20:24:01+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/pool/base.py", line 270, in _close_connection 2023-07-25 20:24:01+0000 [-] self._dialect.do_close(connection) 2023-07-25 20:24:01+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 537, in do_close 2023-07-25 20:24:01+0000 [-] dbapi_connection.close() 2023-07-25 20:24:01+0000 [-] sqlite3.ProgrammingError: SQLite objects created in a thread can only be used in that same thread. The object was created in thread id 140422589822784 and this is thread id 140422475368192.

evilaliv3 commented 1 year ago

Thank you @j3pc0m

There seems to be a strange error in your setup.

How are you launching the application ? Are you using a simple virtual machine with Debian or are you making some different setup (e.g. using some virtualization/container technology?

gabllux commented 1 year ago

I'm not sure that you realized, but the TOR issue may be not related to a version upgrade: onion doesn't work even on a clean install of GlobaLeaks. I've tried with fresh AWS EC2 instances, with clean Debian 11 and 12 images. Globaleaks 4.11.X has onion working properly Globaleaks 4.12.X reports "unable to connect" on TOR browser Upgrading from 4.11.X to 4.12.5 breaks onion, too, but I think that's not the point.

PS If you need a successful migration log, here you are:

2023-07-25 18:50:55+0000 [-] twistd 20.3.0 (/usr/bin/python3 3.9.2) starting up.
2023-07-25 18:50:55+0000 [-] reactor class: twisted.internet.epollreactor.EPollReactor.
2023-07-25 18:50:56+0000 [-] Starting factory <Site object at 0x7f916cff5400>
2023-07-25 18:50:56+0000 [-] GlobaLeaks is now running and accessible at the following urls:
2023-07-25 18:50:56+0000 [-] - [HTTP]   --> http://0.0.0.0
2023-07-25 18:50:56+0000 [-] - [Tor]:   --> http://xt7k44opyzywozkeh7pb37uv7rkka2k5phjnpfzce4lzy3ztq6e36zad.onion
2023-07-25 18:50:56+0000 [-] Starting factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection.<locals>.quiescentCallback at 0x7f916ce19a60>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7f916ce1a7f0>)
2023-07-25 18:50:56+0000 [-] Stopping factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection.<locals>.quiescentCallback at 0x7f916ce19a60>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7f916ce1a7f0>)
2023-07-25 18:50:57+0000 [-] [E] Successfully connected to Tor control port
2023-07-25 18:50:57+0000 [-] [E] [1] Setting up the onion service xt7k44opyzywozkeh7pb37uv7rkka2k5phjnpfzce4lzy3ztq6e36zad.onion
2023-07-25 18:50:58+0000 [-] [E] [1] Initialization of onion-service xt7k44opyzywozkeh7pb37uv7rkka2k5phjnpfzce4lzy3ztq6e36zad.onion completed.
2023-07-25 19:00:00+0000 [-] Starting factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection.<locals>.quiescentCallback at 0x7f916ccbad30>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7f9165880160>)
2023-07-27 06:50:56+0000 [-] Stopping factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection.<locals>.quiescentCallback at 0x7f9165866430>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7f916583a370>)
2023-07-27 07:04:40+0000 [-] Stopping factory <Site object at 0x7f916cff5400>
2023-07-27 07:04:40+0000 [-] [E] Exception while running OnionService
2023-07-27 07:04:40+0000 [-] Traceback (most recent call last):
2023-07-27 07:04:40+0000 [-]   File "/usr/lib/python3/dist-packages/globaleaks/services/service.py", line 25, in run
2023-07-27 07:04:40+0000 [-]     yield self.operation()
2023-07-27 07:04:40+0000 [-] twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion: Connection lost.
2023-07-27 07:04:40+0000 [-] [E] exception mail suppressed for exception (<class 'twisted.internet.error.ConnectionLost'>) [reason: special exception]
2023-07-27 07:04:40+0000 [-] Server Shut Down.
2023-07-27 07:04:49+0000 [-] twistd 20.3.0 (/usr/bin/python3 3.9.2) starting up.
2023-07-27 07:04:49+0000 [-] reactor class: twisted.internet.epollreactor.EPollReactor.
2023-07-27 07:04:51+0000 [-] [E] Found an already initialized database version: 64
2023-07-27 07:04:51+0000 [-] [E] Performing schema migration from version 64 to version 65
2023-07-27 07:04:51+0000 [-] [I] Updating DB from version 64 to version 65
2023-07-27 07:04:52+0000 [-] [I] Migrating table:
2023-07-27 07:04:52+0000 [-] [I]  * AuditLog [#1]
2023-07-27 07:04:52+0000 [-] [I]  * Config [#80]
2023-07-27 07:04:52+0000 [-] [I]  * ConfigL10N [#68]
2023-07-27 07:04:52+0000 [-] [I]  * Context [#1]
2023-07-27 07:04:52+0000 [-] [I]  * EnabledLanguage [#1]
2023-07-27 07:04:52+0000 [-] [I]  * Field [#19]
2023-07-27 07:04:52+0000 [-] [I]  * FieldAttr [#47]
2023-07-27 07:04:52+0000 [-] [I]  * FieldOption [#13]
2023-07-27 07:04:52+0000 [-] [I]  * FieldOptionTriggerField [#7]
2023-07-27 07:04:52+0000 [-] [I]  * Questionnaire [#1]
2023-07-27 07:04:52+0000 [-] [I]  * ReceiverContext [#1]
2023-07-27 07:04:52+0000 [-] [I]  * SubmissionStatus [#3]
2023-07-27 07:04:52+0000 [-] [I]  * Step [#1]
2023-07-27 07:04:52+0000 [-] [I]  * Tenant [#1]
2023-07-27 07:04:52+0000 [-] [I]  * User [#2]
2023-07-27 07:04:52+0000 [-] [I] Migration completed with success.
2023-07-27 07:04:52+0000 [-] [I] Migration stats:
2023-07-27 07:04:52+0000 [-] [I]  * ArchivedSchema table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * AuditLog table migrated (1 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * Comment table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * Config table migrated (82 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * ConfigL10N table migrated (68 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * Context table migrated (1 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * CustomTexts table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * EnabledLanguage table migrated (1 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * Field table migrated (19 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * FieldAttr table migrated (47 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * FieldOption table migrated (13 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * FieldOptionTriggerField table migrated (7 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * FieldOptionTriggerStep table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * File table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * IdentityAccessRequest table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * InternalFile table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * InternalTip table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * InternalTipAnswers table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * InternalTipData table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * Mail table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * Questionnaire table migrated (1 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * ReceiverContext table migrated (1 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * ReceiverFile table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * ReceiverTip table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * Redirect table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * SubmissionStatus table migrated (3 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * SubmissionSubStatus table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * Step table migrated (1 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * Subscriber table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * Tenant table migrated (1 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * User table migrated (2 entry(s))
2023-07-27 07:04:52+0000 [-] [I]  * WhistleblowerFile table migrated (0 entry(s))
2023-07-27 07:04:52+0000 [-] Starting factory <Site object at 0x7f127e47b6a0>
2023-07-27 07:04:52+0000 [-] GlobaLeaks is now running and accessible at the following urls:
2023-07-27 07:04:52+0000 [-] - [HTTP]   --> http://0.0.0.0
2023-07-27 07:04:52+0000 [-] - [Tor]:   --> http://xt7k44opyzywozkeh7pb37uv7rkka2k5phjnpfzce4lzy3ztq6e36zad.onion
2023-07-27 07:04:52+0000 [-] Starting factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection.<locals>.quiescentCallback at 0x7f127bd49820>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7f127bd5a1c0>)
2023-07-27 07:04:53+0000 [-] [E] Successfully connected to Tor control port
2023-07-27 07:04:53+0000 [-] [E] [1] Setting up the onion service xt7k44opyzywozkeh7pb37uv7rkka2k5phjnpfzce4lzy3ztq6e36zad.onion
2023-07-27 07:04:53+0000 [-] Stopping factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection.<locals>.quiescentCallback at 0x7f127bd49820>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7f127bd5a1c0>)
2023-07-27 07:04:54+0000 [-] [E] [1] Initialization of onion-service xt7k44opyzywozkeh7pb37uv7rkka2k5phjnpfzce4lzy3ztq6e36zad.onion completed.

But onion doesn't work as well.

jsguerreroant commented 1 year ago

Same issue here. Onion was working until upgrade. Now on 4.12.5 and not working.

2023-07-27 10:02:41+0200 [-] twistd 20.3.0 (/usr/bin/python3 3.9.2) starting up. 2023-07-27 10:02:41+0200 [-] reactor class: twisted.internet.epollreactor.EPollReactor. 2023-07-27 10:02:42+0200 [-] [E] Found an already initialized database version: 65 2023-07-27 10:02:43+0200 [-] Starting factory <Site object at 0xffffb0fff670> 2023-07-27 10:02:43+0200 [-] GlobaLeaks is now running and accessible at the following urls: 2023-07-27 10:02:43+0200 [-] - [HTTP] --> http://xxxxxxxx 2023-07-27 10:02:43+0200 [-] - [HTTPS] --> https://xxxxxxxxx 2023-07-27 10:02:43+0200 [-] - [Tor]: --> http://z644vnlwc2hluro673drk72h6hxmy7fmuzs52myxfzd2qapclvf6waad.onion 2023-07-27 10:02:43+0200 [-] Starting factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection..quiescentCallback at 0xffffaf36f1f0>, <twisted.internet.endpoints._WrapperEndpoint object at 0xffffaf408cd0>) 2023-07-27 10:02:43+0200 [-] [E] Successfully connected to Tor control port 2023-07-27 10:02:43+0200 [-] [E] [1] Setting up the onion service z644vnlwc2hluro673drk72h6hxmy7fmuzs52myxfzd2qapclvf6waad.onion 2023-07-27 10:02:43+0200 [-] Stopping factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection..quiescentCallback at 0xffffaf36f1f0>, <twisted.internet.endpoints._WrapperEndpoint object at 0xffffaf408cd0>) 2023-07-27 10:02:45+0200 [-] [E] [1] Initialization of onion-service z644vnlwc2hluro673drk72h6hxmy7fmuzs52myxfzd2qapclvf6waad.onion completed.

I don't see anything strange in the starting log.

j3pc0m commented 1 year ago

Hi @evilaliv3 I am using server cloud with Ubuntu 20.04 But I don't understand why Tor has stopped working if the way of launching the application has not changed (witchcraft!!!) I've been looking on other GitHub sites and I've found this issue https://github.com/sqlalchemy/sqlalchemy/issues/5522 And someone proposes the following solution:

try: yield session finally: session.close()

jovimuoz commented 1 year ago

Same issue with Tor upgrading from 4.11.5 to 4.12.5, before upgrading from 4.11.5 to 4.12.3 with the same error. Server is Ubuntu 20.04 and /var/globaleaks/globaleaks.log indicates that "Successfully conected to Tor control port"

evilaliv3 commented 1 year ago

Bug identified.

Initially you had a not working onion server but now it works. The problem instead that you are encountering is that globaleaks is now always redirecting to HTTPS.

We are going to emit a patch and include in a minor release 4.12.6. Thank you for noticing and reporting this.

j3pc0m commented 1 year ago

Great @evilaliv3! Thanks a lot for your hard work

j3pc0m commented 1 year ago

Gooood morning @evilaliv3

Unfortunately the patch is not working for my installation

j3pc0m commented 1 year ago

And the log is the same as with version 4.15.5

2023-07-28 06:13:43+0000 [-] [E] Exception while running OnionService 2023-07-28 06:13:43+0000 [-] Traceback (most recent call last): 2023-07-28 06:13:43+0000 [-] File "/usr/lib/python3/dist-packages/globaleaks/services/service.py", line 25, in run 2023-07-28 06:13:43+0000 [-] yield self.operation() 2023-07-28 06:13:43+0000 [-] twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion: Connection lost. 2023-07-28 06:13:43+0000 [-] [E] exception mail suppressed for exception (<class 'twisted.internet.error.ConnectionLost'>) [reason: special exception] 2023-07-28 06:13:43+0000 [-] Stopping factory <Site object at 0x7fa862dd0ac0> 2023-07-28 06:13:43+0000 [-] Server Shut Down. 2023-07-28 06:13:55+0000 [-] twistd 18.9.0 (/usr/bin/python3 3.8.10) starting up. 2023-07-28 06:13:55+0000 [-] reactor class: twisted.internet.epollreactor.EPollReactor. 2023-07-28 06:13:57+0000 [-] [E] Found an already initialized database version: 64 2023-07-28 06:13:57+0000 [-] [E] Performing schema migration from version 64 to version 65 2023-07-28 06:13:57+0000 [-] [I] Updating DB from version 64 to version 65

[...]

2023-07-28 06:13:59+0000 [-] [E] Successfully connected to Tor control port 2023-07-28 06:13:59+0000 [-] [E] [1] Setting up the onion service pcpieoz6gayo4vntghh7nws5ijmnea5fqemxqpct4whmd7dei5xlz2qd.onion 2023-07-28 06:13:59+0000 [-] [E] [2] Setting up the onion service rczjoww4q7h5v6gz2jnaqbm7jzqieef7gw4dn3bibdmt2fmgdwtfbhyd.onion 2023-07-28 06:13:59+0000 [-] [E] [6] Setting up the onion service hfkbjizi5yd2uriafgx3iqtsamy2zllj5uzrh4azactjezfhfcnygzad.onion 2023-07-28 06:13:59+0000 [-] Stopping factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection..quiescentCallback at 0x7fca2898d430>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7fca29414c70>) 2023-07-28 06:14:02+0000 [-] [E] [1] Initialization of onion-service pcpieoz6gayo4vntghh7nws5ijmnea5fqemxqpct4whmd7dei5xlz2qd.onion completed. 2023-07-28 06:14:02+0000 [-] [E] [2] Initialization of onion-service rczjoww4q7h5v6gz2jnaqbm7jzqieef7gw4dn3bibdmt2fmgdwtfbhyd.onion completed. 2023-07-28 06:14:03+0000 [-] [E] [6] Initialization of onion-service hfkbjizi5yd2uriafgx3iqtsamy2zllj5uzrh4azactjezfhfcnygzad.onion completed. 2023-07-28 06:14:49+0000 [-] Exception during reset or similar 2023-07-28 06:14:49+0000 [-] Traceback (most recent call last): 2023-07-28 06:14:49+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/pool/base.py", line 680, in _finalize_fairy 2023-07-28 06:14:49+0000 [-] fairy._reset(pool) 2023-07-28 06:14:49+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/pool/base.py", line 867, in _reset 2023-07-28 06:14:49+0000 [-] pool._dialect.do_rollback(self) 2023-07-28 06:14:49+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 531, in do_rollback 2023-07-28 06:14:49+0000 [-] dbapi_connection.rollback() 2023-07-28 06:14:49+0000 [-] sqlite3.ProgrammingError: SQLite objects created in a thread can only be used in that same thread. The object was created in thread id 140506346202944 and this is thread id 140506155706112. 2023-07-28 06:14:49+0000 [-] Exception closing connection <sqlite3.Connection object at 0x7fca293374e0> 2023-07-28 06:14:49+0000 [-] Traceback (most recent call last): 2023-07-28 06:14:49+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/pool/base.py", line 680, in _finalize_fairy 2023-07-28 06:14:49+0000 [-] fairy._reset(pool) 2023-07-28 06:14:49+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/pool/base.py", line 867, in _reset 2023-07-28 06:14:49+0000 [-] pool._dialect.do_rollback(self) 2023-07-28 06:14:49+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 531, in do_rollback 2023-07-28 06:14:49+0000 [-] dbapi_connection.rollback() 2023-07-28 06:14:49+0000 [-] sqlite3.ProgrammingError: SQLite objects created in a thread can only be used in that same thread. The object was created in thread id 140506346202944 and this is thread id 140506155706112. 2023-07-28 06:14:49+0000 [-] 2023-07-28 06:14:49+0000 [-] During handling of the above exception, another exception occurred: 2023-07-28 06:14:49+0000 [-] 2023-07-28 06:14:49+0000 [-] Traceback (most recent call last): 2023-07-28 06:14:49+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/pool/base.py", line 270, in _close_connection 2023-07-28 06:14:49+0000 [-] self._dialect.do_close(connection) 2023-07-28 06:14:49+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 537, in do_close 2023-07-28 06:14:49+0000 [-] dbapi_connection.close() 2023-07-28 06:14:49+0000 [-] sqlite3.ProgrammingError: SQLite objects created in a thread can only be used in that same thread. The object was created in thread id 140506346202944 and this is thread id 140506155706112.

j3pc0m commented 1 year ago

I am going back to version 4.11.5

@gabllux @jsguerreroant @jovimuoz

Is the new patch working for you?

jsguerreroant commented 1 year ago

Hi there:

Negative, same issue. Same log. The only new thing I have seen, using http://.onion is that it said once that we are redirectering to https and there is no https onion working on the site.

j3pc0m commented 1 year ago

Thanks @jsguerreroant

I have asked it to rule out if the bug was due to my server.

jovimuoz commented 1 year ago

Hi, Don't work, same issue. Occurs the same as @jsguerreroant says, .onion site redirect to https.

j3pc0m commented 1 year ago

Thanks @jovimuoz

evilaliv3 commented 1 year ago

Thank you all. It seems there is still a bug wit the redirect happening in some situations (i'm on leave till the 10th but i will try to look at it).

@j3pc0m: you have some logs that should be investigated separately and if not may have impact on possible data loss.

2023-07-28 06:14:49+0000 [-]
2023-07-28 06:14:49+0000 [-] During handling of the above exception, another exception occurred:
2023-07-28 06:14:49+0000 [-]
2023-07-28 06:14:49+0000 [-] Traceback (most recent call last):
2023-07-28 06:14:49+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/pool/base.py", line 270, in _close_connection
2023-07-28 06:14:49+0000 [-] self._dialect.do_close(connection)
2023-07-28 06:14:49+0000 [-] File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 537, in do_close
2023-07-28 06:14:49+0000 [-] dbapi_connection.close()
2023-07-28 06:14:49+0000 [-] sqlite3.ProgrammingError: SQLite objects created in a thread can only be used in that same thread.

If you can would you please open a ticket with this title "SQLite objects created in a thread can only be used in that same thread.". collect some detail and describe your setup and system (mainly os / os version/ virtualization technology / processor). Thank you

gabllux commented 1 year ago

Hello @evilaliv3, unfortunately with the bug fix on 4.12.6 Onion still doesn't work - I've tried another clean install from scratch on a new Debian 12 machine. TOR browser still reports "Unable to connect", same log without any clue on what is breaking onion:

2023-07-28 07:52:36+0000 [-] twistd 22.4.0 (/usr/bin/python3 3.11.2) starting up.
2023-07-28 07:52:36+0000 [-] reactor class: twisted.internet.epollreactor.EPollReactor.
2023-07-28 07:52:37+0000 [-] Starting factory <Site object at 0x7fa95f178410>
2023-07-28 07:52:37+0000 [-] GlobaLeaks is now running and accessible at the following urls:
2023-07-28 07:52:37+0000 [-] - [HTTP]   --> http://0.0.0.0
2023-07-28 07:52:37+0000 [-] - [Tor]:   --> http://nf5d4etlnah47asalm2evjjxvo2l4hgrvjob2pnfmq4tjnewft3sc4yd.onion
2023-07-28 07:52:37+0000 [-] Starting factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection.<locals>.quiescentCallback at 0x7fa95edbc0e0>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7fa95f177110>)
2023-07-28 07:52:37+0000 [-] Stopping factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection.<locals>.quiescentCallback at 0x7fa95edbc0e0>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7fa95f177110>)
2023-07-28 07:52:37+0000 [-] [E] Successfully connected to Tor control port
2023-07-28 07:52:37+0000 [-] [E] [1] Setting up the onion service nf5d4etlnah47asalm2evjjxvo2l4hgrvjob2pnfmq4tjnewft3sc4yd.onion
2023-07-28 07:52:43+0000 [-] [E] [1] Initialization of onion-service nf5d4etlnah47asalm2evjjxvo2l4hgrvjob2pnfmq4tjnewft3sc4yd.onion completed.
2023-07-28 08:00:00+0000 [-] Starting factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection.<locals>.quiescentCallback at 0x7fa95eb509a0>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7fa95edacc50>)
2023-07-28 08:00:00+0000 [-] Stopping factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection.<locals>.quiescentCallback at 0x7fa95eb509a0>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7fa95edacc50>)
evilaliv3 commented 1 year ago

Thank you anyone. I've just issued a final working patch.

We are issuing a new release 4.12.7 that should be out in less than 30 min.

The ones of you that are able to could even testing it already.

j3pc0m commented 1 year ago

Hi @evilaliv3

I go to wait 10 minutes and I will upgrade the version.

Thanks for your quick response.

gabllux commented 1 year ago

I confirm the Onion issue has been definitely fixed in version 4.12.7. Thank you!

j3pc0m commented 1 year ago

I am going to upgrade

jsguerreroant commented 1 year ago

Working here too.

Thank you!!!!

j3pc0m commented 1 year ago

THANKS @evilaliv3 PERFECT!!!

jovimuoz commented 1 year ago

Thanks a lot, It works!

j3pc0m commented 1 year ago

I`m sorry @evilaliv3, but today I updated to 4,13.1 and our server is having the same problem again. Although the log is different...

2023-08-31 07:25:11+0000 [-] [E] Failed to initialize Tor connection; error: Tor control port not open on /var/globaleaks/tmp/tor_control; waiting for Tor to become available 2023-08-31 07:25:11+0000 [-] GlobaLeaks is now running and accessible at the following urls: 2023-08-31 07:25:11+0000 [-] - [HTTPS]: https://xxxxxxxxxxxxx.com 2023-08-31 07:25:11+0000 [-] - [Tor]: http://pcpieoz6gayo4vntghh7nws5ijmnea5fqemxqpct4whmd7dei5xlz2qd.onion 2023-08-31 07:25:12+0000 [-] Starting factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection..quiescentCallback at 0x7fc475788160>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7fc47578da90>) 2023-08-31 07:25:12+0000 [-] Starting factory <twisted.mail.smtp.ESMTPSenderFactory object at 0x7fc475749d90> 2023-08-31 07:25:12+0000 [-] Stopping factory _HTTP11ClientFactory(<function HTTPConnectionPool._newConnection..quiescentCallback at 0x7fc475788160>, <twisted.internet.endpoints._WrapperEndpoint object at 0x7fc47578da90>) 2023-08-31 07:25:12+0000 [-] Stopping factory <twisted.mail.smtp.ESMTPSenderFactory object at 0x7fc475749d90> 2023-08-31 07:34:13+0000 [-] Stopping factory <Site object at 0x7fc477f8dfa0> 2023-08-31 07:34:13+0000 [-] Server Shut Down. 2023-08-31 07:34:39+0000 [-] twistd 18.9.0 (/usr/bin/python3 3.8.10) starting up. 2023-08-31 07:34:39+0000 [-] reactor class: twisted.internet.epollreactor.EPollReactor. 2023-08-31 07:34:42+0000 [-] [E] Found an already initialized database version: 66 2023-08-31 07:34:42+0000 [-] Starting factory <Site object at 0x7f5b08773a00> 2023-08-31 07:34:42+0000 [-] [E] Failed to initialize Tor connection; error: Tor control port not open on /var/globaleaks/tmp/tor_control; waiting for Tor to become available

j3pc0m commented 1 year ago

@gabllux @jsguerreroant @jovimuoz

Have you been able to update the version without problems?

evilaliv3 commented 1 year ago

Thank you @j3pc0m for reopening the ticket.

We are aware of a bug and we are about to issue a release that fix it.

The system Tor is competing with the tor instance launched by globaleaks

In the meantime you could solve the problem with this commands:


/etc/init.d/tor stop
update-rc. d tor disable
/etc/init.d/globaleaks restart```
j3pc0m commented 1 year ago

Thank you for your very fast answer. I go to try

jovimuoz commented 1 year ago

@j3pc0m thanks you, we also have the problem. Thanks @evilaliv3 for workaround.

j3pc0m commented 1 year ago

Hi @evilaliv3, just so you know... the onion site is still disconnected. I'm going to wait for the version that fixes the bug. Thanks for being there.

evilaliv3 commented 1 year ago

@j3pc0m : it may take a while to load but i think it should @j3pc0m

The version that we will issue actually do somethin similar (just use a different port so to nbot compete with the system tor)

j3pc0m commented 1 year ago

Great @evilaliv3, now it's working