-
Notifications
You must be signed in to change notification settings - Fork 42
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Synapse not working properly since Yunohost 12.0 upgrade #495
Comments
About a year ago I restored the app after an architecture change (32 to 64bits) using this trick. (see the the issue I posted at the time) Do you think it can be related? Thank you for any help. |
Update: I have tried without great hope to delete and restore Synapse aaaand it kind of worked! The messages I send to my matrix.org account are not rejected anymore and my server got the messages sent during the down times in rooms concerned (all from matrix.org instance) Not everything seems resolved though: The messages I sent from my matrix.org account to my instance during the down time were not recovered and I don't recieve new messages. Here is my logs (that look far more normal than the other day) I think the great number of rotating notifications (and it doesn't seem to decrease) is not good?
thanks for the help. homeserver.log2024-11-14 08:50:48,861 - synapse.handlers.presence - 914 - INFO - persist_presence_changes-539- Persisting 1 unpersisted presence updates 2024-11-14 08:50:49,032 - synapse.util.caches.lrucache - 218 - INFO - LruCache._expire_old_entries-1081- Dropped 0 items from caches 2024-11-14 08:51:02,738 - synapse.access.http.8008 - 473 - INFO - GET-1925- 37.97.106.xx - 8008 - {@krcr:matrix.mydomain.com} Processed request: 30.017sec/0.002sec (0.014sec, 0.000sec) (0.000sec/0.000sec/0) 412B 200 "GET /_matrix/client/v3/sync?filter=8&timeout=30000&set_presence=unavailable&since=s188034_2852049_40_420563_175960_516578_149429_66317_0_28 HTTP/1.0" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.85 Chrome/128.0.6613.36 Electron/32.0.1 Safari/537.36" [0 dbevts] 2024-11-14 08:51:11,808 - synapse.http.site - 385 - INFO - GET-1927- Connection from client lost before response was sent 2024-11-14 08:51:12,408 - synapse.access.http.8008 - 473 - INFO - GET-1928- 37.97.106.xx - 8008 - {@krcr:matrix.mydomain.com} Processed request: 0.017sec/-0.000sec (0.006sec, 0.003sec) (0.002sec/0.005sec/2) 1828B 200 "GET /_matrix/client/v1/media/thumbnail/matrix.org/fZIAgrlgYQSCIwusJmyEbadz?width=36&height=36&method=crop&allow_redirect=true HTTP/1.0" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.85 Chrome/128.0.6613.36 Electron/32.0.1 Safari/537.36" [0 dbevts] 2024-11-14 08:51:14,197 - synapse.access.http.8008 - 473 - INFO - GET-1929- 37.97.106.xx - 8008 - {None} Processed request: 0.001sec/0.002sec (0.004sec, 0.000sec) (0.000sec/0.000sec/0) 1062B 200 "GET /_matrix/client/versions HTTP/1.0" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.85 Chrome/128.0.6613.36 Electron/32.0.1 Safari/537.36" [0 dbevts] 2024-11-14 08:51:14,502 - synapse.access.http.8008 - 473 - INFO - GET-1931- 37.97.106.xx - 8008 - {@krcr:matrix.mydomain.com} Processed request: 0.013sec/0.002sec (0.013sec, 0.000sec) (0.000sec/0.000sec/0) 261B 200 "GET /_matrix/client/v3/sync?filter=8&timeout=0&set_presence=unavailable&since=s188034_2852050_40_420563_175960_516578_149429_66317_0_28 HTTP/1.0" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.85 Chrome/128.0.6613.36 Electron/32.0.1 Safari/537.36" [0 dbevts] 2024-11-14 08:51:14,698 - synapse.util.caches.response_cache - 275 - INFO - GET-1933- [sync]: using incomplete cached result for [(@krcr:matrix.mydomain.com, 30000, 's188034_2852050_40_420563_175960_516578_149429_66317_0_28', '8', False, 'UWIZFHREAW', None)] 2024-11-14 08:51:17,857 - synapse.storage.databases.main.event_push_actions - 1396 - INFO - rotate_notifs-1082- Rotating notifications 2024-11-14 08:51:17,867 - synapse.storage.databases.main.event_push_actions - 1599 - INFO - rotate_notifs-1082- Rotating notifications up to: 188034 2024-11-14 08:51:17,886 - synapse.storage.databases.main.event_push_actions - 1685 - INFO - rotate_notifs-1082- Rotating notifications, handling 0 rows 2024-11-14 08:51:17,915 - synapse.storage.databases.main.event_push_actions - 1770 - INFO - rotate_notifs-1082- Rotating notifications, deleted 0 push actions 2024-11-14 08:51:19,032 - synapse.util.caches.lrucache - 218 - INFO - LruCache._expire_old_entries-1082- Dropped 0 items from caches 2024-11-14 08:51:32,980 - synapse.rest.client.sync - 254 - INFO - GET-1927- Client has disconnected; not serializing response. 2024-11-14 08:51:32,981 - synapse.http.server - 782 - WARNING - GET-1927- Not sending response to request , already disconnected. 2024-11-14 08:51:32,983 - synapse.access.http.8008 - 473 - INFO - GET-1927- 37.97.106.xx - 8008 - {@krcr:matrix.mydomain.com} Processed request: 30.011sec/-21.174sec (0.019sec, 0.000sec) (0.000sec/0.000sec/0) 0B 200! "GET /_matrix/client/v3/sync?filter=8&timeout=30000&set_presence=unavailable&since=s188034_2852050_40_420563_175960_516578_149429_66317_0_28 HTTP/1.0" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.85 Chrome/128.0.6613.36 Electron/32.0.1 Safari/537.36" [0 dbevts] 2024-11-14 08:51:32,991 - synapse.access.http.8008 - 473 - INFO - GET-1933- 37.97.106.xx - 8008 - {@krcr:matrix.mydomain.com} Processed request: 18.293sec/0.004sec (0.008sec, 0.000sec) (0.000sec/0.000sec/0) 261B 200 "GET /_matrix/client/v3/sync?filter=8&timeout=30000&set_presence=unavailable&since=s188034_2852050_40_420563_175960_516578_149429_66317_0_28 HTTP/1.0" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.85 Chrome/128.0.6613.36 Electron/32.0.1 Safari/537.36" [0 dbevts] 2024-11-14 08:51:33,112 - synapse.federation.sender.transaction_manager - 127 - INFO - federation_transaction_transmission_loop-619- TX [matrix.org] {1731541788903} Sending transaction [1731541788903], (PDUs: 0, EDUs: 1) 2024-11-14 08:51:33,130 - synapse.access.http.8008 - 473 - INFO - GET-1935- 37.97.106.xx - 8008 - {@krcr:matrix.mydomain.com} Processed request: 0.070sec/0.003sec (0.029sec, 0.003sec) (0.003sec/0.026sec/3) 426B 200 "GET /_matrix/client/v3/sync?filter=8&timeout=30000&set_presence=online&since=s188034_2852050_40_420563_175960_516578_149429_66317_0_28 HTTP/1.0" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.85 Chrome/128.0.6613.36 Electron/32.0.1 Safari/537.36" [0 dbevts] 2024-11-14 08:51:33,226 - synapse.http.matrixfederationclient - 364 - INFO - federation_transaction_transmission_loop-619- {PUT-O-94} [matrix.org] Completed request: 200 OK in 0.11 secs, got 11 bytes - PUT matrix-federation://matrix.org/_matrix/federation/v1/send/1731541788903 2024-11-14 08:51:33,227 - synapse.federation.sender.transaction_manager - 180 - INFO - federation_transaction_transmission_loop-619- TX [matrix.org] {1731541788903} got 200 response 2024-11-14 08:51:47,851 - synapse.storage.databases.main.event_push_actions - 1396 - INFO - rotate_notifs-1083- Rotating notifications 2024-11-14 08:51:47,860 - synapse.storage.databases.main.event_push_actions - 1599 - INFO - rotate_notifs-1083- Rotating notifications up to: 188034 2024-11-14 08:51:47,872 - synapse.storage.databases.main.event_push_actions - 1685 - INFO - rotate_notifs-1083- Rotating notifications, handling 0 rows 2024-11-14 08:51:47,891 - synapse.storage.databases.main.event_push_actions - 1770 - INFO - rotate_notifs-1083- Rotating notifications, deleted 0 push actions 2024-11-14 08:51:48,844 - synapse.federation.sender - 1019 - INFO - wake_destinations_needing_catchup-542- Destination matrix.mygaia.org has outstanding catch-up, waking up. 2024-11-14 08:51:48,854 - synapse.handlers.presence - 914 - INFO - persist_presence_changes-540- Persisting 1 unpersisted presence updates 2024-11-14 08:51:48,964 - synapse.metrics._gc - 127 - INFO - sentinel- Collecting gc 1 2024-11-14 08:51:49,031 - synapse.util.caches.lrucache - 218 - INFO - LruCache._expire_old_entries-1083- Dropped 0 items from caches 2024-11-14 08:52:03,222 - synapse.access.http.8008 - 473 - INFO - GET-1937- 37.97.106.xx - 8008 - {@krcr:matrix.mydomain.com} Processed request: 30.012sec/0.002sec (0.009sec, 0.001sec) (0.000sec/0.000sec/0) 429B 200 "GET /_matrix/client/v3/sync?filter=8&timeout=30000&set_presence=online&since=s188034_2852051_40_420563_175960_516578_149429_66317_0_28 HTTP/1.0" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.85 Chrome/128.0.6613.36 Electron/32.0.1 Safari/537.36" [0 dbevts] 2024-11-14 08:52:17,856 - synapse.storage.databases.main.event_push_actions - 1396 - INFO - rotate_notifs-1084- Rotating notifications 2024-11-14 08:52:17,866 - synapse.storage.databases.main.event_push_actions - 1599 - INFO - rotate_notifs-1084- Rotating notifications up to: 188034 2024-11-14 08:52:17,885 - synapse.storage.databases.main.event_push_actions - 1685 - INFO - rotate_notifs-1084- Rotating notifications, handling 0 rows 2024-11-14 08:52:17,911 - synapse.storage.databases.main.event_push_actions - 1770 - INFO - rotate_notifs-1084- Rotating notifications, deleted 0 push actions 2024-11-14 08:52:19,039 - synapse.util.caches.lrucache - 218 - INFO - LruCache._expire_old_entries-1084- Dropped 57 items from caches 2024-11-14 08:52:33,295 - synapse.access.http.8008 - 473 - INFO - GET-1939- 37.97.106.xx - 8008 - {@krcr:matrix.mydomain.com} Processed request: 30.008sec/0.003sec (0.010sec, 0.000sec) (0.000sec/0.000sec/0) 261B 200 "GET /_matrix/client/v3/sync?filter=8&timeout=30000&set_presence=online&since=s188034_2852052_40_420563_175960_516578_149429_66317_0_28 HTTP/1.0" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.85 Chrome/128.0.6613.36 Electron/32.0.1 Safari/537.36" [0 dbevts] 2024-11-14 08:52:47,856 - synapse.storage.databases.main.event_push_actions - 1396 - INFO - rotate_notifs-1085- Rotating notifications 2024-11-14 08:52:47,866 - synapse.storage.databases.main.event_push_actions - 1599 - INFO - rotate_notifs-1085- Rotating notifications up to: 188034 2024-11-14 08:52:47,886 - synapse.storage.databases.main.event_push_actions - 1685 - INFO - rotate_notifs-1085- Rotating notifications, handling 0 rows 2024-11-14 08:52:47,914 - synapse.storage.databases.main.event_push_actions - 1770 - INFO - rotate_notifs-1085- Rotating notifications, deleted 0 push actions 2024-11-14 08:52:48,854 - synapse.federation.sender - 1019 - INFO - wake_destinations_needing_catchup-543- Destination matrix.mygaia.org has outstanding catch-up, waking up. 2024-11-14 08:52:48,860 - synapse.handlers.presence - 914 - INFO - persist_presence_changes-541- Persisting 1 unpersisted presence updates 2024-11-14 08:52:49,067 - synapse.util.caches.lrucache - 218 - INFO - LruCache._expire_old_entries-1085- Dropped 378 items from caches 2024-11-14 08:53:03,389 - synapse.access.http.8008 - 473 - INFO - GET-1941- 37.97.106.xx - 8008 - {@krcr:matrix.mydomain.com} Processed request: 30.010sec/0.002sec (0.013sec, 0.001sec) (0.000sec/0.000sec/0) 261B 200 "GET /_matrix/client/v3/sync?filter=8&timeout=30000&set_presence=online&since=s188034_2852052_40_420563_175960_516578_149429_66317_0_28 HTTP/1.0" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.85 Chrome/128.0.6613.36 Electron/32.0.1 Safari/537.36" [0 dbevts] 2024-11-14 08:53:03,801 - synapse.access.http.8008 - 473 - INFO - GET-1943- 37.97.106.xx - 8008 - {@krcr:matrix.mydomain.com} Processed request: 0.015sec/0.002sec (0.014sec, 0.000sec) (0.000sec/0.000sec/0) 426B 200 "GET /_matrix/client/v3/sync?filter=8&timeout=30000&set_presence=online&since=s188034_2852052_40_420563_175960_516578_149429_66317_0_28 HTTP/1.0" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Element/1.11.85 Chrome/128.0.6613.36 Electron/32.0.1 Safari/537.36" [0 dbevts] 2024-11-14 08:53:17,872 - synapse.storage.databases.main.event_push_actions - 1396 - INFO - rotate_notifs-1086- Rotating notifications 2024-11-14 08:53:17,879 - synapse.storage.databases.main.event_push_actions - 1599 - INFO - rotate_notifs-1086- Rotating notifications up to: 188034 2024-11-14 08:53:17,890 - synapse.storage.databases.main.event_push_actions - 1685 - INFO - rotate_notifs-1086- Rotating notifications, handling 0 rows 2024-11-14 08:53:17,927 - synapse.storage.databases.main.event_push_actions - 1770 - INFO - rotate_notifs-1086- Rotating notifications, deleted 0 push actions 2024-11-14 08:53:19,053 - synapse.util.caches.lrucache - 218 - INFO - LruCache._expire_old_entries-1086- Dropped 466 items from cachesjournalctl.logLOGFILE: journalctl LOGFILE: /var/log/matrix-synapse/homeserver.log |
Context
Steps to reproduce
Hi, since I upgraded Yunohost to 12.0 Synapse does not work anymore. It runs but I am unable to send or recieve messages. I am not sure if it's a package issue since others does not seem to have this behavior. I tried to run the command below as suggested:
The upgrade was executed and Synapse is running, but it is still not working properly.
Could this be related to IPV6? The post-upgrade diagnostic told me my ipv6 had changed, I updated my DNS as advised and https://federationtester.matrix.org/ show my instance as working. Also when I test with an account on matrix.org instance, I can see "XXX is writing..." but not the messages. If I send one, it is instantly rejected.
Here is what I see in my journalctl, Thank you for any help, as I have no idea what to try now.
Journalctl Logs
See logs
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/databases/main/roommember.py", line 660, in get_local_current_membership_for_user_in_room
Nov 11 20:26:42 cloud.mydomain.com python[16207]: await self.db_pool.simple_select_one(
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 1680, in simple_select_one
Nov 11 20:26:42 cloud.mydomain.com python[16207]: return await self.runInteraction(
Nov 11 20:26:42 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 952, in runInteraction
Nov 11 20:26:42 cloud.mydomain.com python[16207]: return await delay_cancellation(_runInteraction())
Nov 11 20:26:42 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/internet/defer.py", line 2010, in _inlineCallbacks
Nov 11 20:26:42 cloud.mydomain.com python[16207]: result = context.run(
Nov 11 20:26:42 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/failure.py", line 549, in throwExceptionIntoGenerator
Nov 11 20:26:42 cloud.mydomain.com python[16207]: return g.throw(self.value.with_traceback(self.tb))
Nov 11 20:26:42 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 918, in _runInteraction
Nov 11 20:26:42 cloud.mydomain.com python[16207]: result: R = await self.runWithConnection(
Nov 11 20:26:42 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 1047, in runWithConnection
Nov 11 20:26:42 cloud.mydomain.com python[16207]: return await make_deferred_yieldable(
Nov 11 20:26:42 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/threadpool.py", line 269, in inContext
Nov 11 20:26:42 cloud.mydomain.com python[16207]: result = inContext.theWork() # type: ignore[attr-defined]
Nov 11 20:26:42 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/threadpool.py", line 285, in
Nov 11 20:26:42 cloud.mydomain.com python[16207]: inContext.theWork = lambda: context.call( # type: ignore[attr-defined]
Nov 11 20:26:42 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/context.py", line 117, in callWithContext
Nov 11 20:26:42 cloud.mydomain.com python[16207]: return self.currentContext().callWithContext(ctx, func, *args, **kw)
Nov 11 20:26:42 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/context.py", line 82, in callWithContext
Nov 11 20:26:42 cloud.mydomain.com python[16207]: return func(*args, **kw)
Nov 11 20:26:42 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/enterprise/adbapi.py", line 282, in _runWithConnection
Nov 11 20:26:42 cloud.mydomain.com python[16207]: result = func(conn, *args, **kw)
Nov 11 20:26:42 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 1043, in inner_func
Nov 11 20:26:42 cloud.mydomain.com python[16207]: self.engine.attempt_to_set_autocommit(conn, False)
Nov 11 20:26:42 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/engines/postgres.py", line 239, in attempt_to_set_autocommit
Nov 11 20:26:42 cloud.mydomain.com python[16207]: return conn.set_session(autocommit=autocommit)
Nov 11 20:26:42 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:42 cloud.mydomain.com python[16207]: psycopg2.InterfaceError: connection already closed
Nov 11 20:26:45 cloud.mydomain.com python[16207]: 2024-11-11 20:26:45,850 - synapse.storage.txn - 787 - WARNING - GET-550- [TXN OPERROR] {_get_state_groups_from_groups-5a0} SSL SYSCALL error: EOF detected
Nov 11 20:26:45 cloud.mydomain.com python[16207]: 0/5
Nov 11 20:26:45 cloud.mydomain.com python[16207]: 2024-11-11 20:26:45,852 - twisted - 279 - CRITICAL - GET-550- Rollback failed
Nov 11 20:26:45 cloud.mydomain.com python[16207]: Traceback (most recent call last):
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/enterprise/adbapi.py", line 282, in _runWithConnection
Nov 11 20:26:45 cloud.mydomain.com python[16207]: result = func(conn, *args, **kw)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 1040, in inner_func
Nov 11 20:26:45 cloud.mydomain.com python[16207]: return func(db_conn, *args, **kwargs)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 798, in new_transaction
Nov 11 20:26:45 cloud.mydomain.com python[16207]: conn.rollback()
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 213, in rollback
Nov 11 20:26:45 cloud.mydomain.com python[16207]: self.conn.rollback()
Nov 11 20:26:45 cloud.mydomain.com python[16207]: --- ---
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/enterprise/adbapi.py", line 52, in rollback
Nov 11 20:26:45 cloud.mydomain.com python[16207]: self._connection.rollback()
Nov 11 20:26:45 cloud.mydomain.com python[16207]: psycopg2.InterfaceError: connection already closed
Nov 11 20:26:45 cloud.mydomain.com python[16207]: 2024-11-11 20:26:45,866 - twisted - 279 - CRITICAL - sentinel- Rollback failed
Nov 11 20:26:45 cloud.mydomain.com python[16207]: Traceback (most recent call last):
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/threadpool.py", line 285, in
Nov 11 20:26:45 cloud.mydomain.com python[16207]: inContext.theWork = lambda: context.call( # type: ignore[attr-defined]
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/context.py", line 117, in callWithContext
Nov 11 20:26:45 cloud.mydomain.com python[16207]: return self.currentContext().callWithContext(ctx, func, *args, **kw)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/context.py", line 82, in callWithContext
Nov 11 20:26:45 cloud.mydomain.com python[16207]: return func(*args, **kw)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/enterprise/adbapi.py", line 287, in _runWithConnection
Nov 11 20:26:45 cloud.mydomain.com python[16207]: conn.rollback()
Nov 11 20:26:45 cloud.mydomain.com python[16207]: --- ---
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/enterprise/adbapi.py", line 52, in rollback
Nov 11 20:26:45 cloud.mydomain.com python[16207]: self._connection.rollback()
Nov 11 20:26:45 cloud.mydomain.com python[16207]: psycopg2.InterfaceError: connection already closed
Nov 11 20:26:45 cloud.mydomain.com python[16207]: 2024-11-11 20:26:45,868 - twisted - 279 - CRITICAL - sentinel- Rollback failed
Nov 11 20:26:45 cloud.mydomain.com python[16207]: Traceback (most recent call last):
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/threadpool.py", line 269, in inContext
Nov 11 20:26:45 cloud.mydomain.com python[16207]: result = inContext.theWork() # type: ignore[attr-defined]
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/threadpool.py", line 285, in
Nov 11 20:26:45 cloud.mydomain.com python[16207]: inContext.theWork = lambda: context.call( # type: ignore[attr-defined]
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/context.py", line 117, in callWithContext
Nov 11 20:26:45 cloud.mydomain.com python[16207]: return self.currentContext().callWithContext(ctx, func, *args, **kw)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/context.py", line 82, in callWithContext
Nov 11 20:26:45 cloud.mydomain.com python[16207]: return func(*args, **kw)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: --- ---
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/enterprise/adbapi.py", line 287, in _runWithConnection
Nov 11 20:26:45 cloud.mydomain.com python[16207]: conn.rollback()
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/enterprise/adbapi.py", line 61, in rollback
Nov 11 20:26:45 cloud.mydomain.com python[16207]: self._pool.disconnect(self._connection)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/enterprise/adbapi.py", line 426, in disconnect
Nov 11 20:26:45 cloud.mydomain.com python[16207]: raise Exception("wrong connection for thread")
Nov 11 20:26:45 cloud.mydomain.com python[16207]: builtins.Exception: wrong connection for thread
Nov 11 20:26:45 cloud.mydomain.com python[16207]: 2024-11-11 20:26:45,876 - synapse.http.server - 146 - ERROR - GET-550- Failed handle request via 'RoomMessageListRestServlet': <XForwardedForRequest at 0x7f841c41d0 method='GET' uri='/_matrix/client/v3/rooms/!eEYxvziMhmLgaKQoLe%3Amatrix.mydomain.com/messages?limit=100&dir=b&from=s179583_2713741_36_401190_161738_516577_147910_66141_0_25&filter=%7B%22lazy_load_members%22%3Atrue%7D' clientproto='HTTP/1.0' site='8008'>
Nov 11 20:26:45 cloud.mydomain.com python[16207]: Traceback (most recent call last):
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 780, in new_transaction
Nov 11 20:26:45 cloud.mydomain.com python[16207]: r = func(cursor, *args, **kwargs)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/databases/state/bg_updates.py", line 214, in _get_state_groups_from_groups_txn
Nov 11 20:26:45 cloud.mydomain.com python[16207]: txn.execute(sql % (overall_select_clause,), args)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 426, in execute
Nov 11 20:26:45 cloud.mydomain.com python[16207]: self._do_execute(self.txn.execute, sql, parameters)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 488, in _do_execute
Nov 11 20:26:45 cloud.mydomain.com python[16207]: return func(sql, *args, **kwargs)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: psycopg2.OperationalError: SSL SYSCALL error: EOF detected
Nov 11 20:26:45 cloud.mydomain.com python[16207]: During handling of the above exception, another exception occurred:
Nov 11 20:26:45 cloud.mydomain.com python[16207]: Traceback (most recent call last):
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/http/server.py", line 332, in _async_render_wrapper
Nov 11 20:26:45 cloud.mydomain.com python[16207]: callback_return = await self._async_render(request)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/http/server.py", line 544, in _async_render
Nov 11 20:26:45 cloud.mydomain.com python[16207]: callback_return = await raw_callback_return
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/rest/client/room.py", line 808, in on_GET
Nov 11 20:26:45 cloud.mydomain.com python[16207]: msgs = await self.pagination_handler.get_messages(
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/handlers/pagination.py", line 629, in get_messages
Nov 11 20:26:45 cloud.mydomain.com python[16207]: events = await filter_events_for_client(
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/visibility.py", line 123, in filter_events_for_client
Nov 11 20:26:45 cloud.mydomain.com python[16207]: event_id_to_state = await storage.state.get_state_for_events(
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/controllers/state.py", line 246, in get_state_for_events
Nov 11 20:26:45 cloud.mydomain.com python[16207]: group_to_state = await self.stores.state._get_state_for_groups(
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/databases/state/store.py", line 317, in _get_state_for_groups
Nov 11 20:26:45 cloud.mydomain.com python[16207]: group_to_state_dict = await self._get_state_groups_from_groups(
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/databases/state/store.py", line 206, in _get_state_groups_from_groups
Nov 11 20:26:45 cloud.mydomain.com python[16207]: res = await self.db_pool.runInteraction(
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 952, in runInteraction
Nov 11 20:26:45 cloud.mydomain.com python[16207]: return await delay_cancellation(_runInteraction())
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/internet/defer.py", line 2010, in _inlineCallbacks
Nov 11 20:26:45 cloud.mydomain.com python[16207]: result = context.run(
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/failure.py", line 549, in throwExceptionIntoGenerator
Nov 11 20:26:45 cloud.mydomain.com python[16207]: return g.throw(self.value.with_traceback(self.tb))
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 918, in _runInteraction
Nov 11 20:26:45 cloud.mydomain.com python[16207]: result: R = await self.runWithConnection(
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 1047, in runWithConnection
Nov 11 20:26:45 cloud.mydomain.com python[16207]: return await make_deferred_yieldable(
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/threadpool.py", line 269, in inContext
Nov 11 20:26:45 cloud.mydomain.com python[16207]: result = inContext.theWork() # type: ignore[attr-defined]
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/threadpool.py", line 285, in
Nov 11 20:26:45 cloud.mydomain.com python[16207]: inContext.theWork = lambda: context.call( # type: ignore[attr-defined]
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/context.py", line 117, in callWithContext
Nov 11 20:26:45 cloud.mydomain.com python[16207]: return self.currentContext().callWithContext(ctx, func, *args, **kw)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/python/context.py", line 82, in callWithContext
Nov 11 20:26:45 cloud.mydomain.com python[16207]: return func(*args, **kw)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/enterprise/adbapi.py", line 282, in _runWithConnection
Nov 11 20:26:45 cloud.mydomain.com python[16207]: result = func(conn, *args, **kw)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 1040, in inner_func
Nov 11 20:26:45 cloud.mydomain.com python[16207]: return func(db_conn, *args, **kwargs)
Nov 11 20:26:45 cloud.mydomain.com python[16207]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 798, in new_transaction
Nov 11 20:26:45 cloud.mydomain.com python[16207]: conn.rollback()
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/synapse/storage/database.py", line 213, in rollback
Nov 11 20:26:45 cloud.mydomain.com python[16207]: self.conn.rollback()
Nov 11 20:26:45 cloud.mydomain.com python[16207]: File "/opt/yunohost/matrix-synapse/lib/python3.11/site-packages/twisted/enterprise/adbapi.py", line 66, in rollback
Nov 11 20:26:45 cloud.mydomain.com python[16207]: raise ConnectionLost()
Nov 11 20:26:45 cloud.mydomain.com python[16207]: twisted.enterprise.adbapi.ConnectionLost
edit: I am still investigating my case, maybe I sould have mentionned that my first attempt of upgrade has failed (It seems to went well with the 2nd try after rebooting) here is the YunoPaste Log of the failed attempt:
https://paste.yunohost.org/raw/woxogaxora
The text was updated successfully, but these errors were encountered: