search

matrix-construct / construct

This is The Construct
Other
369 stars 43 forks source link

Lockup after undefined symbol jpeg_LTX_RegisterJPEGImage in thumbnail request. #100

Open Valinwolf opened 5 years ago

Valinwolf commented 5 years ago 
1564624942.519859      0 CRITICAL *                0 *          :DEADSTART
1564624942.519930      0    ERROR *                0 *          :DEADSTART
1564624942.519939      0  WARNING *                0 *          :DEADSTART
1564624942.519945      0   NOTICE *                0 *          :DEADSTART
1564624942.519955      0     INFO *                0 *          :DEADSTART
1564624942.519961      0    ERROR *                0 *          :DEADSTART
1564624942.519971      0  WARNING *                0 *          :DEADSTART
1564624942.519983      0     INFO ircd             0 *          :7364a4d9b configured: Wed Jul 31 17:49:56 2019; compiled: Wed Jul 31 17:39:23 2019; executed: Wed Jul 31 17:49:56 2019; (DEBUG MODE)
1564624942.519998      0     INFO ircd             0 *          :SD-6 201703. glibcxx 20190223. glibc 6.2.28. boost 1.66.0. RocksDB 5.16.6. sodium 1.0.18. OpenSSL 1.1.1c FIPS  28 May 2019. magic 534.
1564624942.520015      0     INFO ircd             0 *          :Linked: glibc 2.28. boost 0. RocksDB 0. sodium 1.0.18. OpenSSL 1.1.1c FIPS  28 May 2019. magic 534.
1564624942.520025      0     INFO ircd             0 *          :Linux srv1.octal.ventures 5.1.18-200.fc29.x86_64 #1 SMP Mon Jul 15 16:09:08 UTC 2019 x86_64
1564624942.520124      0   NOTICE ircd             0 *          :IRCd READY
1564624942.520274      1   NOTICE ircd             0 *          :IRCd START
1564624942.520574      1  WARNING net              1 main       :IPv6 is disabled by the configuration. Not checking for usable interfaces.
1564624942.528037      1     INFO db               1 main       :Using database directory at `/usr/local/var/db/construct'
1564624942.531785     98     INFO matrix           1 main       :Certificate `/root/w0lfr.net.crt' :PEM 973 bytes; DER 677 bytes; sha256b64 Dp8JU3PIy3UPSnluXvZ8QYzmVrR14yIWgHgTl4iZYA8
1564624942.531886     98     INFO matrix           1 main       :Certificate `/root/w0lfr.net.crt' :CN = w0lfr.net
1564624942.531918     98     INFO matrix           1 main       :Using ed25519 secret key @ `/root/w0lfr.net.ed25519'
1564624942.532018     99     INFO matrix           1 main       :Current key is 'ed25519:DuBrwmJA' and the public key is: MTta8emPcqiOki3dJ0cGiX2OfFH/RNk1/naAhAlvgjg
1564624942.532039     99     INFO modules          1 main       :Loaded module m_keys :Server keys
1564624942.532066     99     INFO db               1 main       :Using database directory at `/usr/local/var/db/construct/w0lfr.net'
1564624942.533068    102     INFO db               1 main       :Opening database "events" @ `/usr/local/var/db/construct/w0lfr.net/events/0' with 20 columns...
1564624942.625966    201     INFO db               1 main       :[events] Opened database @ `/usr/local/var/db/construct/w0lfr.net/events/0' with 20 columns at sequence number 8938.
1564624942.628346    201     INFO modules          1 main       :Loaded module net_dns :Domain Name System Client, Cache & Components
1564624942.649500    212     INFO modules          1 main       :Loaded module conf :Server Configuration
1564624942.650002    212     INFO modules          1 main       :Loaded module m_noop :No Operation
1564624942.650566    212     INFO modules          1 main       :Loaded module m_node :Server Nodes
1564624942.651726    212     INFO modules          1 main       :Loaded module m_fetch :Event Fetch Unit
1564624942.652236    212     INFO modules          1 main       :Loaded module m_feds :Federation :General Library and Utils
1564624942.652821    212     INFO modules          1 main       :Loaded module m_events :Matrix events library
1564624942.653564    212     INFO modules          1 main       :Loaded module m_rooms :Matrix rooms interface; modular components
1564624942.653983    212     INFO modules          1 main       :Loaded module m_user :Matrix user library; modular components.
1564624942.654394    212     INFO modules          1 main       :Loaded module m_user_rooms :Matrix rooms for a user.
1564624942.654787    212     INFO modules          1 main       :Loaded module m_user_events :Matrix events for a user.
1564624942.655572    212     INFO modules          1 main       :Loaded module m_user_highlight :Matrix user library; highlight notification support
1564624942.656299    212     INFO modules          1 main       :Loaded module m_user_profile :Matrix user profiles.
1564624942.656762    212     INFO modules          1 main       :Loaded module m_room_timeline :Matrix room library; timeline modular components.
1564624942.657696    212     INFO modules          1 main       :Loaded module m_room_aliases :Matrix m.room.aliases
1564624942.658231    212     INFO modules          1 main       :Loaded module m_room_canonical_alias :Matrix m.room.canonical_alias
1564624942.658892    212     INFO modules          1 main       :Loaded module m_room_create :Matrix m.room.create
1564624942.659528    212     INFO modules          1 main       :Loaded module m_room_history_visibility :Matrix m.room.history_visibility
1564624942.660280    212     INFO modules          1 main       :Loaded module m_room_join_rules :Matrix m.room.join_rules
1564624942.661533    212     INFO modules          1 main       :Loaded module m_room_member :Matrix m.room.member
1564624942.662042    212     INFO modules          1 main       :Loaded module m_room_third_party_invite :Matrix m.room.third_party_invite
1564624942.662521    212     INFO modules          1 main       :Loaded module m_room_message :Matrix m.room.message
1564624942.663093    212     INFO modules          1 main       :Loaded module m_room_power_levels :Matrix m.room.power_levels
1564624942.663953    212     INFO modules          1 main       :Loaded module m_room_server_acl :Matrix Room Server Access Control List
1564624942.664587    212     INFO modules          1 main       :Loaded module m_room_redaction :Matrix m.room.redaction
1564624942.666378    212     INFO modules          1 main       :Loaded module m_room_bootstrap :Matrix room bootstrap.
1564624942.667078    212     INFO modules          1 main       :Loaded module m_presence :Matrix Presence
1564624942.667692    212     INFO modules          1 main       :Loaded module m_receipt :Matrix Receipts
1564624942.668448    212     INFO modules          1 main       :Loaded module m_typing :Matrix Typing
1564624942.669012    212     INFO modules          1 main       :Loaded module m_device_list_update :Matrix Device List Update
1564624942.669532    212     INFO modules          1 main       :Loaded module m_device :Matrix device library; modular components.
1564624942.670056    212     INFO modules          1 main       :Loaded module m_direct :Client 14.23 :Direct Messaging
1564624942.670598    212     INFO modules          1 main       :Loaded module m_direct_to_device :Matrix Direct To Device
1564624942.671063    212     INFO modules          1 main       :Loaded module m_breadcrumb_rooms :Matrix Breadcrumb Rooms
1564624942.671649    212     INFO modules          1 main       :Loaded module m_ignored_user_list :14.24 :Ignoring Users
1564624942.672087    212     INFO modules          1 main       :Loaded module key_server :Federation 2.2.1.1 :Publishing Keys
1564624942.672558    212     INFO modules          1 main       :Loaded module identity_pubkey :Identity Service 7 :Key management
1564624942.672995    212     INFO modules          1 main       :Loaded module identity_v1 :Identity Service 6 :Status Check
1564624942.674964    220     INFO db               1 main       :Opening database "media" @ `/usr/local/var/db/construct/w0lfr.net/media/0' with 2 columns...
1564624942.687149    260     INFO db               1 main       :[media] Opened database @ `/usr/local/var/db/construct/w0lfr.net/media/0' with 2 columns at sequence number 24.
1564624942.690761    260     INFO magick           1 main       :Initializing Magick Library version API:2301952 [1.3.32] ABI:2301952 [GraphicsMagick 1.3.32 2019-06-15 Q16 http://www.GraphicsMagick.org/]
1564624942.691026    260     INFO modules          1 main       :Loaded module magick :GraphicsMagick Library support for media manipulation
1564624942.691052    260     INFO modules          1 main       :Loaded module media_media :11.7 :Content respository
1564624942.691762    260     INFO modules          1 main       :Loaded module m_command :Server Command
1564624942.692445    260     INFO modules          1 main       :Loaded module m_control :Server Control
1564624942.692889    260     INFO modules          1 main       :Loaded module well_known :RFC5785 /.well-known/ support
1564624942.693681    260     INFO modules          1 main       :Loaded module webhook :Webhook Handler
1564624942.694182    260     INFO modules          1 main       :Loaded module stats :Prometheus Metrics
1564624942.695006    260     INFO modules          1 main       :Loaded module federation_backfill_ids :federation backfill event IDs
1564624942.696179    260     INFO modules          1 main       :Loaded module federation_backfill :federation backfill
1564624942.697101    260     INFO modules          1 main       :Loaded module federation_event_auth :federation event_auth (undocumented)
1564624942.697830    260     INFO modules          1 main       :Loaded module federation_event :federation event
1564624942.698287    260     INFO modules          1 main       :Loaded module federation_get_groups_publicised :Federation (undocumented) :Get groups publicised.
1564624942.699419    260     INFO modules          1 main       :Loaded module federation_get_missing_events :Federation (undocumented) :Get missing events.
1564624942.700205    260     INFO modules          1 main       :Loaded module federation_invite :Federation 10 :Inviting to a room
1564624942.700965    260     INFO modules          1 main       :Loaded module federation_invite2 :Federation 12 :Inviting to a room (v2)
1564624942.701460    260     INFO modules          1 main       :Loaded module federation_make_join :Federation :Request a prototype for creating a join event.
1564624942.701937    260     INFO modules          1 main       :Loaded module federation_make_leave :Federation :Request a prototype for creating a leave event.
1564624942.702529    260     INFO modules          1 main       :Loaded module federation_publicrooms :Federation 14.1 :Public Rooms
1564624942.702994    260     INFO modules          1 main       :Loaded module federation_query_auth :Federation 5.1.5.2 :Query Auth
1564624942.703500    260     INFO modules          1 main       :Loaded module federation_query :Federation :Query
1564624942.704378    260     INFO modules          1 main       :Loaded module federation_sender :federation sender
1564624942.705089    260     INFO modules          1 main       :Loaded module federation_send_join :Federation :Send join event
1564624942.705617    260     INFO modules          1 main       :Loaded module federation_send_leave :Federation :Send leave event
1564624942.706331    260     INFO modules          1 main       :Loaded module federation_send :federation send
1564624942.706838    260     INFO modules          1 main       :Loaded module federation_state_ids :federation state_ids
1564624942.707637    260     INFO modules          1 main       :Loaded module federation_state :federation state
1564624942.708151    260     INFO modules          1 main       :Loaded module federation_user_devices :Federation 20 :Device Management
1564624942.708606    260     INFO modules          1 main       :Loaded module federation_user_keys_claim :Federation 21 :End-to-End Encryption
1564624942.709066    260     INFO modules          1 main       :Loaded module federation_user_keys_query :Federation 21 :End-to-End Encryption
1564624942.709516    260     INFO modules          1 main       :Loaded module federation_version :Federation 2.2 :Version
1564624942.710017    260     INFO modules          1 main       :Loaded module client_account :Client 3.4,3.5,3.6 :Account
1564624942.710687    260     INFO modules          1 main       :Loaded module client_user :Client X.X :User endpoints
1564624942.711169    260     INFO modules          1 main       :Loaded module client_profile :Client 8.2 :Profiles
1564624942.711644    260     INFO modules          1 main       :Loaded module client_capabilities :Client 6 :Capabilities Negotiation
1564624942.712389    260     INFO modules          1 main       :Loaded module client_createroom :Client 7.1.1 :Create Room
1564624942.713154    260     INFO modules          1 main       :Loaded module client_delete_devices :Client 14.10.1.5 :Device Management
1564624942.713752    260     INFO modules          1 main       :Loaded module client_devices :Client 11.9 Device Management
1564624942.714295    260     INFO modules          1 main       :Loaded module client_directory_list_appservice :Application Service 2.3.5 :Application service room directories
1564624942.714831    260     INFO modules          1 main       :Loaded module client_directory_list_room :Client 10.5 :Listing rooms
1564624942.715343    260     INFO modules          1 main       :Loaded module client_directory_room :Client 7.2 :Room aliases
1564624942.715863    260     INFO modules          1 main       :Loaded module client_directory_user :Client 8.1 :User Directory
1564624942.717226    260     INFO modules          1 main       :Loaded module client_events :Client 14.17.1.1 :Room Previews
1564624942.718160    260     INFO modules          1 main       :Loaded module client_initialsync :Client 6.2.3 :initialSync
1564624942.718629    260     INFO modules          1 main       :Loaded module client_joined_groups :Client (unspecified) :Joined Groups
1564624942.719106    260     INFO modules          1 main       :Loaded module client_join :Client 7.4.2.3 :Join
1564624942.719560    260     INFO modules          1 main       :Loaded module client_keys_changes :Client 14.11.5.2 :Key management API
1564624942.720331    260     INFO modules          1 main       :Loaded module client_keys_claim :Client 14.11.5.2 :Key management API
1564624942.721157    260     INFO modules          1 main       :Loaded module client_keys_query :Client 14.11.5.2 :Key management API
1564624942.721731    260     INFO modules          1 main       :Loaded module client_keys_upload :Client 14.11.5.2 :Key management API
1564624942.722301    260     INFO modules          1 main       :Loaded module client_login :Client 3.3 :Login
1564624942.722780    260     INFO modules          1 main       :Loaded module client_logout :Client 3.3.2 :Logout
1564624942.723324    260     INFO modules          1 main       :Loaded module client_notifications :Client 14.13.1.3 :Listing Notifications
1564624942.723913    260     INFO modules          1 main       :Loaded module client_presence :Client 11.6 :Presence
1564624942.724355    260     INFO modules          1 main       :Loaded module client_publicised_groups :Client (unspecified) :Publicised Groups
1564624942.725025    260     INFO modules          1 main       :Loaded module client_publicrooms :Client 7.5 :Public Rooms
1564624942.725509    260     INFO modules          1 main       :Loaded module client_pushers :Client 11.12 :Pushers
1564624942.725986    260     INFO modules          1 main       :Loaded module client_pushrules :Client 11.12.1.5 :Push Rules API
1564624942.726517    260     INFO modules          1 main       :Loaded module client_register_available :Client 3.4.1 :Register Available
1564624942.727526    260     INFO modules          1 main       :Loaded module client_register :Client 3.4.1 :Register
1564624942.729793    260     INFO modules          1 main       :Loaded module client_rooms :Client 7 :Rooms
1564624942.730274    260     INFO modules          1 main       :Loaded module client_search :Client 11.14 :Server Side Search
1564624942.730798    260     INFO modules          1 main       :Loaded module client_send_to_device :Client 14.9 :Send-to-Device messaging
1564624942.731525    260     INFO modules          1 main       :Loaded module client_sync_account_data :Client Sync :Account Data
1564624942.732131    260     INFO modules          1 main       :Loaded module client_sync_device_lists :Client Sync :Device Lists
1564624942.732833    260     INFO modules          1 main       :Loaded module client_sync_device_one_time_keys_count :Client Sync :Device One Time Keys Count
1564624942.733518    260     INFO modules          1 main       :Loaded module client_sync_presence :Client Sync :Presence
1564624942.734170    260     INFO modules          1 main       :Loaded module client_sync_rooms_account_data :Client Sync :Room Account Data
1564624942.734929    260     INFO modules          1 main       :Loaded module client_sync_rooms_ephemeral_receipt :Client Sync :Room Ephemeral :Receipts
1564624942.735555    260     INFO modules          1 main       :Loaded module client_sync_rooms_ephemeral :Client Sync :Rooms Ephemeral
1564624942.736176    260     INFO modules          1 main       :Loaded module client_sync_rooms_ephemeral_typing :Client Sync :Room Ephemeral :Typing
1564624942.736871    260     INFO modules          1 main       :Loaded module client_sync_rooms :Client Sync :Rooms
1564624942.737814    260     INFO modules          1 main       :Loaded module client_sync_rooms_state :Client Sync :Room State
1564624942.738992    260     INFO modules          1 main       :Loaded module client_sync_rooms_timeline :Client Sync :Room Timeline
1564624942.739684    260     INFO modules          1 main       :Loaded module client_sync_rooms_unread_notifications :Client Sync :Room Unread Notifications
1564624942.740319    260     INFO modules          1 main       :Loaded module client_sync_rooms_summary :Client Sync :Room Summary
1564624942.742569    260     INFO modules          1 main       :Loaded module client_sync :Client 6.2.1 :Sync
1564624942.743223    260     INFO modules          1 main       :Loaded module client_sync_to_device :Client Sync :To Device
1564624942.743707    260     INFO modules          1 main       :Loaded module client_thirdparty_protocols :Client (unstable) (no-section) :Third party protocols
1564624942.744364    260     INFO modules          1 main       :Loaded module client_versions :Client 2.1 :Versions
1564624942.745258    260     INFO modules          1 main       :Loaded module client_voip_turnserver :Client 11.3 :Voice over IP
1564624942.746001    260     INFO modules          1 main       :Loaded module index :Web root content resource
1564624942.747855    260     INFO net.listen       1 main       :[matrix] @ [::]:8448 using certificate chain file '/etc/letsencrypt/live/w0lfr.net/fullchain.pem'
1564624942.748028    260     INFO net.listen       1 main       :[matrix] @ [::]:8448 using certificate file '/etc/letsencrypt/live/w0lfr.net/cert.pem'
1564624942.748124    260     INFO net.listen       1 main       :[matrix] @ [::]:8448 using private key file '/etc/letsencrypt/live/w0lfr.net/privkey.pem'
1564624942.748717    260     INFO modules          1 main       :Loaded module m_listen :Server listeners
1564624942.750933    260     INFO matrix.vm        1 main       :BOOT w0lfr.net @500 [$LA_wW0WO0nygh0dhpom7ojL0waKxgRj6knz8ZQw9BR8]
1564624942.750965    260     INFO modules          1 main       :Loaded module m_vm :Matrix Virtual Machine
1564624942.755624    266   NOTICE ircd             0 *          :IRCd RUN
1564624945.706626    358    ERROR modules         54 client     :dynamic linker (0) symbol lookup error in `/usr/lib64/GraphicsMagick-1.3.32/modules-Q16/coders/jpeg.so' :undefined symbol: jpeg_LTX_RegisterJPEGImage
1564624945.707091    358    ERROR client          54 client     :socket:9 local:167.99.96.20:8448 remote:70.125.158.67:35090 client:8 req:1:1 HTTP 500 Internal Error `/_matrix/media/r0/thumbnail/w0lfr.net/WqgzKghmVkgLLyJzGiktIgdpcJTAFxJM?width=28&height=28&method=crop' :error :symbol lookup error in /usr/lib64/GraphicsMagick-1.3.32/modules-Q16/coders/jpeg.so (0) undefined symbol: jpeg_LTX_RegisterJPEGImage
1564624945.707265    359    ERROR resource        54 client     :socket:9 local:167.99.96.20:8448 remote:70.125.158.67:35090 client:8 req:1:1 HTTP 500 `/_matrix/media/r0/thumbnail/w0lfr.net/WqgzKghmVkgLLyJzGiktIgdpcJTAFxJM' Internal Server Error in 3.82ms; text/html; charset=utf-8 content-length:138 wrote:161 
1564624953.207752    400    ERROR client          54 client     :socket:9 local:167.99.96.20:8448 remote:70.125.158.67:35090 client:8 req:1:1 fault :Connection timed out
1564624958.494524    402    ERROR client           0 *          :socket:6 local:167.99.96.20:8448 remote:70.125.158.67:35088 client:7 req:0:0 :system: Connection reset by peer
jevolk commented 5 years ago

Is this a deadlock (everything stops) or a livelock (CPU pegs 100%)?

Valinwolf commented 5 years ago

I'm going to say deadlock because the CPU is nowhere near 100%. Construct doesn't crash, it just stops responding to anything (ctrl-c, ctrl-\, etc.) The only thing you can do is send kill -9.

Valinwolf commented 5 years ago

Rebuilding without GraphicsMagick stops the error.

jevolk commented 5 years ago

While the underlying problem is being addressed, you might have some luck with disabling jpeg thumbnails in the configuration at the console:

conf set ircd.m.media.thumbnail.mime.blacklist image/jpeg