scylladb / scylladb

NoSQL data store using the seastar framework, compatible with Apache Cassandra
http://scylladb.com
GNU Affero General Public License v3.0
13.52k stars 1.29k forks source link

Can't connect to scylla housekeeper #12822

Open lapisz1 opened 1 year ago

lapisz1 commented 1 year ago

Everything works fine except I got an error when I deployed scylladb 5.X.Y. Scylladb version: 5.1.3 Instance family: r6g (ARM64) Image: Amazon linux 2 Volume: ebs Deployment: kubernetes statefulset Traceback (most recent call last): File "/opt/scylladb/scripts/libexec/scylla-housekeeping", line 196, in args.func(args) File "/opt/scylladb/scripts/libexec/scylla-housekeeping", line 122, in check_version current_version = sanitize_version(get_api('/storage_service/scylla_release_version')) File "/opt/scylladb/scripts/libexec/scylla-housekeeping", line 80, in get_api return get_json_from_url("http://" + api_address + path) File "/opt/scylladb/scripts/libexec/scylla-housekeeping", line 75, in get_json_from_url raise RuntimeError(f'Failed to get "{path}" due to the following error: {retval}') BTW scylladb version 4.6.11 doesn't appear this error message and housekeeper is working properly.

fruch commented 1 year ago

@lapisz1 can you supply a bit more full log of the problematic pod in question ?

also is something else isn't working ? beside this backtrace print ? i.e. the housekeeping failure shouldn't be blocking anything.

also are you using scylla-operator here ?

mykaul commented 1 year ago

I'm surprised it tries with HTTP, but I'm not sure if it's even related. @amnonh - thoughts?

amnonh commented 1 year ago

I just did a test with https and saw that I got a correct reply, maybe it's a network issue?

On Tue, Feb 14, 2023 at 10:14 AM Yaniv Kaul @.***> wrote:

I'm surprised it tries with HTTP, but I'm not sure if it's even related. @amnonh https://github.com/amnonh - thoughts?

— Reply to this email directly, view it on GitHub https://github.com/scylladb/scylladb/issues/12822#issuecomment-1429306104, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAQFDPYNEYU2LK5JUKXWKTTWXM5HBANCNFSM6AAAAAAU2HADCU . You are receiving this because you were mentioned.Message ID: @.***>