Closed emre141 closed 1 year ago
Hi,
Could you share the logs of the other pods? Could you re-try the experiment with image.debug=true
. Also, could you ensure that there are no leftover PVCs from previous installations?
@javsalgar ,
I have completely uninstall mongodb helm release and clean all pvc, pv and ebs volume, afterward I used below command to install,
helm upgrade --install mongprod-test my-repo/mongodb --version=13.5.0 -f values.prod-rs.yaml --set auth.rootPassword=root123,auth.replicaSetKey=mongoprod --set image.debug=true --debug --atomic --wait --timeout 5m
POD Status
emre@MACFVFF76H8Q05P:/tmp|⇒ kubectl get pods
NAME READY STATUS RESTARTS AGE
mongo-prod-rs-0 1/1 Running 0 15m
mongo-prod-rs-1 1/1 Running 0 14m
mongo-prod-rs-arbiter-0 0/1 Error 3 15m
PVC Status
NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE
datadir-mongo-prod-rs-0 Bound pvc-daf9587b-44f4-4dd6-a2c6-bea073b2e7f4 10Gi RWO gp2-new 15m
datadir-mongo-prod-rs-1 Bound pvc-6477a3c2-af1f-4638-a316-38557c6df77b 10Gi RWO
mongo arbiter pod logs
mongodb 19:55:19.97
mongodb 19:55:19.97 Welcome to the Bitnami mongodb container
mongodb 19:55:19.97 Subscribe to project updates by watching https://github.com/bitnami/containers
mongodb 19:55:19.97 Submit issues and feature requests at https://github.com/bitnami/containers/issues
mongodb 19:55:19.97
mongodb 19:55:19.98 INFO ==> ** Starting MongoDB setup **
mongodb 19:55:19.99 INFO ==> Validating settings in MONGODB_* env vars...
mongodb 19:55:20.02 INFO ==> Initializing MongoDB...
mongodb 19:55:20.03 INFO ==> Deploying MongoDB from scratch...
mongodb 19:55:20.03 DEBUG ==> Starting MongoDB in background...
{"t":{"$date":"2022-11-30T19:55:20.050Z"},"s":"I", "c":"CONTROL", "id":5760901, "ctx":"-","msg":"Applied --setParameter options","attr":{"serverParameters":{"enableLocalhostAuthBypass":{"default":true,"value":true}}}}
about to fork child process, waiting until server is ready for connections.
forked process: 45
child process started successfully, parent exiting
MongoNetworkError: connect ECONNREFUSED 172.16.4.164:27017
mongodb 19:55:21.54 INFO ==> Creating users...
mongodb 19:55:21.54 INFO ==> Users created
mongodb 19:55:21.54 INFO ==> Writing keyfile for replica set authentication...
mongodb 19:55:21.56 INFO ==> Configuring MongoDB replica set...
mongodb 19:55:21.56 INFO ==> Stopping MongoDB...
mongodb 19:55:22.57 DEBUG ==> Starting MongoDB in background...
{"t":{"$date":"2022-11-30T19:55:22.606Z"},"s":"I", "c":"CONTROL", "id":5760901, "ctx":"-","msg":"Applied --setParameter options","attr":{"serverParameters":{"enableLocalhostAuthBypass":{"default":true,"value":true}}}}
about to fork child process, waiting until server is ready for connections.
forked process: 138
child process started successfully, parent exiting
mongodb 19:55:25.35 DEBUG ==> Waiting for primary node...
mongodb 19:55:25.36 DEBUG ==> Waiting for primary node...
mongodb 19:55:25.36 INFO ==> Trying to connect to MongoDB server mongo-prod-rs-0.mongo-prod-rs-headless.infra.svc.cluster.local...
cannot resolve host "mongo-prod-rs-0.mongo-prod-rs-headless.infra.svc.cluster.local": lookup mongo-prod-rs-0.mongo-prod-rs-headless.infra.svc.cluster.local: no such host
cannot resolve host "mongo-prod-rs-0.mongo-prod-rs-headless.infra.svc.cluster.local": lookup mongo-prod-rs-0.mongo-prod-rs-headless.infra.svc.cluster.local: no such host
mongodb 19:55:35.39 INFO ==> Found MongoDB server listening at mongo-prod-rs-0.mongo-prod-rs-headless.infra.svc.cluster.local:27017 !
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
mongodb primary pod log
{"t":{"$date":"2022-11-30T19:55:31.521Z"},"s":"I", "c":"CONTROL", "id":5760901, "ctx":"-","msg":"Applied --setParameter options","attr":{"serverParameters":{"enableLocalhostAuthBypass":{"default":true,"value":false}}}}
{"t":{"$date":"2022-11-30T19:55:31.521+00:00"},"s":"I", "c":"CONTROL", "id":20698, "ctx":"-","msg":"***** SERVER RESTARTED *****"}
{"t":{"$date":"2022-11-30T19:55:31.521+00:00"},"s":"I", "c":"NETWORK", "id":4915701, "ctx":"-","msg":"Initialized wire specification","attr":{"spec":{"incomingExternalClient":{"minWireVersion":0,"maxWireVersion":17},"incomingInternalClient":{"minWireVersion":0,"maxWireVersion":17},"outgoing":{"minWireVersion":6,"maxWireVersion":17},"isInternalClient":true}}}
{"t":{"$date":"2022-11-30T19:55:31.521+00:00"},"s":"I", "c":"CONTROL", "id":23285, "ctx":"-","msg":"Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'"}
{"t":{"$date":"2022-11-30T19:55:31.522+00:00"},"s":"I", "c":"NETWORK", "id":4648601, "ctx":"main","msg":"Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize."}
{"t":{"$date":"2022-11-30T19:55:31.535+00:00"},"s":"I", "c":"REPL", "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"TenantMigrationDonorService","namespace":"config.tenantMigrationDonors"}}
[38;5;6mmongodb [38;5;5m19:55:31.50 [0m[38;5;2mINFO [0m ==> ** Starting MongoDB **
{"t":{"$date":"2022-11-30T19:55:31.521Z"},"s":"I", "c":"CONTROL", "id":5760901, "ctx":"-","msg":"Applied --setParameter options","attr":{"serverParameters":{"enableLocalhostAuthBypass":{"default":true,"value":false}}}}
{"t":{"$date":"2022-11-30T19:55:31.521+00:00"},"s":"I", "c":"CONTROL", "id":20698, "ctx":"-","msg":"***** SERVER RESTARTED *****"}
{"t":{"$date":"2022-11-30T19:55:31.521+00:00"},"s":"I", "c":"NETWORK", "id":4915701, "ctx":"-","msg":"Initialized wire specification","attr":{"spec":{"incomingExternalClient":{"minWireVersion":0,"maxWireVersion":17},"incomingInternalClient":{"minWireVersion":0,"maxWireVersion":17},"outgoing":{"minWireVersion":6,"maxWireVersion":17},"isInternalClient":true}}}
{"t":{"$date":"2022-11-30T19:55:31.521+00:00"},"s":"I", "c":"CONTROL", "id":23285, "ctx":"-","msg":"Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'"}
{"t":{"$date":"2022-11-30T19:55:31.522+00:00"},"s":"I", "c":"NETWORK", "id":4648601, "ctx":"main","msg":"Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize."}
{"t":{"$date":"2022-11-30T19:55:31.535+00:00"},"s":"I", "c":"REPL", "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"TenantMigrationDonorService","namespace":"config.tenantMigrationDonors"}}
{"t":{"$date":"2022-11-30T19:55:31.535+00:00"},"s":"I", "c":"REPL", "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"TenantMigrationRecipientService","namespace":"config.tenantMigrationRecipients"}}
{"t":{"$date":"2022-11-30T19:55:31.535+00:00"},"s":"I", "c":"REPL", "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"ShardSplitDonorService","namespace":"config.tenantSplitDonors"}}
{"t":{"$date":"2022-11-30T19:55:31.535+00:00"},"s":"I", "c":"CONTROL", "id":5945603, "ctx":"main","msg":"Multi threading initialized"}
{"t":{"$date":"2022-11-30T19:55:31.535+00:00"},"s":"I", "c":"CONTROL", "id":4615611, "ctx":"initandlisten","msg":"MongoDB starting","attr":{"pid":1,"port":27017,"dbPath":"/bitnami/mongodb/data/db","architecture":"64-bit","host":"mongo-prod-rs-0"}}
{"t":{"$date":"2022-11-30T19:55:31.535+00:00"},"s":"W", "c":"CONTROL", "id":20720, "ctx":"initandlisten","msg":"Memory available to mongo process is less than total system memory","attr":{"availableMemSizeMB":30720,"systemMemSizeMB":31594}}
{"t":{"$date":"2022-11-30T19:55:31.535+00:00"},"s":"I", "c":"CONTROL", "id":23403, "ctx":"initandlisten","msg":"Build Info","attr":{"buildInfo":{"version":"6.0.3","gitVersion":"f803681c3ae19817d31958965850193de067c516","openSSLVersion":"OpenSSL 1.1.1n 15 Mar 2022","modules":[],"allocator":"tcmalloc","environment":{"distmod":"debian11","distarch":"x86_64","target_arch":"x86_64"}}}}
{"t":{"$date":"2022-11-30T19:55:31.535+00:00"},"s":"I", "c":"CONTROL", "id":51765, "ctx":"initandlisten","msg":"Operating System","attr":{"os":{"name":"PRETTY_NAME=\"Debian GNU/Linux 11 (bullseye)\"","version":"Kernel 5.4.209-116.367.amzn2.x86_64"}}}
{"t":{"$date":"2022-11-30T19:55:31.535+00:00"},"s":"I", "c":"CONTROL", "id":21951, "ctx":"initandlisten","msg":"Options set by command line","attr":{"options":{"config":"/opt/bitnami/mongodb/conf/mongodb.conf","net":{"bindIp":"*","ipv6":false,"port":27017,"unixDomainSocket":{"enabled":true,"pathPrefix":"/opt/bitnami/mongodb/tmp"}},"processManagement":{"fork":false,"pidFilePath":"/opt/bitnami/mongodb/tmp/mongodb.pid"},"replication":{"enableMajorityReadConcern":true,"replSetName":"prodrs"},"security":{"authorization":"enabled","keyFile":"/opt/bitnami/mongodb/conf/keyfile"},"setParameter":{"enableLocalhostAuthBypass":"false"},"storage":{"dbPath":"/bitnami/mongodb/data/db","directoryPerDB":false,"engine":"wiredTiger","journal":{"enabled":true},"wiredTiger":{"engineConfig":{"cacheSizeGB":5}}},"systemLog":{"destination":"file","logAppend":true,"logRotate":"reopen","path":"/opt/bitnami/mongodb/logs/mongodb.log","quiet":false,"verbosity":0}}}}
{"t":{"$date":"2022-11-30T19:55:31.536+00:00"},"s":"I", "c":"STORAGE", "id":22297, "ctx":"initandlisten","msg":"Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem","tags":["startupWarnings"]}
{"t":{"$date":"2022-11-30T19:55:31.536+00:00"},"s":"I", "c":"STORAGE", "id":22315, "ctx":"initandlisten","msg":"Opening WiredTiger","attr":{"config":"create,cache_size=5120M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,remove=true,path=journal,compressor=snappy),builtin_extension_config=(zstd=(compression_level=6)),file_manager=(close_idle_time=600,close_scan_interval=10,close_handle_minimum=2000),statistics_log=(wait=0),json_output=(error,message),verbose=[recovery_progress:1,checkpoint_progress:1,compact_progress:1,backup:0,checkpoint:0,compact:0,evict:0,history_store:0,recovery:0,rts:0,salvage:0,tiered:0,timestamp:0,transaction:0,verify:0,log:0],"}}
{"t":{"$date":"2022-11-30T19:55:32.156+00:00"},"s":"I", "c":"STORAGE", "id":4795906, "ctx":"initandlisten","msg":"WiredTiger opened","attr":{"durationMillis":620}}
{"t":{"$date":"2022-11-30T19:55:32.156+00:00"},"s":"I", "c":"RECOVERY", "id":23987, "ctx":"initandlisten","msg":"WiredTiger recoveryTimestamp","attr":{"recoveryTimestamp":{"$timestamp":{"t":0,"i":0}}}}
{"t":{"$date":"2022-11-30T19:55:32.179+00:00"},"s":"W", "c":"CONTROL", "id":5123300, "ctx":"initandlisten","msg":"vm.max_map_count is too low","attr":{"currentValue":524288,"recommendedMinimum":1677720,"maxConns":838860},"tags":["startupWarnings"]}
{"t":{"$date":"2022-11-30T19:55:32.179+00:00"},"s":"I", "c":"REPL", "id":5853300, "ctx":"initandlisten","msg":"current featureCompatibilityVersion value","attr":{"featureCompatibilityVersion":"unset","context":"startup"}}
{"t":{"$date":"2022-11-30T19:55:32.179+00:00"},"s":"I", "c":"STORAGE", "id":5071100, "ctx":"initandlisten","msg":"Clearing temp directory"}
{"t":{"$date":"2022-11-30T19:55:32.179+00:00"},"s":"I", "c":"CONTROL", "id":20536, "ctx":"initandlisten","msg":"Flow Control is enabled on this deployment"}
{"t":{"$date":"2022-11-30T19:55:32.179+00:00"},"s":"I", "c":"FTDC", "id":20625, "ctx":"initandlisten","msg":"Initializing full-time diagnostic data capture","attr":{"dataDirectory":"/bitnami/mongodb/data/db/diagnostic.data"}}
{"t":{"$date":"2022-11-30T19:55:32.180+00:00"},"s":"I", "c":"STORAGE", "id":20320, "ctx":"initandlisten","msg":"createCollection","attr":{"namespace":"local.startup_log","uuidDisposition":"generated","uuid":{"uuid":{"$uuid":"f3550144-c5e5-4011-aca4-34645a981f3e"}},"options":{"capped":true,"size":10485760}}}
{"t":{"$date":"2022-11-30T19:55:32.196+00:00"},"s":"I", "c":"INDEX", "id":20345, "ctx":"initandlisten","msg":"Index build: done building","attr":{"buildUUID":null,"collectionUUID":{"uuid":{"$uuid":"f3550144-c5e5-4011-aca4-34645a981f3e"}},"namespace":"local.startup_log","index":"_id_","ident":"index-1--5902366791980714399","collectionIdent":"collection-0--5902366791980714399","commitTimestamp":null}}
{"t":{"$date":"2022-11-30T19:55:32.197+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"ReadConcernMajorityNotAvailableYet: Read concern majority reads are currently not possible.","nextWakeupMillis":200}}
{"t":{"$date":"2022-11-30T19:55:32.197+00:00"},"s":"I", "c":"REPL", "id":6015317, "ctx":"initandlisten","msg":"Setting new configuration state","attr":{"newState":"ConfigStartingUp","oldState":"ConfigPreStart"}}
{"t":{"$date":"2022-11-30T19:55:32.197+00:00"},"s":"I", "c":"REPL", "id":6005300, "ctx":"initandlisten","msg":"Starting up replica set aware services"}
{"t":{"$date":"2022-11-30T19:55:32.197+00:00"},"s":"I", "c":"REPL", "id":4280500, "ctx":"initandlisten","msg":"Attempting to create internal replication collections"}
{"t":{"$date":"2022-11-30T19:55:32.197+00:00"},"s":"I", "c":"STORAGE", "id":20320, "ctx":"initandlisten","msg":"createCollection","attr":{"namespace":"local.replset.oplogTruncateAfterPoint","uuidDisposition":"generated","uuid":{"uuid":{"$uuid":"12f09fa5-c7ef-41e6-9548-a9353d9c5591"}},"options":{}}}
{"t":{"$date":"2022-11-30T19:55:32.209+00:00"},"s":"I", "c":"INDEX", "id":20345, "ctx":"initandlisten","msg":"Index build: done building","attr":{"buildUUID":null,"collectionUUID":{"uuid":{"$uuid":"12f09fa5-c7ef-41e6-9548-a9353d9c5591"}},"namespace":"local.replset.oplogTruncateAfterPoint","index":"_id_","ident":"index-3--5902366791980714399","collectionIdent":"collection-2--5902366791980714399","commitTimestamp":null}}
{"t":{"$date":"2022-11-30T19:55:32.209+00:00"},"s":"I", "c":"STORAGE", "id":20320, "ctx":"initandlisten","msg":"createCollection","attr":{"namespace":"local.replset.minvalid","uuidDisposition":"generated","uuid":{"uuid":{"$uuid":"cd445050-a7f6-4a92-a5e4-5b0e998058e4"}},"options":{}}}
{"t":{"$date":"2022-11-30T19:55:32.223+00:00"},"s":"I", "c":"INDEX", "id":20345, "ctx":"initandlisten","msg":"Index build: done building","attr":{"buildUUID":null,"collectionUUID":{"uuid":{"$uuid":"cd445050-a7f6-4a92-a5e4-5b0e998058e4"}},"namespace":"local.replset.minvalid","index":"_id_","ident":"index-5--5902366791980714399","collectionIdent":"collection-4--5902366791980714399","commitTimestamp":null}}
{"t":{"$date":"2022-11-30T19:55:32.223+00:00"},"s":"I", "c":"STORAGE", "id":20320, "ctx":"initandlisten","msg":"createCollection","attr":{"namespace":"local.replset.election","uuidDisposition":"generated","uuid":{"uuid":{"$uuid":"cfcf5c8a-80a5-47c7-8a62-52681448bc8d"}},"options":{}}}
{"t":{"$date":"2022-11-30T19:55:32.235+00:00"},"s":"I", "c":"INDEX", "id":20345, "ctx":"initandlisten","msg":"Index build: done building","attr":{"buildUUID":null,"collectionUUID":{"uuid":{"$uuid":"cfcf5c8a-80a5-47c7-8a62-52681448bc8d"}},"namespace":"local.replset.election","index":"_id_","ident":"index-7--5902366791980714399","collectionIdent":"collection-6--5902366791980714399","commitTimestamp":null}}
{"t":{"$date":"2022-11-30T19:55:32.235+00:00"},"s":"I", "c":"REPL", "id":4280501, "ctx":"initandlisten","msg":"Attempting to load local voted for document"}
{"t":{"$date":"2022-11-30T19:55:32.235+00:00"},"s":"I", "c":"REPL", "id":21311, "ctx":"initandlisten","msg":"Did not find local initialized voted for document at startup"}
{"t":{"$date":"2022-11-30T19:55:32.235+00:00"},"s":"I", "c":"REPL", "id":4280502, "ctx":"initandlisten","msg":"Searching for local Rollback ID document"}
{"t":{"$date":"2022-11-30T19:55:32.235+00:00"},"s":"I", "c":"REPL", "id":21312, "ctx":"initandlisten","msg":"Did not find local Rollback ID document at startup. Creating one"}
{"t":{"$date":"2022-11-30T19:55:32.235+00:00"},"s":"I", "c":"STORAGE", "id":20320, "ctx":"initandlisten","msg":"createCollection","attr":{"namespace":"local.system.rollback.id","uuidDisposition":"generated","uuid":{"uuid":{"$uuid":"ef72dd4c-1d22-4bf7-a9e5-caad3138c5b4"}},"options":{}}}
{"t":{"$date":"2022-11-30T19:55:32.246+00:00"},"s":"I", "c":"INDEX", "id":20345, "ctx":"initandlisten","msg":"Index build: done building","attr":{"buildUUID":null,"collectionUUID":{"uuid":{"$uuid":"ef72dd4c-1d22-4bf7-a9e5-caad3138c5b4"}},"namespace":"local.system.rollback.id","index":"_id_","ident":"index-9--5902366791980714399","collectionIdent":"collection-8--5902366791980714399","commitTimestamp":null}}
{"t":{"$date":"2022-11-30T19:55:32.246+00:00"},"s":"I", "c":"REPL", "id":21531, "ctx":"initandlisten","msg":"Initialized the rollback ID","attr":{"rbid":1}}
{"t":{"$date":"2022-11-30T19:55:32.246+00:00"},"s":"I", "c":"REPL", "id":21313, "ctx":"initandlisten","msg":"Did not find local replica set configuration document at startup","attr":{"error":{"code":47,"codeName":"NoMatchingDocument","errmsg":"Did not find replica set configuration document in local.system.replset"}}}
{"t":{"$date":"2022-11-30T19:55:32.246+00:00"},"s":"I", "c":"REPL", "id":6015317, "ctx":"initandlisten","msg":"Setting new configuration state","attr":{"newState":"ConfigUninitialized","oldState":"ConfigStartingUp"}}
{"t":{"$date":"2022-11-30T19:55:32.246+00:00"},"s":"I", "c":"STORAGE", "id":20320, "ctx":"initandlisten","msg":"createCollection","attr":{"namespace":"local.system.views","uuidDisposition":"generated","uuid":{"uuid":{"$uuid":"23a64772-5771-4d3d-a967-55ce10251d4f"}},"options":{}}}
{"t":{"$date":"2022-11-30T19:55:32.256+00:00"},"s":"I", "c":"INDEX", "id":20345, "ctx":"initandlisten","msg":"Index build: done building","attr":{"buildUUID":null,"collectionUUID":{"uuid":{"$uuid":"23a64772-5771-4d3d-a967-55ce10251d4f"}},"namespace":"local.system.views","index":"_id_","ident":"index-11--5902366791980714399","collectionIdent":"collection-10--5902366791980714399","commitTimestamp":null}}
{"t":{"$date":"2022-11-30T19:55:32.257+00:00"},"s":"I", "c":"STORAGE", "id":22262, "ctx":"initandlisten","msg":"Timestamp monitor starting"}
{"t":{"$date":"2022-11-30T19:55:32.257+00:00"},"s":"I", "c":"CONTROL", "id":20714, "ctx":"LogicalSessionCacheRefresh","msg":"Failed to refresh session cache, will try again at the next refresh interval","attr":{"error":"NotYetInitialized: Replication has not yet been configured"}}
{"t":{"$date":"2022-11-30T19:55:32.258+00:00"},"s":"I", "c":"REPL", "id":40440, "ctx":"initandlisten","msg":"Starting the TopologyVersionObserver"}
{"t":{"$date":"2022-11-30T19:55:32.258+00:00"},"s":"I", "c":"CONTROL", "id":20712, "ctx":"LogicalSessionCacheReap","msg":"Sessions collection is not set up; waiting until next sessions reap interval","attr":{"error":"NamespaceNotFound: config.system.sessions does not exist"}}
{"t":{"$date":"2022-11-30T19:55:32.258+00:00"},"s":"I", "c":"REPL", "id":40445, "ctx":"TopologyVersionObserver","msg":"Started TopologyVersionObserver"}
{"t":{"$date":"2022-11-30T19:55:32.258+00:00"},"s":"I", "c":"NETWORK", "id":23015, "ctx":"listener","msg":"Listening on","attr":{"address":"/opt/bitnami/mongodb/tmp/mongodb-27017.sock"}}
{"t":{"$date":"2022-11-30T19:55:32.258+00:00"},"s":"I", "c":"NETWORK", "id":23015, "ctx":"listener","msg":"Listening on","attr":{"address":"0.0.0.0"}}
{"t":{"$date":"2022-11-30T19:55:32.258+00:00"},"s":"I", "c":"NETWORK", "id":23016, "ctx":"listener","msg":"Waiting for connections","attr":{"port":27017,"ssl":"off"}}
{"t":{"$date":"2022-11-30T19:55:32.397+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":400}}
{"t":{"$date":"2022-11-30T19:55:32.798+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":600}}
{"t":{"$date":"2022-11-30T19:55:33.399+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":800}}
{"t":{"$date":"2022-11-30T19:55:34.200+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":1000}}
{"t":{"$date":"2022-11-30T19:55:35.201+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":1200}}
{"t":{"$date":"2022-11-30T19:55:35.390+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:48298","uuid":"8fcd01d8-8d0f-49ec-970d-19da9be8cc9f","connectionId":1,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:35.390+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn1","msg":"Connection ended","attr":{"remote":"172.16.4.164:48298","uuid":"8fcd01d8-8d0f-49ec-970d-19da9be8cc9f","connectionId":1,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:55:36.217+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:48312","uuid":"da1f76fa-0f6f-411d-a023-00737764d250","connectionId":2,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:36.220+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn2","msg":"client metadata","attr":{"remote":"172.16.4.164:48312","client":"conn2","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:36.226+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:48328","uuid":"ca7722c2-0a63-449e-9494-e9a4435f3058","connectionId":3,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:55:36.227+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn3","msg":"client metadata","attr":{"remote":"172.16.4.164:48328","client":"conn3","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:36.227+00:00"},"s":"I", "c":"ACCESS", "id":20251, "ctx":"conn3","msg":"Supported SASL mechanisms requested for unknown user","attr":{"user":{"user":"root","db":"admin"}}}
{"t":{"$date":"2022-11-30T19:55:36.227+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn3","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-256","speculative":true,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:48328","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:55:36.228+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn3","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-1","speculative":false,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:48328","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:55:36.230+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn2","msg":"Connection ended","attr":{"remote":"172.16.4.164:48312","uuid":"da1f76fa-0f6f-411d-a023-00737764d250","connectionId":2,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:36.238+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn3","msg":"Connection ended","attr":{"remote":"172.16.4.164:48328","uuid":"ca7722c2-0a63-449e-9494-e9a4435f3058","connectionId":3,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:55:36.402+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":1400}}
{"t":{"$date":"2022-11-30T19:55:37.804+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":1600}}
{"t":{"$date":"2022-11-30T19:55:39.406+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":1800}}
{"t":{"$date":"2022-11-30T19:55:41.207+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":2000}}
{"t":{"$date":"2022-11-30T19:55:42.062+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:48338","uuid":"d684d5a7-d140-4160-a27a-f62246a7cd55","connectionId":4,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:42.065+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn4","msg":"client metadata","attr":{"remote":"172.16.4.164:48338","client":"conn4","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:42.071+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:48346","uuid":"559ab1b3-7321-4637-8a42-ec1cba6b27ed","connectionId":5,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:55:42.072+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn5","msg":"client metadata","attr":{"remote":"172.16.4.164:48346","client":"conn5","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:42.072+00:00"},"s":"I", "c":"ACCESS", "id":20251, "ctx":"conn5","msg":"Supported SASL mechanisms requested for unknown user","attr":{"user":{"user":"root","db":"admin"}}}
{"t":{"$date":"2022-11-30T19:55:42.072+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn5","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-256","speculative":true,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:48346","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:55:42.074+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn5","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-1","speculative":false,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:48346","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:55:42.076+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn4","msg":"Connection ended","attr":{"remote":"172.16.4.164:48338","uuid":"d684d5a7-d140-4160-a27a-f62246a7cd55","connectionId":4,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:42.084+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn5","msg":"Connection ended","attr":{"remote":"172.16.4.164:48346","uuid":"559ab1b3-7321-4637-8a42-ec1cba6b27ed","connectionId":5,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:55:43.209+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":2200}}
{"t":{"$date":"2022-11-30T19:55:44.384+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:49604","uuid":"27738318-d815-486b-b9b1-d5e2882fc4b6","connectionId":6,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:44.387+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn6","msg":"client metadata","attr":{"remote":"127.0.0.1:49604","client":"conn6","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:44.398+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:49620","uuid":"7124a2e5-738b-41a7-a801-d1fb03ad901b","connectionId":7,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:55:44.399+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:49626","uuid":"3adb6b7b-446c-43ed-8629-db195d7575c1","connectionId":8,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:55:44.400+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn7","msg":"client metadata","attr":{"remote":"127.0.0.1:49620","client":"conn7","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:44.400+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn8","msg":"client metadata","attr":{"remote":"127.0.0.1:49626","client":"conn8","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:44.402+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:49642","uuid":"025d83c7-6d1a-420b-be36-b5eaace7f8c8","connectionId":9,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:55:44.404+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn9","msg":"client metadata","attr":{"remote":"127.0.0.1:49642","client":"conn9","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:44.634+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn7","msg":"Connection ended","attr":{"remote":"127.0.0.1:49620","uuid":"7124a2e5-738b-41a7-a801-d1fb03ad901b","connectionId":7,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:55:44.634+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn6","msg":"Connection ended","attr":{"remote":"127.0.0.1:49604","uuid":"27738318-d815-486b-b9b1-d5e2882fc4b6","connectionId":6,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:55:44.634+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn8","msg":"Connection ended","attr":{"remote":"127.0.0.1:49626","uuid":"3adb6b7b-446c-43ed-8629-db195d7575c1","connectionId":8,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:44.634+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn9","msg":"Connection ended","attr":{"remote":"127.0.0.1:49642","uuid":"025d83c7-6d1a-420b-be36-b5eaace7f8c8","connectionId":9,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:55:45.410+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":2400}}
{"t":{"$date":"2022-11-30T19:55:47.813+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":2600}}
{"t":{"$date":"2022-11-30T19:55:47.870+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:38372","uuid":"eb141b11-7132-40c2-bc2f-9875835d0c56","connectionId":10,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:47.873+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn10","msg":"client metadata","attr":{"remote":"172.16.4.164:38372","client":"conn10","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:47.879+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:38388","uuid":"14959356-a551-4de3-b220-fd64ebb30162","connectionId":11,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:55:47.881+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn11","msg":"client metadata","attr":{"remote":"172.16.4.164:38388","client":"conn11","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:47.881+00:00"},"s":"I", "c":"ACCESS", "id":20251, "ctx":"conn11","msg":"Supported SASL mechanisms requested for unknown user","attr":{"user":{"user":"root","db":"admin"}}}
{"t":{"$date":"2022-11-30T19:55:47.881+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn11","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-256","speculative":true,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:38388","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:55:47.882+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn11","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-1","speculative":false,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:38388","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:55:47.885+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn10","msg":"Connection ended","attr":{"remote":"172.16.4.164:38372","uuid":"eb141b11-7132-40c2-bc2f-9875835d0c56","connectionId":10,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:47.894+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn11","msg":"Connection ended","attr":{"remote":"172.16.4.164:38388","uuid":"14959356-a551-4de3-b220-fd64ebb30162","connectionId":11,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:55:50.416+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":2800}}
{"t":{"$date":"2022-11-30T19:55:53.219+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":3000}}
{"t":{"$date":"2022-11-30T19:55:53.693+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:38394","uuid":"ff09ff14-c396-4f73-8031-83c7ca9d6b0e","connectionId":12,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:53.698+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn12","msg":"client metadata","attr":{"remote":"172.16.4.164:38394","client":"conn12","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:53.705+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:38402","uuid":"c792be3a-43f5-4e47-baa4-1ce768488f13","connectionId":13,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:55:53.707+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn13","msg":"client metadata","attr":{"remote":"172.16.4.164:38402","client":"conn13","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:53.708+00:00"},"s":"I", "c":"ACCESS", "id":20251, "ctx":"conn13","msg":"Supported SASL mechanisms requested for unknown user","attr":{"user":{"user":"root","db":"admin"}}}
{"t":{"$date":"2022-11-30T19:55:53.708+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn13","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-256","speculative":true,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:38402","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:55:53.710+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn13","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-1","speculative":false,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:38402","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:55:53.712+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn12","msg":"Connection ended","attr":{"remote":"172.16.4.164:38394","uuid":"ff09ff14-c396-4f73-8031-83c7ca9d6b0e","connectionId":12,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:53.720+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn13","msg":"Connection ended","attr":{"remote":"172.16.4.164:38402","uuid":"c792be3a-43f5-4e47-baa4-1ce768488f13","connectionId":13,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:55:54.374+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:59170","uuid":"1de0d87e-5a06-431c-890c-bf9c00cc98ca","connectionId":14,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:54.377+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn14","msg":"client metadata","attr":{"remote":"127.0.0.1:59170","client":"conn14","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:54.388+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:59172","uuid":"b6310c2c-398c-40fa-bc9b-5ddcc95965fe","connectionId":15,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:55:54.388+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:59184","uuid":"9afb3b17-a0d3-422b-a665-92adb8e91af0","connectionId":16,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:55:54.389+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn15","msg":"client metadata","attr":{"remote":"127.0.0.1:59172","client":"conn15","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:54.390+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn16","msg":"client metadata","attr":{"remote":"127.0.0.1:59184","client":"conn16","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:54.391+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:59196","uuid":"30287db4-d6e1-492b-b1c3-13f945e257d2","connectionId":17,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:55:54.393+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn17","msg":"client metadata","attr":{"remote":"127.0.0.1:59196","client":"conn17","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:54.627+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn16","msg":"Connection ended","attr":{"remote":"127.0.0.1:59184","uuid":"9afb3b17-a0d3-422b-a665-92adb8e91af0","connectionId":16,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:55:54.627+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn15","msg":"Connection ended","attr":{"remote":"127.0.0.1:59172","uuid":"b6310c2c-398c-40fa-bc9b-5ddcc95965fe","connectionId":15,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:55:54.628+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn14","msg":"Connection ended","attr":{"remote":"127.0.0.1:59170","uuid":"1de0d87e-5a06-431c-890c-bf9c00cc98ca","connectionId":14,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:54.628+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn17","msg":"Connection ended","attr":{"remote":"127.0.0.1:59196","uuid":"30287db4-d6e1-492b-b1c3-13f945e257d2","connectionId":17,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:55:56.222+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":3200}}
{"t":{"$date":"2022-11-30T19:55:59.423+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":3400}}
{"t":{"$date":"2022-11-30T19:55:59.675+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:42866","uuid":"2692fd55-df7f-43cd-8013-ea89b0242415","connectionId":18,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:59.679+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn18","msg":"client metadata","attr":{"remote":"172.16.4.164:42866","client":"conn18","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:59.685+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:42872","uuid":"281efcd9-4a6d-4d8d-a33d-d83f84590705","connectionId":19,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:55:59.686+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn19","msg":"client metadata","attr":{"remote":"172.16.4.164:42872","client":"conn19","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:55:59.686+00:00"},"s":"I", "c":"ACCESS", "id":20251, "ctx":"conn19","msg":"Supported SASL mechanisms requested for unknown user","attr":{"user":{"user":"root","db":"admin"}}}
{"t":{"$date":"2022-11-30T19:55:59.686+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn19","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-256","speculative":true,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:42872","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:55:59.688+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn19","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-1","speculative":false,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:42872","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:55:59.690+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn18","msg":"Connection ended","attr":{"remote":"172.16.4.164:42866","uuid":"2692fd55-df7f-43cd-8013-ea89b0242415","connectionId":18,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:55:59.697+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn19","msg":"Connection ended","attr":{"remote":"172.16.4.164:42872","uuid":"281efcd9-4a6d-4d8d-a33d-d83f84590705","connectionId":19,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:56:02.825+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":3600}}
{"t":{"$date":"2022-11-30T19:56:04.366+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:41788","uuid":"7bb51f01-af0a-4cc3-b8a8-d26adf3bc70b","connectionId":20,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:56:04.370+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn20","msg":"client metadata","attr":{"remote":"127.0.0.1:41788","client":"conn20","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:04.381+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:41802","uuid":"e9d5d99b-e8ff-404e-ba3c-f4a02148740a","connectionId":21,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:56:04.381+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:41810","uuid":"c45a73fe-f88c-4797-b9b3-cbeeeb32aa94","connectionId":22,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:56:04.382+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn21","msg":"client metadata","attr":{"remote":"127.0.0.1:41802","client":"conn21","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:04.382+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn22","msg":"client metadata","attr":{"remote":"127.0.0.1:41810","client":"conn22","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:04.384+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:41818","uuid":"16303a9b-8f8b-4a34-8f3b-d6af2b019fd5","connectionId":23,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:56:04.386+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn23","msg":"client metadata","attr":{"remote":"127.0.0.1:41818","client":"conn23","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:04.626+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn22","msg":"Connection ended","attr":{"remote":"127.0.0.1:41810","uuid":"c45a73fe-f88c-4797-b9b3-cbeeeb32aa94","connectionId":22,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:56:04.626+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn20","msg":"Connection ended","attr":{"remote":"127.0.0.1:41788","uuid":"7bb51f01-af0a-4cc3-b8a8-d26adf3bc70b","connectionId":20,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:56:04.626+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn23","msg":"Connection ended","attr":{"remote":"127.0.0.1:41818","uuid":"16303a9b-8f8b-4a34-8f3b-d6af2b019fd5","connectionId":23,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:56:04.626+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn21","msg":"Connection ended","attr":{"remote":"127.0.0.1:41802","uuid":"e9d5d99b-e8ff-404e-ba3c-f4a02148740a","connectionId":21,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:56:05.547+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:40094","uuid":"5116f91f-e616-488a-bb3d-0c8028105a5e","connectionId":24,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:56:05.550+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn24","msg":"client metadata","attr":{"remote":"172.16.4.164:40094","client":"conn24","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:05.556+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.16.4.164:40104","uuid":"b53e0507-971f-4e48-8416-d11652a73d0f","connectionId":25,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:56:05.557+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn25","msg":"client metadata","attr":{"remote":"172.16.4.164:40104","client":"conn25","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:05.557+00:00"},"s":"I", "c":"ACCESS", "id":20251, "ctx":"conn25","msg":"Supported SASL mechanisms requested for unknown user","attr":{"user":{"user":"root","db":"admin"}}}
{"t":{"$date":"2022-11-30T19:56:05.557+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn25","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-256","speculative":true,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:40104","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:56:05.558+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn25","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-1","speculative":false,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:40104","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:56:05.560+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn24","msg":"Connection ended","attr":{"remote":"172.16.4.164:40094","uuid":"5116f91f-e616-488a-bb3d-0c8028105a5e","connectionId":24,"connectionCount":1}}
[primary-pod.log](https://github.com/bitnami/charts/files/10126903/primary-pod.log)
[primary-pod.log](https://github.com/bitnami/charts/f
[secondary-pod.log](https://github.com/bitnami/charts/files/10126914/secondary-pod.log)
iles/10126912/primary-pod.log)
Secondary Pod Logs
38;5;6mmongodb [38;5;5m19:56:08.68 [0m[38;5;2mINFO [0m ==> ** Starting MongoDB **
{"t":{"$date":"2022-11-30T19:56:08.697Z"},"s":"I", "c":"CONTROL", "id":5760901, "ctx":"-","msg":"Applied --setParameter options","attr":{"serverParameters":{"enableLocalhostAuthBypass":{"default":true,"value":false}}}}
{"t":{"$date":"2022-11-30T19:56:08.697+00:00"},"s":"I", "c":"CONTROL", "id":20698, "ctx":"-","msg":"***** SERVER RESTARTED *****"}
{"t":{"$date":"2022-11-30T19:56:08.697+00:00"},"s":"I", "c":"NETWORK", "id":4915701, "ctx":"-","msg":"Initialized wire specification","attr":{"spec":{"incomingExternalClient":{"minWireVersion":0,"maxWireVersion":17},"incomingInternalClient":{"minWireVersion":0,"maxWireVersion":17},"outgoing":{"minWireVersion":6,"maxWireVersion":17},"isInternalClient":true}}}
{"t":{"$date":"2022-11-30T19:56:08.697+00:00"},"s":"I", "c":"CONTROL", "id":23285, "ctx":"-","msg":"Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'"}
{"t":{"$date":"2022-11-30T19:56:08.698+00:00"},"s":"I", "c":"NETWORK", "id":4648601, "ctx":"main","msg":"Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize."}
{"t":{"$date":"2022-11-30T19:56:08.711+00:00"},"s":"I", "c":"REPL", "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"TenantMigrationDonorService","namespace":"config.tenantMigrationDonors"}}
{"t":{"$date":"2022-11-30T19:56:08.711+00:00"},"s":"I", "c":"REPL", "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"TenantMigrationRecipientService","namespace":"config.tenantMigrationRecipients"}}
{"t":{"$date":"2022-11-30T19:56:08.711+00:00"},"s":"I", "c":"REPL", "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"ShardSplitDonorService","namespace":"config.tenantSplitDonors"}}
{"t":{"$date":"2022-11-30T19:56:08.711+00:00"},"s":"I", "c":"CONTROL", "id":5945603, "ctx":"main","msg":"Multi threading initialized"}
{"t":{"$date":"2022-11-30T19:56:08.711+00:00"},"s":"I", "c":"CONTROL", "id":4615611, "ctx":"initandlisten","msg":"MongoDB starting","attr":{"pid":1,"port":27017,"dbPath":"/bitnami/mongodb/data/db","architecture":"64-bit","host":"mongo-prod-rs-1"}}
{"t":{"$date":"2022-11-30T19:56:08.711+00:00"},"s":"W", "c":"CONTROL", "id":20720, "ctx":"initandlisten","msg":"Memory available to mongo process is less than total system memory","attr":{"availableMemSizeMB":30720,"systemMemSizeMB":31594}}
{"t":{"$date":"2022-11-30T19:56:08.711+00:00"},"s":"I", "c":"CONTROL", "id":23403, "ctx":"initandlisten","msg":"Build Info","attr":{"buildInfo":{"version":"6.0.3","gitVersion":"f803681c3ae19817d31958965850193de067c516","openSSLVersion":"OpenSSL 1.1.1n 15 Mar 2022","modules":[],"allocator":"tcmalloc","environment":{"distmod":"debian11","distarch":"x86_64","target_arch":"x86_64"}}}}
{"t":{"$date":"2022-11-30T19:56:08.711+00:00"},"s":"I", "c":"CONTROL", "id":51765, "ctx":"initandlisten","msg":"Operating System","attr":{"os":{"name":"PRETTY_NAME=\"Debian GNU/Linux 11 (bullseye)\"","version":"Kernel 5.4.209-116.367.amzn2.x86_64"}}}
{"t":{"$date":"2022-11-30T19:56:08.711+00:00"},"s":"I", "c":"CONTROL", "id":21951, "ctx":"initandlisten","msg":"Options set by command line","attr":{"options":{"config":"/opt/bitnami/mongodb/conf/mongodb.conf","net":{"bindIp":"*","ipv6":false,"port":27017,"unixDomainSocket":{"enabled":true,"pathPrefix":"/opt/bitnami/mongodb/tmp"}},"processManagement":{"fork":false,"pidFilePath":"/opt/bitnami/mongodb/tmp/mongodb.pid"},"replication":{"enableMajorityReadConcern":true,"replSetName":"prodrs"},"security":{"authorization":"enabled","keyFile":"/opt/bitnami/mongodb/conf/keyfile"},"setParameter":{"enableLocalhostAuthBypass":"false"},"storage":{"dbPath":"/bitnami/mongodb/data/db","directoryPerDB":false,"engine":"wiredTiger","journal":{"enabled":true},"wiredTiger":{"engineConfig":{"cacheSizeGB":5}}},"systemLog":{"destination":"file","logAppend":true,"logRotate":"reopen","path":"/opt/bitnami/mongodb/logs/mongodb.log","quiet":false,"verbosity":0}}}}
{"t":{"$date":"2022-11-30T19:56:08.712+00:00"},"s":"I", "c":"STORAGE", "id":22297, "ctx":"initandlisten","msg":"Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem","tags":["startupWarnings"]}
{"t":{"$date":"2022-11-30T19:56:08.712+00:00"},"s":"I", "c":"STORAGE", "id":22315, "ctx":"initandlisten","msg":"Opening WiredTiger","attr":{"config":"create,cache_size=5120M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,remove=true,path=journal,compressor=snappy),builtin_extension_config=(zstd=(compression_level=6)),file_manager=(close_idle_time=600,close_scan_interval=10,close_handle_minimum=2000),statistics_log=(wait=0),json_output=(error,message),verbose=[recovery_progress:1,checkpoint_progress:1,compact_progress:1,backup:0,checkpoint:0,compact:0,evict:0,history_store:0,recovery:0,rts:0,salvage:0,tiered:0,timestamp:0,transaction:0,verify:0,log:0],"}}
{"t":{"$date":"2022-11-30T19:56:09.279+00:00"},"s":"I", "c":"STORAGE", "id":4795906, "ctx":"initandlisten","msg":"WiredTiger opened","attr":{"durationMillis":567}}
{"t":{"$date":"2022-11-30T19:56:09.279+00:00"},"s":"I", "c":"RECOVERY", "id":23987, "ctx":"initandlisten","msg":"WiredTiger recoveryTimestamp","attr":{"recoveryTimestamp":{"$timestamp":{"t":0,"i":0}}}}
{"t":{"$date":"2022-11-30T19:56:09.298+00:00"},"s":"W", "c":"CONTROL", "id":5123300, "ctx":"initandlisten","msg":"vm.max_map_count is too low","attr":{"currentValue":524288,"recommendedMinimum":1677720,"maxConns":838860},"tags":["startupWarnings"]}
{"t":{"$date":"2022-11-30T19:56:09.298+00:00"},"s":"I", "c":"REPL", "id":5853300, "ctx":"initandlisten","msg":"current featureCompatibilityVersion value","attr":{"featureCompatibilityVersion":"unset","context":"startup"}}
{"t":{"$date":"2022-11-30T19:56:09.298+00:00"},"s":"I", "c":"STORAGE", "id":5071100, "ctx":"initandlisten","msg":"Clearing temp directory"}
{"t":{"$date":"2022-11-30T19:56:09.299+00:00"},"s":"I", "c":"CONTROL", "id":20536, "ctx":"initandlisten","msg":"Flow Control is enabled on this deployment"}
{"t":{"$date":"2022-11-30T19:56:09.299+00:00"},"s":"I", "c":"FTDC", "id":20625, "ctx":"initandlisten","msg":"Initializing full-time diagnostic data capture","attr":{"dataDirectory":"/bitnami/mongodb/data/db/diagnostic.data"}}
{"t":{"$date":"2022-11-30T19:56:09.300+00:00"},"s":"I", "c":"STORAGE", "id":20320, "ctx":"initandlisten","msg":"createCollection","attr":{"namespace":"local.startup_log","uuidDisposition":"generated","uuid":{"uuid":{"$uuid":"dbf66ace-2295-4628-af60-84b45569c0e7"}},"options":{"capped":true,"size":10485760}}}
{"t":{"$date":"2022-11-30T19:56:09.310+00:00"},"s":"I", "c":"INDEX", "id":20345, "ctx":"initandlisten","msg":"Index build: done building","attr":{"buildUUID":null,"collectionUUID":{"uuid":{"$uuid":"dbf66ace-2295-4628-af60-84b45569c0e7"}},"namespace":"local.startup_log","index":"_id_","ident":"index-1-5279883429430069038","collectionIdent":"collection-0-5279883429430069038","commitTimestamp":null}}
{"t":{"$date":"2022-11-30T19:56:09.311+00:00"},"s":"I", "c":"REPL", "id":6015317, "ctx":"initandlisten","msg":"Setting new configuration state","attr":{"newState":"ConfigStartingUp","oldState":"ConfigPreStart"}}
{"t":{"$date":"2022-11-30T19:56:09.311+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"ReadConcernMajorityNotAvailableYet: Read concern majority reads are currently not possible.","nextWakeupMillis":200}}
{"t":{"$date":"2022-11-30T19:56:09.311+00:00"},"s":"I", "c":"REPL", "id":6005300, "ctx":"initandlisten","msg":"Starting up replica set aware services"}
{"t":{"$date":"2022-11-30T19:56:09.312+00:00"},"s":"I", "c":"REPL", "id":4280500, "ctx":"initandlisten","msg":"Attempting to create internal replication collections"}
{"t":{"$date":"2022-11-30T19:56:09.312+00:00"},"s":"I", "c":"STORAGE", "id":20320, "ctx":"initandlisten","msg":"createCollection","attr":{"namespace":"local.replset.oplogTruncateAfterPoint","uuidDisposition":"generated","uuid":{"uuid":{"$uuid":"67a83ed0-1697-4cef-82d3-1a9aef1ee17e"}},"options":{}}}
{"t":{"$date":"2022-11-30T19:56:09.323+00:00"},"s":"I", "c":"INDEX", "id":20345, "ctx":"initandlisten","msg":"Index build: done building","attr":{"buildUUID":null,"collectionUUID":{"uuid":{"$uuid":"67a83ed0-1697-4cef-82d3-1a9aef1ee17e"}},"namespace":"local.replset.oplogTruncateAfterPoint","index":"_id_","ident":"index-3-5279883429430069038","collectionIdent":"collection-2-5279883429430069038","commitTimestamp":null}}
{"t":{"$date":"2022-11-30T19:56:09.323+00:00"},"s":"I", "c":"STORAGE", "id":20320, "ctx":"initandlisten","msg":"createCollection","attr":{"namespace":"local.replset.minvalid","uuidDisposition":"generated","uuid":{"uuid":{"$uuid":"86dd0ab3-ec17-4816-9249-f9d9cebdca32"}},"options":{}}}
{"t":{"$date":"2022-11-30T19:56:09.333+00:00"},"s":"I", "c":"INDEX", "id":20345, "ctx":"initandlisten","msg":"Index build: done building","attr":{"buildUUID":null,"collectionUUID":{"uuid":{"$uuid":"86dd0ab3-ec17-4816-9249-f9d9cebdca32"}},"namespace":"local.replset.minvalid","index":"_id_","ident":"index-5-5279883429430069038","collectionIdent":"collection-4-5279883429430069038","commitTimestamp":null}}
{"t":{"$date":"2022-11-30T19:56:09.333+00:00"},"s":"I", "c":"STORAGE", "id":20320, "ctx":"initandlisten","msg":"createCollection","attr":{"namespace":"local.replset.election","uuidDisposition":"generated","uuid":{"uuid":{"$uuid":"69beb9a4-db0f-4f72-af06-0742eafe74eb"}},"options":{}}}
{"t":{"$date":"2022-11-30T19:56:09.344+00:00"},"s":"I", "c":"INDEX", "id":20345, "ctx":"initandlisten","msg":"Index build: done building","attr":{"buildUUID":null,"collectionUUID":{"uuid":{"$uuid":"69beb9a4-db0f-4f72-af06-0742eafe74eb"}},"namespace":"local.replset.election","index":"_id_","ident":"index-7-5279883429430069038","collectionIdent":"collection-6-5279883429430069038","commitTimestamp":null}}
{"t":{"$date":"2022-11-30T19:56:09.344+00:00"},"s":"I", "c":"REPL", "id":4280501, "ctx":"initandlisten","msg":"Attempting to load local voted for document"}
{"t":{"$date":"2022-11-30T19:56:09.344+00:00"},"s":"I", "c":"REPL", "id":21311, "ctx":"initandlisten","msg":"Did not find local initialized voted for document at startup"}
{"t":{"$date":"2022-11-30T19:56:09.344+00:00"},"s":"I", "c":"REPL", "id":4280502, "ctx":"initandlisten","msg":"Searching for local Rollback ID document"}
{"t":{"$date":"2022-11-30T19:56:09.344+00:00"},"s":"I", "c":"REPL", "id":21312, "ctx":"initandlisten","msg":"Did not find local Rollback ID document at startup. Creating one"}
{"t":{"$date":"2022-11-30T19:56:09.344+00:00"},"s":"I", "c":"STORAGE", "id":20320, "ctx":"initandlisten","msg":"createCollection","attr":{"namespace":"local.system.rollback.id","uuidDisposition":"generated","uuid":{"uuid":{"$uuid":"a7c8f36b-1c05-46a1-9bf3-d7a350a4858d"}},"options":{}}}
{"t":{"$date":"2022-11-30T19:56:09.354+00:00"},"s":"I", "c":"INDEX", "id":20345, "ctx":"initandlisten","msg":"Index build: done building","attr":{"buildUUID":null,"collectionUUID":{"uuid":{"$uuid":"a7c8f36b-1c05-46a1-9bf3-d7a350a4858d"}},"namespace":"local.system.rollback.id","index":"_id_","ident":"index-9-5279883429430069038","collectionIdent":"collection-8-5279883429430069038","commitTimestamp":null}}
{"t":{"$date":"2022-11-30T19:56:09.355+00:00"},"s":"I", "c":"REPL", "id":21531, "ctx":"initandlisten","msg":"Initialized the rollback ID","attr":{"rbid":1}}
{"t":{"$date":"2022-11-30T19:56:09.355+00:00"},"s":"I", "c":"REPL", "id":21313, "ctx":"initandlisten","msg":"Did not find local replica set configuration document at startup","attr":{"error":{"code":47,"codeName":"NoMatchingDocument","errmsg":"Did not find replica set configuration document in local.system.replset"}}}
{"t":{"$date":"2022-11-30T19:56:09.355+00:00"},"s":"I", "c":"REPL", "id":6015317, "ctx":"initandlisten","msg":"Setting new configuration state","attr":{"newState":"ConfigUninitialized","oldState":"ConfigStartingUp"}}
{"t":{"$date":"2022-11-30T19:56:09.355+00:00"},"s":"I", "c":"STORAGE", "id":20320, "ctx":"initandlisten","msg":"createCollection","attr":{"namespace":"local.system.views","uuidDisposition":"generated","uuid":{"uuid":{"$uuid":"5be0432d-254e-4af7-9b48-cc40a0e128d8"}},"options":{}}}
{"t":{"$date":"2022-11-30T19:56:09.365+00:00"},"s":"I", "c":"INDEX", "id":20345, "ctx":"initandlisten","msg":"Index build: done building","attr":{"buildUUID":null,"collectionUUID":{"uuid":{"$uuid":"5be0432d-254e-4af7-9b48-cc40a0e128d8"}},"namespace":"local.system.views","index":"_id_","ident":"index-11-5279883429430069038","collectionIdent":"collection-10-5279883429430069038","commitTimestamp":null}}
{"t":{"$date":"2022-11-30T19:56:09.366+00:00"},"s":"I", "c":"STORAGE", "id":22262, "ctx":"initandlisten","msg":"Timestamp monitor starting"}
{"t":{"$date":"2022-11-30T19:56:09.366+00:00"},"s":"I", "c":"CONTROL", "id":20714, "ctx":"LogicalSessionCacheRefresh","msg":"Failed to refresh session cache, will try again at the next refresh interval","attr":{"error":"NotYetInitialized: Replication has not yet been configured"}}
{"t":{"$date":"2022-11-30T19:56:09.367+00:00"},"s":"I", "c":"REPL", "id":40440, "ctx":"initandlisten","msg":"Starting the TopologyVersionObserver"}
{"t":{"$date":"2022-11-30T19:56:09.367+00:00"},"s":"I", "c":"CONTROL", "id":20712, "ctx":"LogicalSessionCacheReap","msg":"Sessions collection is not set up; waiting until next sessions reap interval","attr":{"error":"NamespaceNotFound: config.system.sessions does not exist"}}
{"t":{"$date":"2022-11-30T19:56:09.367+00:00"},"s":"I", "c":"REPL", "id":40445, "ctx":"TopologyVersionObserver","msg":"Started TopologyVersionObserver"}
{"t":{"$date":"2022-11-30T19:56:09.367+00:00"},"s":"I", "c":"NETWORK", "id":23015, "ctx":"listener","msg":"Listening on","attr":{"address":"/opt/bitnami/mongodb/tmp/mongodb-27017.sock"}}
{"t":{"$date":"2022-11-30T19:56:09.367+00:00"},"s":"I", "c":"NETWORK", "id":23015, "ctx":"listener","msg":"Listening on","attr":{"address":"0.0.0.0"}}
{"t":{"$date":"2022-11-30T19:56:09.367+00:00"},"s":"I", "c":"NETWORK", "id":23016, "ctx":"listener","msg":"Waiting for connections","attr":{"port":27017,"ssl":"off"}}
{"t":{"$date":"2022-11-30T19:56:09.512+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":400}}
{"t":{"$date":"2022-11-30T19:56:09.912+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":600}}
{"t":{"$date":"2022-11-30T19:56:10.513+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":800}}
{"t":{"$date":"2022-11-30T19:56:11.314+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":1000}}
{"t":{"$date":"2022-11-30T19:56:12.315+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":1200}}
{"t":{"$date":"2022-11-30T19:56:13.516+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":1400}}
{"t":{"$date":"2022-11-30T19:56:14.918+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":1600}}
{"t":{"$date":"2022-11-30T19:56:16.520+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":1800}}
{"t":{"$date":"2022-11-30T19:56:18.322+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":2000}}
{"t":{"$date":"2022-11-30T19:56:20.323+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":2200}}
{"t":{"$date":"2022-11-30T19:56:21.555+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:58726","uuid":"29b41053-483f-4971-97cc-db5b612e8cbf","connectionId":1,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:56:21.559+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn1","msg":"client metadata","attr":{"remote":"127.0.0.1:58726","client":"conn1","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:21.570+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:58740","uuid":"0c3712fa-c0a4-4626-9e5f-98261073aa23","connectionId":2,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:56:21.570+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:58754","uuid":"f1ae0f93-b2a9-448a-bea2-c2b1225ddee1","connectionId":3,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:56:21.571+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn2","msg":"client metadata","attr":{"remote":"127.0.0.1:58740","client":"conn2","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:21.572+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn3","msg":"client metadata","attr":{"remote":"127.0.0.1:58754","client":"conn3","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:21.573+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:58762","uuid":"9e029ebe-45f2-4d26-980a-c982057f6282","connectionId":4,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:56:21.575+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn4","msg":"client metadata","attr":{"remote":"127.0.0.1:58762","client":"conn4","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:21.811+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn2","msg":"Connection ended","attr":{"remote":"127.0.0.1:58740","uuid":"0c3712fa-c0a4-4626-9e5f-98261073aa23","connectionId":2,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:56:21.811+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn4","msg":"Connection ended","attr":{"remote":"127.0.0.1:58762","uuid":"9e029ebe-45f2-4d26-980a-c982057f6282","connectionId":4,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:56:21.811+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn1","msg":"Connection ended","attr":{"remote":"127.0.0.1:58726","uuid":"29b41053-483f-4971-97cc-db5b612e8cbf","connectionId":1,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:56:21.811+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn3","msg":"Connection ended","attr":{"remote":"127.0.0.1:58754","uuid":"f1ae0f93-b2a9-448a-bea2-c2b1225ddee1","connectionId":3,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:56:22.526+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":2400}}
{"t":{"$date":"2022-11-30T19:56:24.928+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":2600}}
{"t":{"$date":"2022-11-30T19:56:27.531+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":2800}}
{"t":{"$date":"2022-11-30T19:56:30.334+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":3000}}
{"t":{"$date":"2022-11-30T19:56:31.553+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:42746","uuid":"b8731c30-d3c9-4d1d-a302-105a19340b5b","connectionId":5,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:56:31.557+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn5","msg":"client metadata","attr":{"remote":"127.0.0.1:42746","client":"conn5","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:31.568+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:42754","uuid":"c9572167-61ab-44e7-a003-380c96f95342","connectionId":6,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:56:31.568+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:42762","uuid":"f01c853e-783a-4d42-8c72-e41fb0cb1bca","connectionId":7,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:56:31.569+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn6","msg":"client metadata","attr":{"remote":"127.0.0.1:42754","client":"conn6","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:31.569+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn7","msg":"client metadata","attr":{"remote":"127.0.0.1:42762","client":"conn7","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:31.571+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:42776","uuid":"b7db9dbc-6e0a-4bb2-999e-fa411e6f4a2f","connectionId":8,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:56:31.573+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn8","msg":"client metadata","attr":{"remote":"127.0.0.1:42776","client":"conn8","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:31.807+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn6","msg":"Connection ended","attr":{"remote":"127.0.0.1:42754","uuid":"c9572167-61ab-44e7-a003-380c96f95342","connectionId":6,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:56:31.807+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn7","msg":"Connection ended","attr":{"remote":"127.0.0.1:42762","uuid":"f01c853e-783a-4d42-8c72-e41fb0cb1bca","connectionId":7,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:56:31.807+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn5","msg":"Connection ended","attr":{"remote":"127.0.0.1:42746","uuid":"b8731c30-d3c9-4d1d-a302-105a19340b5b","connectionId":5,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:56:31.807+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn8","msg":"Connection ended","attr":{"remote":"127.0.0.1:42776","uuid":"b7db9dbc-6e0a-4bb2-999e-fa411e6f4a2f","connectionId":8,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:56:33.334+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":3200}}
{"t":{"$date":"2022-11-30T19:56:36.538+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":3400}}
{"t":{"$date":"2022-11-30T19:56:39.942+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":3600}}
{"t":{"$date":"2022-11-30T19:56:41.542+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:40076","uuid":"bc92e09f-48aa-4adf-8b6a-a295ca4f9db2","connectionId":9,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:56:41.545+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn9","msg":"client metadata","attr":{"remote":"127.0.0.1:40076","client":"conn9","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:41.557+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:40078","uuid":"37ca165b-20b0-4b74-9e4d-8b90408b02b8","connectionId":10,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:56:41.557+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:40090","uuid":"473903e2-955d-4cff-8ca2-53c75fd04376","connectionId":11,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:56:41.558+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn10","msg":"client metadata","attr":{"remote":"127.0.0.1:40078","client":"conn10","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:41.559+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn11","msg":"client metadata","attr":{"remote":"127.0.0.1:40090","client":"conn11","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:41.560+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:40104","uuid":"d90cc8be-ca29-465e-bf78-071c92472f3f","connectionId":12,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:56:41.562+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn12","msg":"client metadata","attr":{"remote":"127.0.0.1:40104","client":"conn12","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:41.794+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn9","msg":"Connection ended","attr":{"remote":"127.0.0.1:40076","uuid":"bc92e09f-48aa-4adf-8b6a-a295ca4f9db2","connectionId":9,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:56:41.794+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn10","msg":"Connection ended","attr":{"remote":"127.0.0.1:40078","uuid":"37ca165b-20b0-4b74-9e4d-8b90408b02b8","connectionId":10,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:56:41.794+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn12","msg":"Connection ended","attr":{"remote":"127.0.0.1:40104","uuid":"d90cc8be-ca29-465e-bf78-071c92472f3f","connectionId":12,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:56:41.794+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn11","msg":"Connection ended","attr":{"remote":"127.0.0.1:40090","uuid":"473903e2-955d-4cff-8ca2-53c75fd04376","connectionId":11,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:56:43.545+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":3800}}
{"t":{"$date":"2022-11-30T19:56:47.349+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":4000}}
{"t":{"$date":"2022-11-30T19:56:51.350+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":4200}}
{"t":{"$date":"2022-11-30T19:56:51.667+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:33216","uuid":"617e4b84-e956-41a1-9197-3628003be61c","connectionId":13,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:56:51.672+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn13","msg":"client metadata","attr":{"remote":"127.0.0.1:33216","client":"conn13","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:51.689+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:33226","uuid":"b32519cc-f2f1-485c-9551-4eb1ce3dd69e","connectionId":14,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:56:51.689+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:33234","uuid":"7ad17b1d-1473-4dbc-a9a9-2d2da63695c1","connectionId":15,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:56:51.690+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn14","msg":"client metadata","attr":{"remote":"127.0.0.1:33226","client":"conn14","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:51.691+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn15","msg":"client metadata","attr":{"remote":"127.0.0.1:33234","client":"conn15","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:51.693+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:33246","uuid":"f18ad0ca-0491-42d1-a156-58538fddf860","connectionId":16,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:56:51.696+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn16","msg":"client metadata","attr":{"remote":"127.0.0.1:33246","client":"conn16","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:51.700+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:33248","uuid":"19ba50d3-f9a2-4f9b-a6ee-727f40a6c5d0","connectionId":17,"connectionCount":5}}
{"t":{"$date":"2022-11-30T19:56:51.705+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn17","msg":"client metadata","attr":{"remote":"127.0.0.1:33248","client":"conn17","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:51.722+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:33258","uuid":"2dadd1d3-a311-41cf-b79b-665095ac2e0e","connectionId":18,"connectionCount":6}}
{"t":{"$date":"2022-11-30T19:56:51.722+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:33260","uuid":"0c12869c-80f7-4f0a-9f0b-302ed977b5c4","connectionId":19,"connectionCount":7}}
{"t":{"$date":"2022-11-30T19:56:51.723+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn18","msg":"client metadata","attr":{"remote":"127.0.0.1:33258","client":"conn18","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:51.723+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn19","msg":"client metadata","attr":{"remote":"127.0.0.1:33260","client":"conn19","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:51.725+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:33264","uuid":"c2ca53fa-ec3b-41ab-be6a-4a954e30a2bc","connectionId":20,"connectionCount":8}}
{"t":{"$date":"2022-11-30T19:56:51.728+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn20","msg":"client metadata","attr":{"remote":"127.0.0.1:33264","client":"conn20","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:56:51.972+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn13","msg":"Connection ended","attr":{"remote":"127.0.0.1:33216","uuid":"617e4b84-e956-41a1-9197-3628003be61c","connectionId":13,"connectionCount":7}}
{"t":{"$date":"2022-11-30T19:56:51.972+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn15","msg":"Connection ended","attr":{"remote":"127.0.0.1:33234","uuid":"7ad17b1d-1473-4dbc-a9a9-2d2da63695c1","connectionId":15,"connectionCount":6}}
{"t":{"$date":"2022-11-30T19:56:51.973+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn16","msg":"Connection ended","attr":{"remote":"127.0.0.1:33246","uuid":"f18ad0ca-0491-42d1-a156-58538fddf860","connectionId":16,"connectionCount":5}}
{"t":{"$date":"2022-11-30T19:56:51.973+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn14","msg":"Connection ended","attr":{"remote":"127.0.0.1:33226","uuid":"b32519cc-f2f1-485c-9551-4eb1ce3dd69e","connectionId":14,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:56:51.996+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn20","msg":"Connection ended","attr":{"remote":"127.0.0.1:33264","uuid":"c2ca53fa-ec3b-41ab-be6a-4a954e30a2bc","connectionId":20,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:56:51.996+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn19","msg":"Connection ended","attr":{"remote":"127.0.0.1:33260","uuid":"0c12869c-80f7-4f0a-9f0b-302ed977b5c4","connectionId":19,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:56:51.996+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn17","msg":"Connection ended","attr":{"remote":"127.0.0.1:33248","uuid":"19ba50d3-f9a2-4f9b-a6ee-727f40a6c5d0","connectionId":17,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:56:51.996+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn18","msg":"Connection ended","attr":{"remote":"127.0.0.1:33258","uuid":"2dadd1d3-a311-41cf-b79b-665095ac2e0e","connectionId":18,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:56:55.555+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":4400}}
{"t":{"$date":"2022-11-30T19:56:59.960+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":4600}}
{"t":{"$date":"2022-11-30T19:57:01.564+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:34496","uuid":"b29ec6e6-8b6c-4b04-8aa0-0aa775e805c0","connectionId":21,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:57:01.567+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn21","msg":"client metadata","attr":{"remote":"127.0.0.1:34496","client":"conn21","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:01.580+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:34508","uuid":"5038102a-7e8f-4b45-b35e-742878f18186","connectionId":22,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:57:01.580+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:34518","uuid":"0b92f97f-cfe7-4482-a15d-4446081dd64f","connectionId":23,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:57:01.582+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn22","msg":"client metadata","attr":{"remote":"127.0.0.1:34508","client":"conn22","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:01.582+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn23","msg":"client metadata","attr":{"remote":"127.0.0.1:34518","client":"conn23","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:01.585+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:34520","uuid":"379d51c9-088c-43ee-aee5-53c47a6f6e38","connectionId":24,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:57:01.585+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:34532","uuid":"0c8b1915-605c-4c2d-952d-058e6b92f71c","connectionId":25,"connectionCount":5}}
{"t":{"$date":"2022-11-30T19:57:01.586+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn24","msg":"client metadata","attr":{"remote":"127.0.0.1:34520","client":"conn24","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:01.588+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn25","msg":"client metadata","attr":{"remote":"127.0.0.1:34532","client":"conn25","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:01.816+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn24","msg":"Connection ended","attr":{"remote":"127.0.0.1:34520","uuid":"379d51c9-088c-43ee-aee5-53c47a6f6e38","connectionId":24,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:57:01.816+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn21","msg":"Connection ended","attr":{"remote":"127.0.0.1:34496","uuid":"b29ec6e6-8b6c-4b04-8aa0-0aa775e805c0","connectionId":21,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:57:01.816+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn23","msg":"Connection ended","attr":{"remote":"127.0.0.1:34518","uuid":"0b92f97f-cfe7-4482-a15d-4446081dd64f","connectionId":23,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:57:01.816+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn25","msg":"Connection ended","attr":{"remote":"127.0.0.1:34532","uuid":"0c8b1915-605c-4c2d-952d-058e6b92f71c","connectionId":25,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:57:01.816+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn22","msg":"Connection ended","attr":{"remote":"127.0.0.1:34508","uuid":"5038102a-7e8f-4b45-b35e-742878f18186","connectionId":22,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:57:04.562+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":4800}}
{"t":{"$date":"2022-11-30T19:57:09.366+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":5000}}
{"t":{"$date":"2022-11-30T19:57:11.630+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:39780","uuid":"bb01d54e-8b7c-426c-99f7-e562557e1218","connectionId":26,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:57:11.635+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn26","msg":"client metadata","attr":{"remote":"127.0.0.1:39780","client":"conn26","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:11.652+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:39790","uuid":"9c5f4fdf-c0af-4555-8ad3-bd9e3ef27ec3","connectionId":27,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:57:11.652+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:39792","uuid":"9494e400-45b7-4167-9834-19b195ab73cd","connectionId":28,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:57:11.654+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn27","msg":"client metadata","attr":{"remote":"127.0.0.1:39790","client":"conn27","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:11.654+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn28","msg":"client metadata","attr":{"remote":"127.0.0.1:39792","client":"conn28","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:11.656+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:39804","uuid":"5ccb45cb-c919-4256-a7b9-3b399ecfee54","connectionId":29,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:57:11.658+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn29","msg":"client metadata","attr":{"remote":"127.0.0.1:39804","client":"conn29","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:11.692+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:39806","uuid":"60d92888-4678-4a39-bf90-9ae1b8d39e73","connectionId":30,"connectionCount":5}}
{"t":{"$date":"2022-11-30T19:57:11.695+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn30","msg":"client metadata","attr":{"remote":"127.0.0.1:39806","client":"conn30","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:11.706+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:39814","uuid":"98478d27-2175-4cde-8e83-390648c717f1","connectionId":31,"connectionCount":6}}
{"t":{"$date":"2022-11-30T19:57:11.706+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:39824","uuid":"abf82fae-e6af-453b-b8e8-18d2aa886903","connectionId":32,"connectionCount":7}}
{"t":{"$date":"2022-11-30T19:57:11.707+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn31","msg":"client metadata","attr":{"remote":"127.0.0.1:39814","client":"conn31","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:11.708+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn32","msg":"client metadata","attr":{"remote":"127.0.0.1:39824","client":"conn32","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:11.709+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:39838","uuid":"92621210-a490-4807-a68b-b9a1af79da55","connectionId":33,"connectionCount":8}}
{"t":{"$date":"2022-11-30T19:57:11.711+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn33","msg":"client metadata","attr":{"remote":"127.0.0.1:39838","client":"conn33","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:11.898+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn27","msg":"Connection ended","attr":{"remote":"127.0.0.1:39790","uuid":"9c5f4fdf-c0af-4555-8ad3-bd9e3ef27ec3","connectionId":27,"connectionCount":7}}
{"t":{"$date":"2022-11-30T19:57:11.898+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn26","msg":"Connection ended","attr":{"remote":"127.0.0.1:39780","uuid":"bb01d54e-8b7c-426c-99f7-e562557e1218","connectionId":26,"connectionCount":5}}
{"t":{"$date":"2022-11-30T19:57:11.898+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn28","msg":"Connection ended","attr":{"remote":"127.0.0.1:39792","uuid":"9494e400-45b7-4167-9834-19b195ab73cd","connectionId":28,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:57:11.898+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn29","msg":"Connection ended","attr":{"remote":"127.0.0.1:39804","uuid":"5ccb45cb-c919-4256-a7b9-3b399ecfee54","connectionId":29,"connectionCount":6}}
{"t":{"$date":"2022-11-30T19:57:11.953+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn30","msg":"Connection ended","attr":{"remote":"127.0.0.1:39806","uuid":"60d92888-4678-4a39-bf90-9ae1b8d39e73","connectionId":30,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:57:11.953+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn31","msg":"Connection ended","attr":{"remote":"127.0.0.1:39814","uuid":"98478d27-2175-4cde-8e83-390648c717f1","connectionId":31,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:57:11.953+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn33","msg":"Connection ended","attr":{"remote":"127.0.0.1:39838","uuid":"92621210-a490-4807-a68b-b9a1af79da55","connectionId":33,"connectionCount":0}}
{"t":{"$date":"2022-11-30T19:57:11.953+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn32","msg":"Connection ended","attr":{"remote":"127.0.0.1:39824","uuid":"abf82fae-e6af-453b-b8e8-18d2aa886903","connectionId":32,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:57:14.371+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":5200}}
{"t":{"$date":"2022-11-30T19:57:19.577+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"NotYetInitialized: Cannot use non-local read concern until replica set is finished initializing.","nextWakeupMillis":5400}}
{"t":{"$date":"2022-11-30T19:57:21.539+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:41262","uuid":"b6be8e17-e003-4c65-8264-ddad7a03d414","connectionId":34,"connectionCount":1}}
{"t":{"$date":"2022-11-30T19:57:21.542+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn34","msg":"client metadata","attr":{"remote":"127.0.0.1:41262","client":"conn34","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:21.553+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:41264","uuid":"308edaa8-b0a6-421b-a5ea-d8ad41b2e0c2","connectionId":35,"connectionCount":2}}
{"t":{"$date":"2022-11-30T19:57:21.553+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:41268","uuid":"e11c2cb6-a4b4-4eb3-ad1a-0739edf696ff","connectionId":36,"connectionCount":3}}
{"t":{"$date":"2022-11-30T19:57:21.554+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn35","msg":"client metadata","attr":{"remote":"127.0.0.1:41264","client":"conn35","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:21.555+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn36","msg":"client metadata","attr":{"remote":"127.0.0.1:41268","client":"conn36","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
{"t":{"$date":"2022-11-30T19:57:21.556+00:00"},"s":"I", "c":"NETWORK", "id":22943, "ctx":"listener","msg":"Connection accepted","attr":{"remote":"127.0.0.1:41280","uuid":"6c0f93cf-c058-408a-b22f-3d743666f208","connectionId":37,"connectionCount":4}}
{"t":{"$date":"2022-11-30T19:57:21.558+00:00"},"s":"I", "c":"NETWORK", "id":51800, "ctx":"conn37","msg":"client metadata","attr":{"remote":"127.0.0.1:41280","client":"conn37","doc":{"driver":{"name":"nodejs|mongosh","version":"4.10.0"},"os":{"type":"Linux","name":"linux","architecture":"x64","version":"5.4.209-116.367.amzn2.x86_64"},"platform":"Node.js v16.17.0, LE (unified)","version":"4.10.0|1.6.0","application":{"name":"mongosh 1.6.0"}}}}
I do not know but I guess the root user did not create or does not create due to following log lines getting from primary but not secondary pod, so i could not see ACCESS facility based on secondary but I saw the logs on only primary pod ?
{"t":{"$date":"2022-11-30T19:55:36.227+00:00"},"s":"I", "c":"ACCESS", "id":20251, "ctx":"conn3","msg":"Supported SASL mechanisms requested for unknown user","attr":{"user":{"user":"root","db":"admin"}}}
{"t":{"$date":"2022-11-30T19:55:36.227+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn3","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-256","speculative":true,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:48328","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:55:36.228+00:00"},"s":"I", "c":"ACCESS", "id":20249, "ctx":"conn3","msg":"Authentication failed","attr":{"mechanism":"SCRAM-SHA-1","speculative":false,"principalName":"root","authenticationDatabase":"admin","remote":"172.16.4.164:48328","extraInfo":{},"error":"UserNotFound: Could not find user \"root\" for db \"admin\""}}
{"t":{"$date":"2022-11-30T19:55:36.230+00:00"},"s":"I", "c":"NETWORK", "id":22944, "ctx":"conn2","msg":"Connection ended","attr":{"remote":"172.16.4.164:48312","uuid":"da1f76fa-0f6f-411d-a023-00737764d250","connectionId":2,"connectionCount":1}}
Hi @CeliaGMqrz
Did you have change to look at the issue ? Do you have any update ?
Hi @emre141
Thanks for reporting this but sorry, I need more time to reproduce this particular case. I have created an internal task to investigate the issue. We’ll leave this issue on hold until we have updates.
Hi @emre141
Thanks for reporting this but sorry, I need more time to reproduce this particular case. I have created an internal task to investigate the issue. We’ll leave this issue on hold until we have updates.
Hi Celina, Have you ever chance to test the case on your environment
Hi Emre.
I think you missed something in the values.yaml or in the instructions to reproduce the issue, for example architecture
is set standalone by default (which enforces the number of replicas to 1) and I don't see where did you set it. Could you review if you share correctly the values?
Other points you have to check are:
replicaSetName
value should be at root level, not under auth
enableLocalhostAuthBypass
should be set to true
at least during first installation to create the default users, after that you can upgrade your deployment and set it to false
Hi @fmulero ,
Actually I do not want to share whole values yaml, because its too big, So Yes I am using architecture
replicaset
because I want to deploy PSA(primary-secondary-arbiter)
By the way replicaSetName
. set at the root level, but i just wrote wrong place from here, otherwise helm does not deploy the release,
Lastly I tried to with enableLocalhostAuthBypass
this parameter to true
but I had got same error,
If you want to reproduce the case on your local , I am able to share the full values.yaml and helm command with flags on here ?
I tried a couple of different way to install mongodb replicaset let me share the way which was successed and failed
Success Scenari-1
helm install my-release \
--set auth.rootPassword=secretpassword,auth.username=my-user,auth.password=my-password,auth.database=my-database,architecture=replicaset,replicaCount=2,persistence.storageClass=gp2-new my-repo/mongodb
⚡ ⇒ kubectl get pods -l app.kubernetes.io/instance=my-release
NAME READY STATUS RESTARTS AGE
my-release-mongodb-0 1/1 Running 0 4m26s
my-release-mongodb-1 1/1 Running 0 3m48s
my-release-mongodb-arbiter-0 1/1 Running 0 4m26s
Primary Pod Log Output
mongodb 19:34:52.07 INFO ==> Advertised Hostname: my-release-mongodb-0.my-release-mongodb-headless.infra.svc.cluster.local
mongodb 19:34:52.08 INFO ==> Advertised Port: 27017
realpath: /bitnami/mongodb/data/db: No such file or directory
mongodb 19:34:52.08 INFO ==> Data dir empty, checking if the replica set already exists
MongoNetworkError: connect ECONNREFUSED 172.16.6.17:27017
mongodb 19:34:53.98 INFO ==> Pod name matches initial primary pod name, configuring node as a primary
mongodb 19:34:53.99
mongodb 19:34:53.99 Welcome to the Bitnami mongodb container
mongodb 19:34:53.99 Subscribe to project updates by watching https://github.com/bitnami/containers
mongodb 19:34:53.99 Submit issues and feature requests at https://github.com/bitnami/containers/issues
mongodb 19:34:54.00
mongodb 19:34:54.00 INFO ==> ** Starting MongoDB setup **
mongodb 19:34:54.01 INFO ==> Validating settings in MONGODB_* env vars...
mongodb 19:34:54.35 INFO ==> Initializing MongoDB...
mongodb 19:34:54.37 INFO ==> Deploying MongoDB from scratch...
MongoNetworkError: connect ECONNREFUSED 172.16.6.17:27017
**mongodb 19:34:56.37 INFO ==> Creating users...
mongodb 19:34:56.38 INFO ==> Creating root user...**
Current Mongosh Log ID: 6390eae129d528632842af04
Connecting to: mongodb://127.0.0.1:27017/?directConnection=true&serverSelectionTimeoutMS=2000&appName=mongosh+1.6.0
Using MongoDB: 6.0.3
Using Mongosh: 1.6.0
For mongosh info see: https://docs.mongodb.com/mongodb-shell/
Clean Release and Persistent Volumes
helm uninstall my-release
kubectl delete pvc datadir-my-release-mongodb-0 datadir-my-release-mongodb-1
kubectl delete pv pvc-cd8d9e1b-3d63-4cdb-a83d-d738c2787f23 pvc-df853eb1-dddb-4586-95ef-d32e72146f53
Delete volume from EBS console (permentantly cleaned)
Success Scenario-2 Just use latest chart version and without custom user and custom database
helm install my-release \
--set auth.rootPassword=secretpassword,architecture=replicaset,replicaCount=2,persistence.storageClass=gp2-new my-repo/mongodb
⚡ ⇒ kubectl get pods -l app.kubernetes.io/instance=my-release
NAME READY STATUS RESTARTS AGE
my-release-mongodb-0 1/1 Running 0 4m26s
my-release-mongodb-1 1/1 Running 0 3m48s
my-release-mongodb-arbiter-0 1/1 Running 0 4m26s
Mongodb Primary Pod Log
mongodb 19:45:47.79 INFO ==> Advertised Hostname: my-release-mongodb-0.my-release-mongodb-headless.infra.svc.cluster.local
mongodb 19:45:47.79 INFO ==> Advertised Port: 27017
realpath: /bitnami/mongodb/data/db: No such file or directory
mongodb 19:45:47.80 INFO ==> Data dir empty, checking if the replica set already exists
MongoNetworkError: getaddrinfo ENOTFOUND my-release-mongodb-1.my-release-mongodb-headless.infra.svc.cluster.local
mongodb 19:45:49.08 INFO ==> Pod name matches initial primary pod name, configuring node as a primary
mongodb 19:45:49.09
mongodb 19:45:49.09 Welcome to the Bitnami mongodb container
mongodb 19:45:49.09 Subscribe to project updates by watching https://github.com/bitnami/containers
mongodb 19:45:49.09 Submit issues and feature requests at https://github.com/bitnami/containers/issues
mongodb 19:45:49.10
mongodb 19:45:49.10 INFO ==> ** Starting MongoDB setup **
mongodb 19:45:49.11 INFO ==> Validating settings in MONGODB_* env vars...
mongodb 19:45:49.18 INFO ==> Initializing MongoDB...
mongodb 19:45:49.20 INFO ==> Deploying MongoDB from scratch...
MongoNetworkError: connect ECONNREFUSED 172.16.6.17:27017
mongodb 19:45:51.10 INFO ==> Creating users...
mongodb 19:45:51.10 INFO ==> Creating root user...
Current Mongosh Log ID: 6390ed70b1dfe0a264ad4cd6
Connecting to: mongodb://127.0.0.1:27017/?directConnection=true&serverSelectionTimeoutMS=2000&appName=mongosh+1.6.0
Using MongoDB: 6.0.3
Using Mongosh: 1.6.0
Clean Release and Persistent Volumes
Failed Scenario
helm install my-release --set auth.rootPassword=secretpassword -f values.prod-rs-deneme.yaml my-repo/mongodb
mongodbprodrepldeployment⚡ ⇒ kubectl get pods -l app.kubernetes.io/instance=my-release
NAME READY STATUS RESTARTS AGE
my-release-0 1/1 Running 0 4m55s
my-release-1 1/1 Running 0 4m28s
**my-release-arbiter-0 1/1 Running 1 4m55s**
Mongodb Primary POD Initial Logs
mongodb 20:00:52.96 INFO ==> Advertised Hostname: my-release-0.my-release-headless.infra.svc.cluster.local
mongodb 20:00:52.96 INFO ==> Advertised Port: 27017
mongodb 20:00:52.96 INFO ==> Pod name matches initial primary pod name, configuring node as a primary
mongodb 20:00:52.97
mongodb 20:00:52.97 Welcome to the Bitnami mongodb container
mongodb 20:00:52.97 Subscribe to project updates by watching https://github.com/bitnami/containers
mongodb 20:00:52.97 Submit issues and feature requests at https://github.com/bitnami/containers/issues
mongodb 20:00:52.97
mongodb 20:00:52.97 INFO ==> ** Starting MongoDB setup **
mongodb 20:00:52.98 INFO ==> Validating settings in MONGODB_* env vars...
mongodb 20:00:53.01 INFO ==> Initializing MongoDB...
mongodb 20:00:53.01 INFO ==> Deploying MongoDB with persisted data...
mongodb 20:00:53.01 INFO ==> Writing keyfile for replica set authentication...
mongodb 20:00:53.02 INFO ==> ** MongoDB setup finished! **
mongodb 20:00:53.03 INFO ==> ** Starting MongoDB **
{"t":{"$date":"2022-12-07T20:00:53.049Z"},"s":"I", "c":"CONTROL", "id":5760901, "ctx":"-","msg":"Applied --setParameter options","attr":{"serverParameters":{"enableLocalhostAuthBypass":{"default":true,"value":true}}}}
Also, I added the values yaml file to the attachment by zip format,
By the way I clean the release (release- pvc - pv - ebs volume ) afterthat just comment the configration block from values yaml then reuse same helm install command,
commented lines
#configuration: |
# # mongod.conf
# # for documentation of all options, see:
# # http://docs.mongodb.org/manual/reference/configuration-options/
#
# # where and how to store data.
# storage:
# dbPath: /bitnami/mongodb/data/db
# journal:
# enabled: true
# directoryPerDB: false
# engine: wiredTiger
# wiredTiger:
# engineConfig:
# cacheSizeGB: 2
#
# # where to write logging data.
# systemLog:
# destination: file
# quiet: false
# logAppend: true
# logRotate: reopen
# path: /opt/bitnami/mongodb/logs/mongodb.log
# verbosity: 0
#
# # network interfaces
# net:
# port: 27017
# unixDomainSocket:
# enabled: true
# pathPrefix: /opt/bitnami/mongodb/tmp
# ipv6: false
# bindIpAll: true
# #bindIp:
#
# # replica set options
# replication:
# replSetName: prodrs
# enableMajorityReadConcern: true
#
# # sharding options
# #sharding:
# #clusterRole:
#
# # process management options
# processManagement:
# fork: false
# pidFilePath: /opt/bitnami/mongodb/tmp/mongodb.pid
#
# # set parameter options
# setParameter:
# enableLocalhostAuthBypass: true
#
# # security options
# security:
# authorization: enabled
# keyFile: /opt/bitnami/mongodb/conf/keyfile
# configuration: ""
## @section replicaSetConfigurationSettings settings applied during runtime (not via configuration file)
## If enabled, these are applied by a script which is called within setup.sh
## for documentation see https://docs.mongodb.com/manual/reference/replica-configuration/#replica-set-configuration-fields
## @param replicaSetConfigurationSettings.enabled Enable MongoDB(®) Switch to enable/disable configuring MongoDB(®) run time rs.conf settings
## @param replicaSetConfigurationSettings.configuration run-time rs.conf settings
##
helm install my-release --set auth.rootPassword=secretpassword -f values.prod-rs-deneme.yaml my-repo/mongodb
The result same
mongodbprodrepldeployment⚡ ⇒ kubectl get pods -l app.kubernetes.io/instance=my-release
NAME READY STATUS RESTARTS AGE
my-release-0 1/1 Running 0 5m47s
my-release-1 1/1 Running 0 5m20s
my-release-arbiter-0 1/1 Running 1 5m47s
Primary POD Log Output
mongodb 20:11:35.02 INFO ==> Advertised Hostname: my-release-0.my-release-headless.infra.svc.cluster.local
mongodb 20:11:35.02 INFO ==> Advertised Port: 27017
mongodb 20:11:35.02 INFO ==> Pod name matches initial primary pod name, configuring node as a primary
mongodb 20:11:35.03
mongodb 20:11:35.03 Welcome to the Bitnami mongodb container
mongodb 20:11:35.03 Subscribe to project updates by watching https://github.com/bitnami/containers
mongodb 20:11:35.03 Submit issues and feature requests at https://github.com/bitnami/containers/issues
mongodb 20:11:35.03
mongodb 20:11:35.03 INFO ==> ** Starting MongoDB setup **
mongodb 20:11:35.04 INFO ==> Validating settings in MONGODB_* env vars...
mongodb 20:11:35.07 INFO ==> Initializing MongoDB...
mongodb 20:11:35.09 INFO ==> Enabling authentication...
mongodb 20:11:35.09 INFO ==> Deploying MongoDB with persisted data...
mongodb 20:11:35.10 INFO ==> Writing keyfile for replica set authentication...
mongodb 20:11:35.12 INFO ==> ** MongoDB setup finished! **
mongodb 20:11:35.13 INFO ==> ** Starting MongoDB **
{"t":{"$date":"2022-12-07T20:11:35.149Z"},"s":"I", "c":"CONTROL", "id":5760901, "ctx":"-","msg":"Applied --setParameter options","attr":{"serverParameters":{"enableLocalhostAuthBypass":{"default":true,"value":false}}}}
Arbiter POD Log Output
mongodbprodrepldeployment⚡ ⇒ k logs my-release-arbiter-0
mongodb 20:15:04.35
mongodb 20:15:04.36 Welcome to the Bitnami mongodb container
mongodb 20:15:04.36 Subscribe to project updates by watching https://github.com/bitnami/containers
mongodb 20:15:04.36 Submit issues and feature requests at https://github.com/bitnami/containers/issues
mongodb 20:15:04.36
mongodb 20:15:04.36 INFO ==> ** Starting MongoDB setup **
mongodb 20:15:04.37 INFO ==> Validating settings in MONGODB_* env vars...
mongodb 20:15:04.39 INFO ==> Initializing MongoDB...
mongodb 20:15:04.41 INFO ==> Deploying MongoDB from scratch...
MongoNetworkError: connect ECONNREFUSED 172.16.0.37:27017
mongodb 20:15:05.78 INFO ==> Creating users...
mongodb 20:15:05.79 INFO ==> Users created
mongodb 20:15:05.79 INFO ==> Writing keyfile for replica set authentication...
mongodb 20:15:05.80 INFO ==> Configuring MongoDB replica set...
mongodb 20:15:05.80 INFO ==> Stopping MongoDB...
mongodb 20:15:09.28 INFO ==> Trying to connect to MongoDB server my-release-0.my-release-headless.infra.svc.cluster.local...
mongodb 20:15:09.28 INFO ==> Found MongoDB server listening at my-release-0.my-release-headless.infra.svc.cluster.local:27017 !
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
MongoServerError: Authentication failed.
I mean there is something broken the mongo installation while initial setup within values.yaml file but unfortunately I did not found it yet
Hi @CeliaGMqrz @fmulero
Did you have a chance to had good time to test the case on your environment ?
Sorry I haven't got the chance to revisit it yet. Could you compare your values files with the default one and set only the values you are interested in?
Hi @fmulero No problem, I mean I have already shared the values file which I tried to install but failed, Let me share only difference part of the values
fullnameOverride
= my-release
namespaceOverride
= infra
commonLabels
=
onedio_service_owner: "emre-_-gundogdu-_-onedio-_-com"
onedio_team: "onedio"
onedio_environment: "production"
shared_infra_team: "onedio"
product_line: "infra"
product: "mongodbtest"
bitnami/mongodb
tag 6.0.3-debian-11-r4
architecture
= replicaset
replicaSetKey
= mongoprod
replicaSetName
= prodrs
configuration
configuration: |
# mongod.conf
# for documentation of all options, see:
# http://docs.mongodb.org/manual/reference/configuration-options/
# where and how to store data.
storage:
dbPath: /bitnami/mongodb/data/db
journal:
enabled: true
directoryPerDB: false
engine: wiredTiger
wiredTiger:
engineConfig:
cacheSizeGB: 2
# where to write logging data.
systemLog:
destination: file
quiet: false
logAppend: true
logRotate: reopen
path: /opt/bitnami/mongodb/logs/mongodb.log
verbosity: 0
# network interfaces
net:
port: 27017
unixDomainSocket:
enabled: true
pathPrefix: /opt/bitnami/mongodb/tmp
ipv6: false
bindIpAll: true
#bindIp:
# replica set options
replication:
replSetName: prodrs
enableMajorityReadConcern: true
# sharding options
#sharding:
#clusterRole:
# process management options
processManagement:
fork: false
pidFilePath: /opt/bitnami/mongodb/tmp/mongodb.pid
# set parameter options
setParameter:
enableLocalhostAuthBypass: true
# security options
security:
authorization: enabled
keyFile: /opt/bitnami/mongodb/conf/keyfile
affinity
affinity:
nodeAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
nodeSelectorTerms:
- matchExpressions:
- key: name
operator: NotIn
values:
- kube-system
- key: currentness
operator: NotIn
values:
- old
- key: workload-type
operator: In
values:
- mongo
podAntiAffinity:
preferredDuringSchedulingIgnoredDuringExecution:
- weight: 100
podAffinityTerm:
labelSelector:
matchExpressions:
- key: product
operator: In
values:
- mongodbtest
topologyKey: kubernetes.io/hostname
tolerations
- key: "workload"
operator: "Equal"
value: "mongodb"
effect: "NoSchedule"
- key: "workload"
operator: "Equal"
value: "mongodb"
effect: "NoExecute"
request
and limit
limits:
cpu: 3
memory: 30Gi
## Examples:
## requests:
## cpu: 100m
## memory: 128Mi
##
requests:
cpu: 100m
memory: 1Gi
storageClass
= gp2-new
mountPath
= /bitnami/mongodb/data/db
size
= 8Gi
Rest of the definition same.
Hi @fmulero @CeliaGMqrz
Did you have any chance review the shared values yaml diff or test to deploy shared values on your environment ?
Hi Emre
The problem seems related to this In your configuration you are setting the keyFile
and this file is created and configured automatically after first initialization. What is happening? this first initialization is trying to find the file but it doesn't exist yet. There is no easy solution for this issue, so I will open an internal discussion about this topic.
As workarund you can install the chart without the configuration
value and after that, upgrade the chart with the configuration
value. It will work because the /opt/bitnami/mongodb/conf/keyfile
will be taken from the persistent volume.
Hi @fmulero
Yes I tried workaroud , it is working , we are waiting to fix the issue permenantly, Thanks so much 👍
Could this issue be related to #13364 (I know that one is mongodb-sharded)?
Hi Emre. We have been discussing possible solutions for this issue and we have not found any solution that could work without having to make major/breaking changes in the container side. Said that I will close the issue
Anyway, contributions are welcome and we will be happy to review them and provide feedback.
I ran into a similar error, also using bitnami's mongodb chart. It was because mongo's root password had an apostrophe in it, which threw a syntax error in the mongosh command to create the root user. Maybe this comment will help someone else out there who generates random passwords.
Hey I was running into this as well, and it was driving me crazy. My simple solution was to uninstall everything and then delete the pvcs! Looks like the pvcs were hanging around and my new install was reattaching. Hope this helps ppl!
Thanks @domenicbove Deleting the pvcs solve the issue for me.
Is there a solution to re-use the PVCs or recover my data?
Hi @fortra-cloudops-platform if you don't have the credentials and/or the values used to deploy the previous installation, you could try to restore the root password but is not always possible. More details in MongoDB documentation:
Name and Version
bitname/mongodb:13.5.0
What steps will reproduce the bug?
Bitnami Helm Chart : mongodb Chart Version: 13.5.0 MongoDB Image Version: 6.0.3-debian-11-r4 Helm Version: v3.7.2 Kubernetes Engine Version: 1.21 Cloud Provider: AWS Storage Provisioner: kubernetes.io/aws-ebs
Are you using any custom parameters or values?
I am using default values.yaml only except below parameter
Cluster Configuration
--set auth.rootPassword and --set auth.replicaSetKey
What is the expected behavior?
No response
What do you see instead?
I followed up the outputed steps after helm chart installed, I execute a mongo client pod tried to connect to the mongo primary pod but I have got below error output,
As well I have got authentication failed error from arbiter pod due to that the arbiter pods consistently restarting
Arbiter Pod Logs