search

torodb / stampede

The ToroDB solution to provide better analytics on top of MongoDB and make it easier to migrate from MongoDB to SQL
https://www.torodb.com/stampede/
GNU Affero General Public License v3.0
1.77k stars 120 forks source link

WARN REPL - Expected string type for field notEligibleForMBSBackups. Found STRING #204

Open samuelralak opened 7 years ago

samuelralak commented 7 years ago

I am trying to migrate data from an a remote m-lab mongo database. The connection authenticates fine but I am still unable to get any tables or data pulled; instead I keep on getting the following warning WARN REPL - Expected string type for field notEligibleForMBSBackups. Found STRING. Any leads on what might be causing this?

teoincontatto commented 7 years ago

Hi @samuelralak,

It seems you hit a bug. For some reason a deserialization of a BSON from mongo failed with this weird message. Since it is hard to reproduce for us and spot the exact point where this is happening would you mind paste here the logs around the error message using this configuration file for logging:

https://github.com/torodb/stampede/raw/master/main/src/main/profiles/dev/log4j2.xml

This can be achieved by adding to ToroDB Stampede's configuration the log4j2File parameter in the logging section as follow:

...
logging:
  log4j2File: '<path to downloaded log4j2.xml>'
...
samuelralak commented 7 years ago

Hi @teoincontatto

I have attached a screenshot of the error message I keep on getting.

12:24:43.051 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:44.558 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:44.559 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:44.559 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:45.801 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:45.801 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:45.801 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:47.034 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:47.034 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:47.034 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:48.273 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:48.273 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:48.273 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:49.512 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:49.512 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:49.512 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:51.244 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:51.244 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:51.244 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:52.784 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:52.784 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:52.785 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:54.071 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:54.071 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:54.071 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:55.338 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:55.338 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:55.338 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:56.569 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:56.569 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:56.569 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:57.797 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:57.797 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:57.798 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:59.452 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:59.452 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
screen shot 2017-08-30 at 12 03 07 pm screen shot 2017-08-30 at 12 09 49 pm
samuelralak commented 7 years ago

Hey @teoincontatto, quick update:

we contacted mlab support and found out that one of our replicaSet member has a config tag of:

"tags": {
    "notEligibleForMBSBackups": "yes"
}

How does the above affect stampede and how do I get around it? Are there any special replicaSet tags required by stampede?

teoincontatto commented 7 years ago

Hi @samuelralak,

We have added a ticket to investigate if it is a bug and if so resolve it.

You could try to remove the tag to see if ToroDB Stampede is able to replicate?

samuelralak commented 7 years ago

Hey @teoincontatto I don't think that removing the tag config is an option for us at the moment. Its purpose is to prevent m-lab's own backup system from using our own hidden analytics node for backup; however, I'll discuss it with my team and see the best way forward.

justinr1234 commented 5 years ago

@teoincontatto Having this same issue