search

yougov / mongo-connector

MongoDB data stream pipeline tools by YouGov (adopted from MongoDB)
Apache License 2.0
1.88k stars 479 forks source link

OplogThread: Last entry no longer in oplog cannot recover! #448

Open shanghaiyangming opened 8 years ago

shanghaiyangming commented 8 years ago

why??? 2016-05-13 19:33:34,874 [DEBUG] mongo_connector.oplog_manager:294 - OplogThread: Doc is processed. 2016-05-13 19:33:37,088 [DEBUG] mongo_connector.oplog_manager:306 - OplogThread: updating checkpoint afterprocessing new oplog entries 2016-05-13 19:33:37,089 [DEBUG] mongo_connector.oplog_manager:654 - OplogThread: oplog checkpoint updated to Timestamp(1463139214, 48) 2016-05-13 19:33:37,089 [DEBUG] mongo_connector.oplog_manager:188 - OplogThread: Cursor is still alive and thread is still running. 2016-05-13 19:33:39,257 [DEBUG] mongo_connector.oplog_manager:306 - OplogThread: updating checkpoint afterprocessing new oplog entries 2016-05-13 19:33:39,257 [DEBUG] mongo_connector.oplog_manager:654 - OplogThread: oplog checkpoint updated to Timestamp(1463139214, 48) 2016-05-13 19:33:39,257 [DEBUG] mongo_connector.oplog_manager:188 - OplogThread: Cursor is still alive and thread is still running. 2016-05-13 19:33:41,440 [DEBUG] mongo_connector.oplog_manager:306 - OplogThread: updating checkpoint afterprocessing new oplog entries 2016-05-13 19:33:41,440 [DEBUG] mongo_connector.oplog_manager:654 - OplogThread: oplog checkpoint updated to Timestamp(1463139214, 48) 2016-05-13 19:33:41,441 [DEBUG] mongo_connector.oplog_manager:188 - OplogThread: Cursor is still alive and thread is still running. 2016-05-13 19:33:42,490 [DEBUG] mongo_connector.oplog_manager:194 - OplogThread: Iterating through cursor, document number in this cursor is 0 2016-05-13 19:33:42,490 [DEBUG] mongo_connector.oplog_manager:239 - OplogThread: Operation for this entry is i 2016-05-13 19:33:42,506 [DEBUG] mongo_connector.oplog_manager:294 - OplogThread: Doc is processed. 2016-05-13 19:33:44,721 [DEBUG] mongo_connector.oplog_manager:306 - OplogThread: updating checkpoint afterprocessing new oplog entries 2016-05-13 19:33:44,721 [DEBUG] mongo_connector.oplog_manager:654 - OplogThread: oplog checkpoint updated to Timestamp(1463139222, 28) 2016-05-13 19:33:44,721 [DEBUG] mongo_connector.oplog_manager:188 - OplogThread: Cursor is still alive and thread is still running. 2016-05-13 19:33:46,337 [ERROR] mongo_connector.oplog_manager:167 - OplogThread: Last entry no longer in oplog cannot recover! Collection(Database(MongoClient(host=[u'10.0.0.41:60000', u'10.0.0.40:60000', u'10.0.0.42:60000'], document_class=dict, tz_aware=False, connect=True, replicaset=u'6w_shard1'), u'local'), u'oplog.rs') 2016-05-13 19:33:46,890 [DEBUG] mongo_connector.oplog_manager:306 - OplogThread: updating checkpoint afterprocessing new oplog entries 2016-05-13 19:33:46,890 [DEBUG] mongo_connector.oplog_manager:654 - OplogThread: oplog checkpoint updated to Timestamp(1463139222, 28) 2016-05-13 19:33:46,890 [DEBUG] mongo_connector.oplog_manager:188 - OplogThread: Cursor is still alive and thread is still running. 2016-05-13 19:33:46,906 [ERROR] mongo_connector.connector:321 - MongoConnector: OplogThread <OplogThread(Thread-2, stopped 140000008066816)> unexpectedly stopped! Shutting down 2016-05-13 19:33:46,906 [INFO] mongo_connector.connector:359 - MongoConnector: Stopping all OplogThreads 2016-05-13 19:33:46,906 [DEBUG] mongo_connector.oplog_manager:335 - OplogThread: exiting due to join call. 2016-05-13 19:33:46,906 [DEBUG] mongo_connector.oplog_manager:335 - OplogThread: exiting due to join call.

shanghaiyangming commented 8 years ago

after update checkpoint "OplogThread: Last entry no longer in oplog cannot recover!"

llvtt commented 8 years ago

See this page: https://github.com/mongodb-labs/mongo-connector/wiki/Resyncing-the-Connector