search

openebs-archive / longhorn

We put storage on cows and move them around
Apache License 2.0
18 stars 12 forks source link

Issue while syncing: Failed to find meta file error #19

Closed ksatchit closed 4 years ago

ksatchit commented 5 years ago

Detailed logs for this issue can be seen here: https://api.travis-ci.org/v3/job/409381115/log.txt

[0014] Done running ssync[ssync -port 9704 -daemon volume-snap-5f24a71d-7d81-40f5-b5dd-2d3a01716433.img.meta -timeout 7]
[2018-07-28T21:19:52Z] Done synchronizing volume-snap-5f24a71d-7d81-40f5-b5dd-2d3a01716433.img.meta to volume-snap-5f24a71d-7d81-40f5-b5dd-2d3a01716433.img.meta@172.18.0.5:9704
[2018-07-28T21:19:52Z] reloadAndVerify tcp://172.18.0.5:9502        
[2018-07-28T21:19:52Z] Reload Replica                               
[2018-07-28T21:19:52Z] Reloading volume                             
[2018-07-28T21:19:52Z] error in Reload                              
[2018-07-28T21:19:52Z] Error Failed to find metadata for volume-snap-00103065-6f23-4da5-9d4b-d1168d5e9559.img in doOp: /v1/replicas/1?action=reload
[2018-07-28T21:19:52Z] error in reloadReplica Failed to find metadata for volume-snap-00103065-6f23-4da5-9d4b-d1168d5e9559.img
[2018-07-28T21:19:52Z] Error in request: Failed to find metadata for volume-snap-00103065-6f23-4da5-9d4b-d1168d5e9559.img
172.18.0.5 - -[28/Jul/2018:21:19:52 +0000] "POST /v1/replicas/1?action=reload HTTP/1.1" 500 226
[2018-07-28T21:19:52Z] Error in reloadreplica tcp://172.18.0.5:9502
[2018-07-28T21:19:52Z] Error adding replica, err: Bad response: 500 500 Internal Server Error: {"actions":{},"code":"Server Error","detail":"","links":{"self":"http://172.18.0.5:9502/v1/replicas/1"},"message":"Failed to find metadata for volume-snap-00103065-6f23-4da5-9d4b-d1168d5e9559.img","status":500,"type":"error"}
, will retry
[2018-07-28T21:19:54Z] Closing replica                              
[2018-07-28T21:19:54Z] Addreplica tcp://172.18.0.5:9502             
[2018-07-28T21:19:54Z] Get Volume info from controller
[2018-07-28T21:19:54Z] CheckAndResetFailedRebuild tcp://172.18.0.5:9502
[2018-07-28T21:19:54Z] Opening volume /vol3, size 2147483648/512    
[2018-07-28T21:19:54Z] Error Failed to find metadata for volume-snap-00103065-6f23-4da5-9d4b-d1168d5e9559.img during open
[2018-07-28T21:19:54Z] Error during open in checkAndResetFailedRebuild
[2018-07-28T21:19:54Z] CheckAndResetFailedRebuild failed, err:Failed to find metadata for volume-snap-00103065-6f23-4da5-9d4b-d1168d5e9559.img
[2018-07-28T21:19:54Z] Error adding replica, err: Failed to find metadata for volume-snap-00103065-6f23-4da5-9d4b-d1168d5e9559.img, will retry
[2018-07-28T21:19:56Z] Closing replica    
[2018-07-28T21:19:56Z] Close replica failed, s.r not set
[2018-07-28T21:19:56Z] Addreplica tcp://172.18.0.5:9502     
[2018-07-28T21:19:56Z] Get Volume info from controller              
[2018-07-28T21:19:56Z] CheckAndResetFailedRebuild tcp://172.18.0.5:9502
[2018-07-28T21:19:56Z] Opening volume /vol3, size 2147483648/512    
[2018-07-28T21:19:56Z] Error Failed to find metadata for volume-snap-00103065-6f23-4da5-9d4b-d1168d5e9559.img during open
[2018-07-28T21:19:56Z] Error during open in checkAndResetFailedRebuild
[2018-07-28T21:19:56Z] CheckAndResetFailedRebuild failed, err:Failed to find metadata for volume-snap-00103065-6f23-4da5-9d4b-d1168d5e9559.img
[2018-07-28T21:19:56Z] Error adding replica, err: Failed to find metadata for volume-snap-00103065-6f23-4da5-9d4b-d1168d5e9559.img, will retry
[2018-07-28T21:19:58Z] Closing replica
ksatchit commented 5 years ago

cc: @utkarshmani1997