backup failed on fields with binary data

hef82 commented 10 years ago

If some fields are binary data, those data will not be properly exported. For example, I have a field 'content', compressed by gzip, presents in mongodb shell as based64 string, when exported by Tayra will be serialized as the same plain text: ''.

According to https://jira.mongodb.org/browse/JAVA-488, line 105 of Backup.groovy should be changed to: return com.mongodb.util.JSONSerializers.getStrict().serialize(cursor.next())

viveksd87 commented 10 years ago

Hi, Thanks for reporting the issue. We were able to re-create it using some images stored as binary data. We have taken into account your reference and are working to fix it. Would release it soon.

ericfranckx commented 10 years ago

Hi, same situation. We like to approach of be able to generates "logs" on file system from the oplogs database collection. So allow to re-apply "changes" to any restore. (restore faster done on file system level) In my source DB with a upload file : BinData(0,"UmVhZE1lLnR4dAo9PT09PT09PT09CgpUYXlyYSBpcyBhbiBpbmNyZW1lbnRhbCBiYWNrdXAgYW5kIHJlc3RvcmUgdXRpbGl0eSBmb3IgTW9uZ29EQi4KCllvdSBjYW4gdmlldyBUYXlyYSBhcyBhbiBleHRlcm5hbCBhbmQgcGVyc2lzdGVudCBvcGxvZyB0aGF0IGlzIHN0b3JlZCBvbiB0aGUKZmlsZSBzeXN0ZW0gaW5zdGVhZCBvZiByZXNpZGluZyB3aXRoaW4gTW9uZ29EQi4gVGhlIGZpbGVzIGdlbmVyYXRlZCBjYW4gdGhlbiBiZQp1c2VkIHRvIHJlc3RvcmUgdGhlIGRhdGEgaW5jcmVtZW50YWxseSB0byBhbnkgdGFyZ2V0IE1vbmdvREIgaW5zdGFuY2UsIHdoaWNoIGNhbgpiZSBpbmplY3RlZCBpbnRvIGEgcmVwbGljYSBzZXQgaW4gY2FzZSBvZiBhbnkgZXZlbnQgdGhhdCB0aHJlYXRlbnMgdGhlCmF2YWlsYWJpbGl0eSBvZiBzZXJ2aWNlLgoKSW5pdGlhbGx5LCB5b3UgY2FuIHNlZWQgYmFja3VwIGFuZCBzdWJzZXF1ZW50bHkgYmFjay11cCBkYXRhIGluIGFuIGluY3JlbWVudGFsCmZhc2hpb24uCgpZb3UgY2FuIGFsc28gc3BlY2lmeSB0aGUgbnVtYmVyIG9mIGZpbGVzIGFuZCBzaXplIG9mIHRob3NlIGZpbGVzIHRvIGVuc3VyZQpyb3RhdGluZyBvdXRwdXQgZmlsZXMsIGdpdmluZyB5b3UgYSB3aW5kb3cgdG8gcGVyZm9ybSByZXN0b3JlIG9uY2UgbWF4IG51bWJlcgpvbiB0aGUgcm90YXRpbmcgZmlsZSBpcyByZWFjaGVkLgoKWW91IGNhbiBkZWNpZGUgZWl0aGVyIHRvIGJhY2t1cCBmcm9tIHByaW1hcnkgb3Igc2Vjb25kYXJ5IG9mIHRoZSByZXBsaWNhIHNldCBieQpzdGFydGluZyB0aGUgcHJvY2VzcyBvdmVyIHRoYXQgbm9kZS4gSW4gdGhlIGV2ZW50IG9mIGEgbm9kZSBjcmFzaCwgVGF5cmEgd2lsbAphdXRvbWF0aWNhbGx5IHN3aXRjaCBvdmVyIHRvIHRoZSBuZXh0IHNpbWlsYXIgbm9kZSAocHJpbWFyeSBmb3IgcHJpbWFyeSBhbmQKc2Vjb25kYXJ5IHByZWZlcnJlZCBmb3Igc2Vjb25kYXJ5KSBhbmQgd2lsbCByZXN1bWUgdGhlIGJhY2t1cCBmcm9tIHdoZXJlIGl0IGxlZnQKd2l0aG91dCB1c2VyIGludGVydmVudGlvbi4KCllvdSBjYW4gYWxzbyBwZXJmb3JtIGEgYmFja3VwIG9yIHJlc3RvcmUgYnkgc2VsZWN0aXZlbHkgaW5jbHVkaW5nIG9yIGV4Y2x1ZGluZyAKZG9jdW1lbnRzIHNhdGlzZnlpbmcgYSBjZXJ0YWluIGNyaXRlcmlhLiBDcml0ZXJpYSB3aGljaCBjYW4gYmUgYXBwbGllZCBhcmUgCnRpbWUtYm91bmRpbmcgZG9jdW1lbnRzLCBmaWx0ZXJpbmcgb24gdGhlIGJhc2lzIG9mIGRhdGFiYXNlIGFuZCBjb2xsZWN0aW9ucy4KCllvdSBjYW4gaGF2ZSBhIGRyeS1ydW4gdG8gYW5hbHlzZSB0aGUgZG9jdW1lbnRzIHlvdSBoYXZlIHNlbGVjdGVkIHRvIGJlIHJlc3RvcmVkLgoKRmVhdHVyZXMgU3VtbWFyeToKKiBTZWxlY3RpdmUgcmVzdG9yZQoqIFJvdGF0aW5nIExvZ3MgaW4gYmFja3VwIGFuZCByZXN0b3JlCiogU3Vydml2aW5nIG5vZGUgY3Jhc2ggaW4gYSByZXBsaWNhIHNldAoqIFNlY3VyZWQgYW5kIHVuc2VjdXJlZCBiYWNrdXAvcmVzdG9yZQoqIERyeS1ydW4KKiBTZWxlY3RpdmUgYmFja3VwCiogTW9yZSBncmFudWxhciBzZWxlY3Rpb24gY3JpdGVyaWEgZm9yIGJhY2t1cCBhbmQgcmVzdG9yZQogIC1tdWx0aXBsZSBkYnMgYW5kIGNvbGxlY3Rpb25zCiAgLWV4Y2x1ZGUgdGhlIGNyaXRlcmlhIGdpdmVuCgpQcmUtUmVxdWlzaXRlcwoqIEl0IGFzc3VtZXMgdGhhdCB5b3UgaGF2ZSBKREsxLjYgb3IgMS43IGluc3RhbGxlZCBhbmQgeW91IGhhdmUgamF2YQppbiB5b3VyIHBhdGguCgpSdW5uaW5nIFRheXJhCiogQWZ0ZXIgaGF2aW5nIGV4cGxvZGVkIHRoZSBUYXlyYSB6aXAgLQogICogRm9yIFVuaXggbWFjaGluZSwgZ3JhbnQgZXhlY3V0YWJsZSBwZXJtaXNzaW9ucyB0byBiYWNrdXAuc2ggYW5kIHJlc3RvcmUuc2gKICAgIHNjcmlwdHMuCiAgKiBJbiBvcmRlciB0byBzdGFydCBiYWNraW5nIHVwIGEgTW9uZ29EQiAocGFydGljaXBhdGluZyBpbiBhIFJlcGxpY2FTZXQpLCB5b3UKICAgIG1heSB1c2UgdGhlIGJhY2t1cCBzY3JpcHQuCiAgKiBJbiBvcmRlciB0byByZXN0b3JlIGEgYmFja2VkIHVwIGZpbGUgdG8gYSBNb25nb0RCIChjYW4gYmUgaW4gc3RhbmRhbG9uZQogIG1vZGUpLCB5b3UgbWF5IHVzZSB0aGUgcmVzdG9yZSBzY3JpcHQuCiogV2hlbiB1c2luZyByb3RhdGluZyBsb2dzIGZlYXR1cmUsIHRoZSBsb2cgd2l0aCBtYXhpbXVtIGluZGV4IHdpbGwgaGF2ZQogIGVudHJpZXMgZmFydGhlc3QgaW4gaGlzdG9yeS4KCldoYXQgbWF5IEZ1dHVyZSByZWxlYXNlcyBpbmNsdWRlPwoqIEZpbHRlciBvdXQgZG9jdW1lbnRzIG9uIHRoZSBiYXNpcyBvZiBvcGVyYXRpb24gcGVyZm9ybWVkCiogR2xvYnMgZm9yIGRhdGFiYXNlIGFuZCBjb2xsZWN0aW9uIG5hbWVzCg==") } }

In the output of the oplogs on OS level with backup.sh: { "ts" : { "$ts" : 1401782932 , "$inc" : 3} , "h" : -8248375894719413177 , "v" : 2 , "op" : "i" , "ns" : "zza.fs.chunks" , "o" : { "_id" : { "$oid" : "538d82946255abae2b5ed111"} , "files_id" : { "$oid" : "538d8294896cf11ededae1c8"} , "n" : 0 , "data" : }} ^ , Refer error.log for more details.

So as I see the comment Oct 16, 2013, regarding the working for a fix. What is the status ?

Regards,

viveksd87 commented 10 years ago

Hi, We have a fix for it. Apologies for the delay. We are testing it out with the latest mongo version and would be releasing it soon, mostly within a week or 2.

Thanks, Vivek

ericfranckx commented 10 years ago

cool thanks. I had also some issue on 2.6 with authorization. I have specificy the user and password of an admin user with parameters -u and -p but didn't succeed to connect and receive in the log of Mongodb the message it could not authenticate and was not allow to execute ListDatabase. When I logon with the same user, authenticate and execute the command it works.

So for some test I have disable the auth and security file.

Regarding sharding not supported, still the case ? If you run an instance of backup.sh on each sarding instance should it be not possible ?

Regards, Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 3 June 2014 11:06, Vivek Dhapola notifications@github.com wrote:

Hi, We have a fix for it. Apologies for the delay. We are testing it out with the latest mongo version and would be releasing it soon, mostly within a week or 2.

Thanks, Vivek

— Reply to this email directly or view it on GitHub https://github.com/EqualExperts/Tayra/issues/3#issuecomment-44940664.

This email is sent on behalf of Northgate Information Solutions Limited and its associated companies ("Northgate") and is strictly confidential and intended solely for the addressee(s).

If you are not the intended recipient of this email you must: (i) not disclose, copy or distribute its contents to any other person nor use its contents in any way or you may be acting unlawfully; (ii) contact Northgate immediately on +44 (0)1442 232424 quoting the name of the sender and the addressee then delete it from your system.

Northgate has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. You should scan attachments (if any) for

viruses.

viveksd87 commented 10 years ago

Yes Eric, We will try and fix any issues with mongo version 2.6.x. Also, Tayra should be able to support backup for a single shard instance as long as it is a REPLICA SET, because Tayra relies on mongo oplog for performing backup.

Let me know if you any more questions.

Thanks, Vivek

ericfranckx commented 10 years ago

ok thanks.

Waiting then for the new version (fix) .. ;-)

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 3 June 2014 11:28, Vivek Dhapola notifications@github.com wrote:

Yes Eric, We will try and fix any issues with mongo version 2.6.x. Also, Tayra should be able to support backup for a single shard instance as long as it is a REPLICA SET, because Tayra relies on mongo oplog for performing backup..

Thanks, Vivek

— Reply to this email directly or view it on GitHub https://github.com/EqualExperts/Tayra/issues/3#issuecomment-44942594.

This email is sent on behalf of Northgate Information Solutions Limited and its associated companies ("Northgate") and is strictly confidential and intended solely for the addressee(s).

If you are not the intended recipient of this email you must: (i) not disclose, copy or distribute its contents to any other person nor use its contents in any way or you may be acting unlawfully; (ii) contact Northgate immediately on +44 (0)1442 232424 quoting the name of the sender and the addressee then delete it from your system.

Northgate has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. You should scan attachments (if any) for

viruses.

ericfranckx commented 10 years ago

Hi, hope everything is fine and going well with the fix and the testing.

Any feedback ?

Regards,

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 3 June 2014 11:48, Eric Franckx eric.franckx@ngahr.com wrote:

ok thanks.

Waiting then for the new version (fix) .. ;-)

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 3 June 2014 11:28, Vivek Dhapola notifications@github.com wrote:

Yes Eric, We will try and fix any issues with mongo version 2.6.x. Also, Tayra should be able to support backup for a single shard instance as long as it is a REPLICA SET, because Tayra relies on mongo oplog for performing backup..

Thanks, Vivek

— Reply to this email directly or view it on GitHub https://github.com/EqualExperts/Tayra/issues/3#issuecomment-44942594.

This email is sent on behalf of Northgate Information Solutions Limited and its associated companies ("Northgate") and is strictly confidential and intended solely for the addressee(s).

If you are not the intended recipient of this email you must: (i) not disclose, copy or distribute its contents to any other person nor use its contents in any way or you may be acting unlawfully; (ii) contact Northgate immediately on +44 (0)1442 232424 quoting the name of the sender and the addressee then delete it from your system.

Northgate has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. You should scan attachments (if any) for

viruses.

viveksd87 commented 10 years ago

Hi Eric, Apologies for the delay in response. Sort of juggling between multiple projects. :( We assure you we are trying our best to get the fixed release by end of this week, Let me know if you have any feedback for us.

Thanks, Vivek

ericfranckx commented 10 years ago

Ho Ok thanks a lot When you Will have a version i can test i will test it and give you feeback

Regards Eric

On Monday, 9 June 2014, Vivek Dhapola notifications@github.com wrote:

Hi Eric, Apologies for the delay in response. Sort of juggling between multiple projects. :( We assure you we are trying our best to get the fixed release by end of this week, Let me know if you have any feedback for us.

Thanks, Vivek

— Reply to this email directly or view it on GitHub https://github.com/EqualExperts/Tayra/issues/3#issuecomment-45496316.

Sent from Gmail Mobile

This email is sent on behalf of Northgate Information Solutions Limited and its associated companies ("Northgate") and is strictly confidential and intended solely for the addressee(s).

If you are not the intended recipient of this email you must: (i) not disclose, copy or distribute its contents to any other person nor use its contents in any way or you may be acting unlawfully; (ii) contact Northgate immediately on +44 (0)1442 232424 quoting the name of the sender and the addressee then delete it from your system.

Northgate has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. You should scan attachments (if any) for

viruses.

viveksd87 commented 10 years ago

Hi @ericfranckx @hef82 , We have deployed tayra with a fix for the handling of binary data. Please download the latest distribution "Tayra-0.8.2.Beta3" from http://eelabs.co.uk/projects/tayra/. And let us know if you face any issues.

Also fyi, we will be making auth related changes for mongo 2.6 in our next major release very soon. So stay tuned, and keep giving us your valuable feedback/ suggestions.

Regards, Vivek

ericfranckx commented 10 years ago

Hi, thanks a lot. I will test it.

Regards;

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 12 June 2014 15:17, Vivek Dhapola notifications@github.com wrote:

Closed #3 https://github.com/EqualExperts/Tayra/issues/3.

— Reply to this email directly or view it on GitHub https://github.com/EqualExperts/Tayra/issues/3#event-130716333.

This email is sent on behalf of Northgate Information Solutions Limited and its associated companies ("Northgate") and is strictly confidential and intended solely for the addressee(s).

If you are not the intended recipient of this email you must: (i) not disclose, copy or distribute its contents to any other person nor use its contents in any way or you may be acting unlawfully; (ii) contact Northgate immediately on +44 (0)1442 232424 quoting the name of the sender and the addressee then delete it from your system.

Northgate has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. You should scan attachments (if any) for

viruses.

ericfranckx commented 10 years ago

Hi, juts as info: when I have unzip the file and try on linux : backup.sh I have the followign message: ./backup.sh: line 41: syntax error: unexpected end of file

So I made a cut/paste in my notepad and set it in new file on my linux box and it works. Maybe a hide char in the file : backup.sh ?

Regards,

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 12 June 2014 15:19, Eric Franckx eric.franckx@ngahr.com wrote:

Hi, thanks a lot. I will test it.

Regards;

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 12 June 2014 15:17, Vivek Dhapola notifications@github.com wrote:

Closed #3 https://github.com/EqualExperts/Tayra/issues/3.

— Reply to this email directly or view it on GitHub https://github.com/EqualExperts/Tayra/issues/3#event-130716333.

This email is sent on behalf of Northgate Information Solutions Limited and its associated companies ("Northgate") and is strictly confidential and intended solely for the addressee(s).

If you are not the intended recipient of this email you must: (i) not disclose, copy or distribute its contents to any other person nor use its contents in any way or you may be acting unlawfully; (ii) contact Northgate immediately on +44 (0)1442 232424 quoting the name of the sender and the addressee then delete it from your system.

Northgate has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. You should scan attachments (if any) for

viruses.

DhavalDalal commented 10 years ago

Thanks Eric will look into the backup.sh and remove the gremlin

Dhaval

Sent from my iPhone

On 12-Jun-2014, at 20:58, ericfranckx notifications@github.com wrote:

Hi, juts as info: when I have unzip the file and try on linux : backup.sh I have the followign message: ./backup.sh: line 41: syntax error: unexpected end of file

So I made a cut/paste in my notepad and set it in new file on my linux box and it works. Maybe a hide char in the file : backup.sh ?

Regards,

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 12 June 2014 15:19, Eric Franckx eric.franckx@ngahr.com wrote:

Hi, thanks a lot. I will test it.

Regards;

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 12 June 2014 15:17, Vivek Dhapola notifications@github.com wrote:

Closed #3 https://github.com/EqualExperts/Tayra/issues/3.

— Reply to this email directly or view it on GitHub https://github.com/EqualExperts/Tayra/issues/3#event-130716333.

This email is sent on behalf of Northgate Information Solutions Limited and its associated companies ("Northgate") and is strictly confidential and intended solely for the addressee(s).

If you are not the intended recipient of this email you must: (i) not disclose, copy or distribute its contents to any other person nor use its contents in any way or you may be acting unlawfully; (ii) contact Northgate immediately on +44 (0)1442 232424 quoting the name of the sender and the addressee then delete it from your system.

Northgate has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. You should scan attachments (if any) for

viruses.

— Reply to this email directly or view it on GitHub.

ericfranckx commented 10 years ago

Hi, regarding the binary data, now I can see in the log really binary data ;-)

Later I will check to see to restore it and see if it works

Regards,

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 12 June 2014 17:36, Dhaval Dalal notifications@github.com wrote:

Thanks Eric will look into the backup.sh and remove the gremlin

Dhaval

Sent from my iPhone

On 12-Jun-2014, at 20:58, ericfranckx notifications@github.com wrote:

Hi, juts as info: when I have unzip the file and try on linux : backup.sh I have the followign message: ./backup.sh: line 41: syntax error: unexpected end of file

So I made a cut/paste in my notepad and set it in new file on my linux box and it works. Maybe a hide char in the file : backup.sh ?

Regards,

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 12 June 2014 15:19, Eric Franckx eric.franckx@ngahr.com wrote:

Hi, thanks a lot. I will test it.

Regards;

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 12 June 2014 15:17, Vivek Dhapola notifications@github.com wrote:

Closed #3 https://github.com/EqualExperts/Tayra/issues/3.

— Reply to this email directly or view it on GitHub https://github.com/EqualExperts/Tayra/issues/3#event-130716333.

This email is sent on behalf of Northgate Information Solutions Limited and its associated companies ("Northgate") and is strictly confidential and intended solely for the addressee(s).

If you are not the intended recipient of this email you must: (i) not disclose, copy or distribute its contents to any other person nor use its contents in any way or you may be acting unlawfully; (ii) contact Northgate immediately on +44 (0)1442 232424 quoting the name of the sender and the addressee then delete it from your system.

Northgate has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. You should scan attachments (if any) for

viruses.

— Reply to this email directly or view it on GitHub.

— Reply to this email directly or view it on GitHub https://github.com/EqualExperts/Tayra/issues/3#issuecomment-45907905.

This email is sent on behalf of Northgate Information Solutions Limited and its associated companies ("Northgate") and is strictly confidential and intended solely for the addressee(s).

If you are not the intended recipient of this email you must: (i) not disclose, copy or distribute its contents to any other person nor use its contents in any way or you may be acting unlawfully; (ii) contact Northgate immediately on +44 (0)1442 232424 quoting the name of the sender and the addressee then delete it from your system.

Northgate has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. You should scan attachments (if any) for

viruses.

viveksd87 commented 10 years ago

Thanks for the quick test @ericfranckx . Apparently the binaries built on windows machine have such problem. Have pushed a new binary built from OSX.

Please re-download from the same link http://eelabs.co.uk/projects/tayra/ and try again.

Thanks, Vivek

ericfranckx commented 10 years ago

Hi, I made some restore test and it works ... nice.

But I think some additional parameters for the restore should be cool: If I want to restore for example

only some type of action: "op" : "i" or "op" : "d"
on which object ID : "_id" : { "$oid" : "539aa39e642d3d8449c0034c"}
on some range of record corresponding to some field and value : "userid" : "user4"

So the restore could be a little more "specific". ;-)

Question: what si the best way to run the backup.sh ? start it in background as a daemon or background job on Linux like "backup.sh .... &" ?

Regards,

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 12 June 2014 18:48, Vivek Dhapola notifications@github.com wrote:

Thanks for the quick test @ericfranckx https://github.com/ericfranckx . Apparently the binaries built on windows machine have such problem. Have pushed a new binary built from OSX.

Please re-download from the same link http://eelabs.co.uk/projects/tayra/ and try again.

Thanks, Vivek

— Reply to this email directly or view it on GitHub https://github.com/EqualExperts/Tayra/issues/3#issuecomment-45917344.

This email is sent on behalf of Northgate Information Solutions Limited and its associated companies ("Northgate") and is strictly confidential and intended solely for the addressee(s).

If you are not the intended recipient of this email you must: (i) not disclose, copy or distribute its contents to any other person nor use its contents in any way or you may be acting unlawfully; (ii) contact Northgate immediately on +44 (0)1442 232424 quoting the name of the sender and the addressee then delete it from your system.

Northgate has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. You should scan attachments (if any) for

viruses.

ericfranckx commented 9 years ago

Hi,

question: with the the tool Tayra, I think when it starts the first time it looks to all docs and generates OS files . But when it starts the first time does it look for all docs already in the databases or doesn't it looks for only operations in the oplogs ?

Because I want to try this scenario:

execute a snapshot every hour on the storage level ... (easy, fast, efficient, ...)
then to be able to recover to any point-in-time I would like to generates the OS files of the Oplogs

But if my database is 500GB already and I start the tool the first time ? what will be get and generate on the OS level ?

Regards,

Eric

Regards,

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 12 June 2014 18:48, Vivek Dhapola notifications@github.com wrote:

Thanks for the quick test @ericfranckx https://github.com/ericfranckx . Apparently the binaries built on windows machine have such problem. Have pushed a new binary built from OSX.

Please re-download from the same link http://eelabs.co.uk/projects/tayra/ and try again.

Thanks, Vivek

— Reply to this email directly or view it on GitHub https://github.com/EqualExperts/Tayra/issues/3#issuecomment-45917344.

This email is sent on behalf of Northgate Information Solutions Limited and its associated companies ("Northgate") and is strictly confidential and intended solely for the addressee(s).

If you are not the intended recipient of this email you must: (i) not disclose, copy or distribute its contents to any other person nor use its contents in any way or you may be acting unlawfully; (ii) contact Northgate immediately on +44 (0)1442 232424 quoting the name of the sender and the addressee then delete it from your system.

Northgate has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. You should scan attachments (if any) for

viruses.

ericfranckx commented 9 years ago

Hi, it should be nice to have: -c --> continue from previous situation (means takes into account what is in the oplogs) -date now --> start from 0, means will only take into account new oplogs entries that occurs after the start of the backup.sh script -date 23/10/2014-05:35:45 ---> take only oplogs since this dates and check if not yet in the logs files , if already available, nothign done, of not available,generates the files ...

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 17 October 2014 16:58, Eric Franckx eric.franckx@ngahr.com wrote:

Hi,

question: with the the tool Tayra, I think when it starts the first time it looks to all docs and generates OS files . But when it starts the first time does it look for all docs already in the databases or doesn't it looks for only operations in the oplogs ?

Because I want to try this scenario:

execute a snapshot every hour on the storage level ... (easy, fast, efficient, ...)

then to be able to recover to any point-in-time I would like to generates the OS files of the Oplogs

But if my database is 500GB already and I start the tool the first time ? what will be get and generate on the OS level ?

Regards,

Eric

Regards,

Eric

Lead Strategy Architect NorthgateArinso | Eric Franckx | Enterprise IT Architect | +32 477 37 69 74

On 12 June 2014 18:48, Vivek Dhapola notifications@github.com wrote:

Thanks for the quick test @ericfranckx https://github.com/ericfranckx . Apparently the binaries built on windows machine have such problem. Have pushed a new binary built from OSX.

Please re-download from the same link http://eelabs.co.uk/projects/tayra/ and try again.

Thanks, Vivek

— Reply to this email directly or view it on GitHub https://github.com/EqualExperts/Tayra/issues/3#issuecomment-45917344.

This email is sent on behalf of Northgate Information Solutions Limited and its associated companies ("Northgate") and is strictly confidential and intended solely for the addressee(s).

If you are not the intended recipient of this email you must: (i) not disclose, copy or distribute its contents to any other person nor use its contents in any way or you may be acting unlawfully; (ii) contact Northgate immediately on +44 (0)1442 232424 quoting the name of the sender and the addressee then delete it from your system.

Northgate has taken reasonable precautions to ensure that no viruses are contained in this email, but does not accept any responsibility once this email has been transmitted. You should scan attachments (if any) for

viruses.

viveksd87 commented 9 years ago

Hi Eric, Apologies for the delay in reply. Please could you create an issue for each of the features you have requested above. It would help us in identifying and tracking the list of enhancements to be done to Tayra.

Thanks, Vivek

EqualExperts / Tayra