Generic data backup script - Githubissues

samagra-comms / docker-deploy

1 stars 15 forks source link

Generic data backup script #76

Open tushar5526 opened 1 year ago

tushar5526 commented 1 year ago

Description

Set up a generic data backup script, that can take consistent backups of data from folders and then upload it to any S3 compatible storage.

Expected Outcome

The script should take care of log rotations and deleting old logs
The script should tag backups appropriately
It should be generic and parameterized enough to take backups of any folder, on specific intervals specified in cron format and with the right tags.
The script should setup a cron job that takes these backups regularly

Acceptance Criteria

[ ] The script should take care of log rotations and deleting old logs
[ ] The script should tag backups appropriately
[ ] It should be generic and parameterized enough to take backups of any folder, on specific intervals specified in cron format and with the right tags.

Implementation Details

It should be an interactive CLI script

Mockups / Wireframes

NA

Product Name

UCI

Organization Name:

Samagra

Domain

DPG

Tech Skills Needed:

Python or JS

Mentor(s)

@tushar5526

Complexity

High

Category

CI/CD

Sub Category

Maintenance

Mandeep-009 commented 1 year ago

Hey! I know Javascript and I want to work on this issue. Can you guide me in this?

starks-and-wolves commented 1 year ago

Hey @tushar5526, I have previously created cron jobs to store data in an s3 bucket. I would like to contribute to this project. Please let me know the detailed requirements for it.

tushar5526 commented 1 year ago

Hey @tushar5526, I have previously created cron jobs to store data in an s3 bucket. I would like to contribute to this project. Please let me know the detailed requirements for it.

Assume a docker-compose setup with multiple DBs (could be SQL or NO-SQL) persisting their data in a folder mounted in docker. The script should be able to satisfy the acceptance criteria and expected outcome.

It does not have to be something written from scratch, and you can also build on top of existing solutions/ tools out there for data backups.

yash14171 commented 1 year ago

Hey I can solve this issue ,how to move forward?

tushar5526 commented 1 year ago

Hey I can solve this issue ,how to move forward?

Hi please refer this comment - https://github.com/samagra-comms/docker-deploy/issues/76#issuecomment-1638389236

yash14171 commented 1 year ago

Hey @tushar5526, I have previously created cron jobs to store data in an s3 bucket. I would like to contribute to this project. Please let me know the detailed requirements for it.

Assume a docker-compose setup with multiple DBs (could be SQL or NO-SQL) persisting their data in a folder mounted in docker. The script should be able to satisfy the acceptance criteria and expected outcome.

It does not have to be something written from scratch, and you can also build on top of existing solutions/ tools out there for data backups.

It's ok but how can I pull request for this issue?

tushar5526 commented 1 year ago

Hey @tushar5526, I have previously created cron jobs to store data in an s3 bucket. I would like to contribute to this project. Please let me know the detailed requirements for it.

Assume a docker-compose setup with multiple DBs (could be SQL or NO-SQL) persisting their data in a folder mounted in docker. The script should be able to satisfy the acceptance criteria and expected outcome. It does not have to be something written from scratch, and you can also build on top of existing solutions/ tools out there for data backups.

It's ok but how can I pull request for this issue?

The pull request is a script that meets the above criteria. You can attach screenshots of the script or a small demo on how to use the script.

yash14171 commented 1 year ago

I know how to solve this I am asking how to choose this request and how to submit it to you

On Fri, 21 Jul, 2023, 12:21 pm Tushar, @.***> wrote:

Hey @tushar5526 https://github.com/tushar5526, I have previously created cron jobs to store data in an s3 bucket. I would like to contribute to this project. Please let me know the detailed requirements for it.

Assume a docker-compose setup with multiple DBs (could be SQL or NO-SQL) persisting their data in a folder mounted in docker. The script should be able to satisfy the acceptance criteria and expected outcome. It does not have to be something written from scratch, and you can also build on top of existing solutions/ tools out there for data backups.

It's ok but how can I pull request for this issue?

Pull request is a script that meets the above criteria. You can attach screenshots of the script working or a small demo on how to use the script.

— Reply to this email directly, view it on GitHub https://github.com/samagra-comms/docker-deploy/issues/76#issuecomment-1645069013, or unsubscribe https://github.com/notifications/unsubscribe-auth/BBDNR7CZC767WWVYNA2ETOLXRIRGRANCNFSM6AAAAAAZOHBEQI . You are receiving this because you commented.Message ID: @.***>

tushar5526 commented 1 year ago

You can make a PR on this repo only. There are services already in the docker-compose that store data in folder mounts. You will have to create a script for that. Is there anything else you need clarification for, I am not able to understand your doubt.

yash14171 commented 1 year ago

How to make pr

On Fri, 21 Jul, 2023, 12:26 pm Tushar, @.***> wrote:

You can make a PR on this repo only. There are services already in the docker-compose that store data in folder mounts. You will have to create a script for that. Is there anything else you need clarification for, I am not able to understand your doubt.

— Reply to this email directly, view it on GitHub https://github.com/samagra-comms/docker-deploy/issues/76#issuecomment-1645073425, or unsubscribe https://github.com/notifications/unsubscribe-auth/BBDNR7BIBL4I2PO5C7BEJPTXRIRY5ANCNFSM6AAAAAAZOHBEQI . You are receiving this because you commented.Message ID: @.***>

yash14171 commented 1 year ago

Hey Tushar can u help me up here and tell me how to make a pr

yash14171 commented 1 year ago

i created the script that meets the all criteria and i am ready to submit it to you.How to do that?

tushar5526 commented 1 year ago

@yash14171 https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/proposing-changes-to-your-work-with-pull-requests/creating-a-pull-request

yash14171 commented 1 year ago

I still don't understand

On Mon, 24 Jul, 2023, 10:01 am Tushar, @.***> wrote:

@yash14171 https://github.com/yash14171 https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/proposing-changes-to-your-work-with-pull-requests/creating-a-pull-request

— Reply to this email directly, view it on GitHub https://github.com/samagra-comms/docker-deploy/issues/76#issuecomment-1647190234, or unsubscribe https://github.com/notifications/unsubscribe-auth/BBDNR7EZ5IUUTO63OAEWAATXRX3ANANCNFSM6AAAAAAZOHBEQI . You are receiving this because you were mentioned.Message ID: @.***>