Final migrate strategy - Githubissues

amitaibu commented 9 years ago

Here's the most strait-forward + safe technique I think we should follow for the final release:

Chris will set the c4d site to maintenance mode
Chris will dump the DB and send to Gizra
Gizra will perform the migrate locally on the DB
Gizra will send the migrated DB to chris along with the files
Chris will upload the files via FTP
Chris will import the DB to a new table called for example c4d_migrated
Using the FTP, Chris will change in settings.php the table to c4d_migrated - thus the previous one will stay in tact, and Drupal will start serving content from the new DB
Chris will disable the maintenance mode

@ckorakas The 1st action item that should probably be done, is to make sure that you can upload a db to a new table. Let me know if anything is not clear.

ckorakas commented 9 years ago

We could do this but its risky I dont want to shut down C4D for 3 hours If Nader is around I would prefer to hand him over the commands on my PC If not I will ask Peter to assist If not I will do this as explained with some assistance on your side @amitaibu @adevanssay @Katya-cap4dev

amitaibu commented 9 years ago

Best thing will be to get a test eu server, so we can "practice" it. Is that a realistic option?

‫ב-8 בינו 2015, בשעה 17:24, ‏ckorakas notifications@github.com כתב/ה:‬

We could do this but its risky I dont want to shut down C4D for 3 hours If Nader is around I would prefer to hand him over the commands on my PC If not I will ask Peter to assist If not I will do this as explained with some assistance on your side @amitaibu @adevanssay @Katya-cap4dev

— Reply to this email directly or view it on GitHub.

ckorakas commented 9 years ago

we have a test server but its only accessible behind the firewall :-1:

ckorakas commented 9 years ago

I don't mind asking Peter to help He has deployed like this dozens of times the last 4-5 years We just need to see when and get him in the loop at one stage

amitaibu commented 9 years ago

If you have access to it, it's great. We can speak on beginning of next week, and discuss the preparations needed.

‫ב-8 בינו 2015, בשעה 17:34, ‏ckorakas notifications@github.com כתב/ה:‬

we have a test server but its only accessible behind the firewall

— Reply to this email directly or view it on GitHub.

amitaibu commented 9 years ago

Sure

‫ב-8 בינו 2015, בשעה 17:37, ‏ckorakas notifications@github.com כתב/ה:‬

I don't mind asking Peter to help He has deployed like this dozens of times the last 4-5 years We just need to see when and get him in the loop at one stage

— Reply to this email directly or view it on GitHub.

amitaibu commented 9 years ago

Sure, sounds good

‫ב-8 בינו 2015, בשעה 17:37, ‏ckorakas notifications@github.com כתב/ה:‬

I don't mind asking Peter to help He has deployed like this dozens of times the last 4-5 years We just need to see when and get him in the loop at one stage

— Reply to this email directly or view it on GitHub.

amitaibu commented 9 years ago

@ckorakas I'd like Peter to assist us with the final migrate. For that it's good that he can practice it on a test server before the final release.

If it ok if I talk with him directly about this?

amitaibu commented 9 years ago

@ckorakas FYI:

I've discussed with @zero2one the migrate strategy. As he has limited access to the server, we will have to use this workflow:

Gizra will send the files that need to be uploaded in advance
Peter will upload the files via FTP
Site will be offline
Peter will create a DB dump and send to Gizra
Gizra will run the migration locally, and re-send the updated DB
The DB will be uploaded back to C4D production server
Site will be online

We will provide Peter with the non-final dump and files, so he will be able to "practice" it before the final migration.

zero2one commented 9 years ago

@ckorakas Needs to be validated on our site (check with Rika).

zero2one commented 9 years ago

@amitaibu

You could do this also without my help:

Gizra will send the files that need to be uploaded in advance
Chris will upload the files via FTP
Gizra puts Site in offline modus.
Gizra will create a DB dump using Backup-Migrate
Gizra will run the migration locally
Gizra will dump the updates DB in small files (max 30MB each).
Gizra sends the DB dump files to Chris.
Chris deletes the production database using phpMyAdmin.
Chris uploads the migrated database parts using phpMyAdmin
Gizra & Chris Test migration
Gizra puts the site back in OnLine modus.

amitaibu commented 9 years ago

You could do this also without my help:

Indeed, but since you have already experience in numerous releases I would feel more comfortable if you could assist with it.

amitaibu commented 9 years ago

@solker after finishing fixing the views count, please send @zero2one a link with the db dump and files + explanation where to place the files -- so he can "practice" the final migration

solker commented 9 years ago

@amitaibu My zip contain next parts:

database dump of c4d with finished migration.
migration module
export data folder that contain images.

The zip archive have size 1.4Gb. Which data I should send to @zero2one ?

amitaibu commented 9 years ago

No need for the migrate module, just full dump and the exported files

‫ב-23 בפבר 2015, בשעה 21:20, ‏Ilya notifications@github.com כתב/ה:‬

@amitaibu My zip contain next parts:

database dump of c4d with finished migration. migration module export data folder that contain images. The zip archive have size 1.4Gb. Which data I should send to @zero2one ?

— Reply to this email directly or view it on GitHub.

solker commented 9 years ago

The new zip contain:

Dump of c4d with completed migration. Disabled migration modules. Without protecting user emails. Clear cache.
Folder with all exported images.
Readme with instructions.

C4D migration final stage.

1. Move export_data folder to /sites/default/files/ folder.
2. Upload sql dump to database via drush sql-cli < c4d_mysql_dump_postmigrate_24Feb_final.sql

amitaibu commented 9 years ago

@solker can you please put here the link to the zipped file.

solker commented 9 years ago

@amitaibu we found some issues and repack our zip. Need time for upload it will be ready tomorrow.

amitaibu commented 9 years ago

Great, thanks

‫ב-25 בפבר 2015, בשעה 18:38, ‏Ilya notifications@github.com כתב/ה:‬

@amitaibu we found some issues and repack our zip. Need time for upload it will be ready tomorrow.

— Reply to this email directly or view it on GitHub.

solker commented 9 years ago

Here is link to zip archive, it's contain:

Dump of c4d with completed migration. Disabled migration modules. Without protecting user emails. (from the Feb 25)
Folder with all exported images.
Readme with instructions.

https://drive.google.com/a/gizra.com/file/d/0B0R0KVpkzHQPUWpvTndCOWNaQnM/view?usp=sharing

amitaibu commented 9 years ago

@zero2one ^^

zero2one commented 9 years ago

@solker The link does not give me access to the file…

solker commented 9 years ago

@zero2one I fixed privileges, please try again.

amitaibu commented 9 years ago

@zero2one can you please confirm if you were able to install the DB/ files from the zip.

ckorakas commented 9 years ago

do we have a date for the migration? Are we ready ? Peter is your time booked for this ?

amitaibu commented 9 years ago

Yes, from our side we are ready

ckorakas commented 9 years ago

what is the status ? when is the migration planned for ? @zero2one @amitaibu @adevanssay @Katya-cap4dev

Katya-cap4dev commented 9 years ago

@ckorakas depends on you and Peter's availability.. you let us know please

Gizra / euei-euwi-migrate

Final migrate strategy #66