Migration: Test run

[cbrody]

Full migration prior to site freeze. Address oustanding migration issues first.

• [x] #186
• [x] #145
• [x] #127
• [x] Run locally with latest dev-master updates against production sites
• [x] Upload db and files to Acquia pubs-dev
• [x] Synchronise config
• [x] Default content deploy
• [x] Bulk update content and taxonomy URL aliases

[cbrody]

Hi @finnlewis assigning this to you, let me know if anything needs clarifying/documenting. My notes on the process are as follows:

Migration procedure:
iied-d7: lando pull files from production, download backup of database from acquia e.g. as d7.sql
iied-main: on dev-master branch, pull latest database and files from prod
    import d7 database to d7db e,g. lando db-import --host d7db d7.sql
    lando drush cr 
lando drush cim
    lando drush ms //migrate status
lando drush mim iied_projects //Add any new projects and tags from d7 site
lando drush mim iied_tags
    lando drush mim --group=iied_migrate_d7 //Run the whole group of migrations
    //Test locally
    lando push // database and files to Acquia dev
    //Test on acquia

[cbrody]

@finnlewis let's hold off on this until the outstanding migration issues are addressed, thanks.

[cbrody]

@finnlewis thanks for running this. Please let me know when the config import issues have been resolved.

There's an issue with media references getting overwritten that I haven't figured out. If you compare https://pubs.iied.org/admin/content/media-grid to the same page on pubs-dev (filtered for Media type: Document) you'll see that the four newest items are showing incorrectly. Could you look into this please?

[finnlewis]

Hi @cbrody

I've run the config import as follows:

finn@Oobuntoo:~/sites/l.iied/gitroot$ lando drush @iied-main.dev  cr

Deprecated: Required parameter $args follows optional parameter $command in /usr/local/drush10/vendor/drush/drush/includes/batch.inc on line 116

Deprecated: Required parameter $options follows optional parameter $command in /usr/local/drush10/vendor/drush/drush/includes/batch.inc on line 116
 [success] Cache rebuild complete.
Connection to irforumreafzs3cco.ssh.devcloud.acquia-sites.com closed.
finn@Oobuntoo:~/sites/l.iied/gitroot$ lando drush @iied-main.dev  cim

Deprecated: Required parameter $args follows optional parameter $command in /usr/local/drush10/vendor/drush/drush/includes/batch.inc on line 116

Deprecated: Required parameter $options follows optional parameter $command in /usr/local/drush10/vendor/drush/drush/includes/batch.inc on line 116
+------------------+---------------------------------------------------+-----------+
| Collection       | Config                                            | Operation |
+------------------+---------------------------------------------------+-----------+
|                  | views.view.popular_tags                           | Create    |
|                  | block.block.exposedformsearchpage_2_5             | Create    |
|                  | block.block.exposedformsearchpage_2_4             | Create    |
|                  | core.extension                                    | Update    |
|                  | core.menu.static_menu_link_overrides              | Update    |
|                  | block.block.headersearchblock                     | Update    |
|                  | image.style.scale_md                              | Update    |
|                  | field.field.node.long_read.field_content          | Update    |
|                  | search_api_solr.solr_field_type.text_en_6_0_0     | Update    |
|                  | search_api_solr.solr_field_type.text_en_7_0_0     | Update    |
|                  | block.block.iied_tw_page_title                    | Update    |
|                  | block.block.iied_tw_content                       | Update    |
|                  | block.block.iied_tw_branding                      | Update    |
|                  | block.block.about                                 | Update    |
|                  | block.block.primary                               | Update    |
|                  | search_api.index.acquia_search_index              | Update    |
|                  | views.view.publication_slider                     | Update    |
|                  | views.view.taxonomy_featured_display              | Update    |
|                  | core.entity_view_display.taxonomy_term.theme.full | Update    |
|                  | views.view.search                                 | Update    |
|                  | search_api_autocomplete.search.search             | Update    |
|                  | block.block.iied_tw_theme_2                       | Update    |
|                  | acquia_connector.settings                         | Update    |
|                  | devel.settings                                    | Delete    |
|                  | config_devel.settings                             | Delete    |
|                  | views.view.watchdog                               | Delete    |
|                  | dblog.settings                                    | Delete    |
| language.ar      | views.view.frontpage                              | Update    |
| language.ar      | views.view.watchdog                               | Delete    |
| language.es      | views.view.frontpage                              | Update    |
| language.es      | views.view.watchdog                               | Delete    |
| language.fr      | views.view.frontpage                              | Update    |
| language.fr      | views.view.watchdog                               | Delete    |
| language.hr      | views.view.frontpage                              | Update    |
| language.hr      | views.view.watchdog                               | Delete    |
| language.id      | views.view.frontpage                              | Update    |
| language.id      | views.view.watchdog                               | Delete    |
| language.my      | views.view.frontpage                              | Update    |
| language.my      | views.view.watchdog                               | Delete    |
| language.pl      | views.view.frontpage                              | Update    |
| language.pl      | views.view.watchdog                               | Delete    |
| language.pt-br   | views.view.frontpage                              | Update    |
| language.pt-br   | views.view.watchdog                               | Delete    |
| language.pt-pt   | views.view.frontpage                              | Update    |
| language.pt-pt   | views.view.watchdog                               | Delete    |
| language.ru      | views.view.frontpage                              | Update    |
| language.ru      | views.view.watchdog                               | Delete    |
| language.si      | views.view.frontpage                              | Update    |
| language.si      | views.view.watchdog                               | Delete    |
| language.te      | views.view.frontpage                              | Update    |
| language.te      | views.view.watchdog                               | Delete    |
| language.vi      | views.view.frontpage                              | Update    |
| language.vi      | views.view.watchdog                               | Delete    |
| language.zh-hans | views.view.frontpage                              | Update    |
| language.zh-hans | views.view.watchdog                               | Delete    |
| language.zh-hant | views.view.watchdog                               | Delete    |
+------------------+---------------------------------------------------+-----------+

 Import the listed configuration changes? (yes/no) [yes]:
 > 

 [notice] Synchronized extensions: uninstall views_bootstrap.
 [notice] Synchronized extensions: uninstall stage_file_proxy.
 [notice] Synchronized extensions: uninstall help_topics.
 [notice] Synchronized extensions: uninstall config_devel.
 [warning] rmdir(/mnt/gfs/irforumreafzs3cco/sites/default/files/taxonomy_files): No such file or directory FileSystem.php:268
 [notice] Synchronized extensions: uninstall taxonomy_import.
 [notice] Synchronized extensions: install format_bytes.
 [notice] Synchronized extensions: install ctools_views.
 [notice] Synchronized extensions: install devel_kint_extras.
 [notice] Synchronized configuration: delete devel.settings.
 [notice] Synchronized configuration: delete views.view.watchdog.
 [notice] Synchronized configuration: delete dblog.settings.
 [notice] Synchronized configuration: create views.view.popular_tags.
 [notice] Synchronized configuration: create block.block.exposedformsearchpage_2_5.
 [notice] Synchronized configuration: create block.block.exposedformsearchpage_2_4.
 [notice] Synchronized configuration: update core.menu.static_menu_link_overrides.
 [notice] Synchronized configuration: update block.block.headersearchblock.
 [notice] Synchronized configuration: update image.style.scale_md.
 [notice] Synchronized configuration: update field.field.node.long_read.field_content.
 [notice] Synchronized configuration: update search_api_solr.solr_field_type.text_en_6_0_0.
 [notice] Synchronized configuration: update search_api_solr.solr_field_type.text_en_7_0_0.
 [notice] Synchronized configuration: update block.block.iied_tw_page_title.
 [notice] Synchronized configuration: update block.block.iied_tw_content.
 [notice] Synchronized configuration: update block.block.iied_tw_branding.
 [notice] Synchronized configuration: update block.block.about.
 [notice] Synchronized configuration: update block.block.primary.
>  [warning] No configuration objects have been updated.
>  [warning] No configuration objects have been updated.
>  [warning] No configuration objects have been updated.
>  [notice] Message: No configuration objects have been updated.
> 
>  [notice] Message: Successfully executed 1 pending task.
> 
>  [notice] Message: Successfully executed 1 pending task.
> 
 [notice] Synchronized configuration: update search_api.index.acquia_search_index.
 [notice] Synchronized configuration: update views.view.publication_slider.
 [notice] Synchronized configuration: update views.view.taxonomy_featured_display.
 [notice] Synchronized configuration: update core.entity_view_display.taxonomy_term.theme.full.
 [notice] Synchronized configuration: update views.view.search.
 [notice] Synchronized configuration: update search_api_autocomplete.search.search.
 [notice] Synchronized configuration: update block.block.iied_tw_theme_2.
 [notice] Synchronized configuration: update acquia_connector.settings.
 [notice] Synchronized configuration: delete views.view.watchdog in language.ar.
 [notice] Synchronized configuration: update views.view.frontpage in language.ar.
 [notice] Synchronized configuration: delete views.view.watchdog in language.es.
 [notice] Synchronized configuration: update views.view.frontpage in language.es.
 [notice] Synchronized configuration: delete views.view.watchdog in language.fr.
 [notice] Synchronized configuration: update views.view.frontpage in language.fr.
 [notice] Synchronized configuration: delete views.view.watchdog in language.hr.
 [notice] Synchronized configuration: update views.view.frontpage in language.hr.
 [notice] Synchronized configuration: delete views.view.watchdog in language.id.
 [notice] Synchronized configuration: update views.view.frontpage in language.id.
 [notice] Synchronized configuration: delete views.view.watchdog in language.my.
 [notice] Synchronized configuration: update views.view.frontpage in language.my.
 [notice] Synchronized configuration: delete views.view.watchdog in language.pl.
 [notice] Synchronized configuration: update views.view.frontpage in language.pl.
 [notice] Synchronized configuration: delete views.view.watchdog in language.pt-br.
 [notice] Synchronized configuration: update views.view.frontpage in language.pt-br.
 [notice] Synchronized configuration: delete views.view.watchdog in language.pt-pt.
 [notice] Synchronized configuration: update views.view.frontpage in language.pt-pt.
 [notice] Synchronized configuration: delete views.view.watchdog in language.ru.
 [notice] Synchronized configuration: update views.view.frontpage in language.ru.
 [notice] Synchronized configuration: delete views.view.watchdog in language.si.
 [notice] Synchronized configuration: update views.view.frontpage in language.si.
 [notice] Synchronized configuration: delete views.view.watchdog in language.te.
 [notice] Synchronized configuration: update views.view.frontpage in language.te.
 [notice] Synchronized configuration: delete views.view.watchdog in language.vi.
 [notice] Synchronized configuration: update views.view.frontpage in language.vi.
 [notice] Synchronized configuration: delete views.view.watchdog in language.zh-hans.
 [notice] Synchronized configuration: update views.view.frontpage in language.zh-hans.
 [notice] Synchronized configuration: delete views.view.watchdog in language.zh-hant.
 [notice] Finalizing configuration synchronization.
 [success] The configuration was imported successfully.
Connection to irforumreafzs3cco.ssh.devcloud.acquia-sites.com closed.

Does that look right to you?

[cbrody]

Hi @finnlewis that looks right I think. I'll review the site.

[finnlewis]

Just created a separate issue for the media problem.

[finnlewis]

@cbrody when running the migrations locally, I've got a bunch of console output like: Rewrite inline image styles: Cannot find reference to pictures/picture-6526-1550233050.jpg from node 28496. Are these things that you would like to log for future reference to review and resolve?

[finnlewis]

@cbrody I ran the migration again locally after the fixes from yesterday and pushed it up to the dev site, importing config etc.

I've still got to check if the latest /files/[filename] rewrite to /sites/default/files/[filename] had any unintended side effects. I don't think I'll have time to finish that this morning, but will do this afternoon.

If it does not have any side effects.... the current state of dev should be as good as we know for now.

[finnlewis]

See https://github.com/IIED-org/pubs/pull/327

[cbrody]

@cbrody when running the migrations locally, I've got a bunch of console output like: Rewrite inline image styles: Cannot find reference to pictures/picture-6526-1550233050.jpg from node 28496. Are these things that you would like to log for future reference to review and resolve?

Yes. What sort of quantity of these are there?

[cbrody]

Log: https://iied.sharepoint.com/:t:/s/WebTeam/EbaYQJd9LPlJnsIYvYha7YQB93-EJwGAUNyXsA5tJ7i26Q?e=bUlpA8