Migration Help

[reynoldsalec]

• [x] Review User relationships
  • These should be good-to-go, migrated into their own Groups. Simple review.
• [x] Relationship between content and files
  • right now they're content scraping, so that relationship is hard to establish
  • Were the original NIDs recorded? --> todo @rjbain
  • If not, have to link via title
  • Files referenced in Panels?
• [x] Webforms
  • 1-200 forms
  • Want to maintain the submissions
  • John feels that should be fairly straightforward, did it with YAML form
• [x] Redirects
  • Relies on the NIDs, see earlier question/TODO for Rob
  • Little under 400 redirects

[dustinleblanc]

@rjbain is there anything unusual about the webforms on the site? I don't see any add-on modules, want to be aware of anything I might miss

[rjbain]

@dustinleblanc not that I can think of. @nicholas-kebbas what you say?

[nicholas-kebbas]

@rjbain @dustinleblanc Nope should just be that module

[dustinleblanc]

Sweet! Moving on to redirects then

[dustinleblanc]

@rjbain @nicholas-kebbas I've got both the webforms and redirects stubbed in, but we definitely have to do some work to map the nids and placement for the webforms. How were webforms placed on the old site? Where are we with tracking the node ids from the old site?

[rjbain]

@dustinleblanc I believe @labboy0276 is setting up node mapping for migrations? @nicholas-kebbas do users used panels to place webforms on the current site?

[nicholas-kebbas]

@dustinleblanc @rjbain Most webforms were panelized within a section page, mainly so we could have the webform on a page with other content/with navigation. The webform content type was also publicly accessible though. Like this form for example:

https://myusf.usfca.edu/content/announcement-submission-form https://myusf.usfca.edu/marketing-communications/announcement-submission-form

Since we're not using anything like panels, we can look into accomplishing this with the Bootstrap Paragraphs Webform Module, potentially? Looks like we have that installed but not enabled on dev.

[dustinleblanc]

@nicholas-kebbas I am down with whatever layout works best with the site setup. The next question though is:

Do we need to migrate any webform placements? If we do, that just means digging into how they are mapped in the database (I am guessing in some of the panels config) to find what pages they exist on, and then create the new paragraph block on the new site to migrate into.

[dustinleblanc]

Also, just spoke with @labboy0276, we still have plenty of other nodes that haven't been migrated, so I think we might need to make sure to run ALL node migrations first before running these

[nicholas-kebbas]

@dustinleblanc Migrating all webform placements would be ideal if that would be feasible. If not we could work out a process for manual placement but it'd be best to know if we have to go that route sooner rather than later.

[drmyers1]

@dustinleblanc thank you again for your help with this. @rjbain was able to successfully import web content and retain the node id on his multidev. He is currently running another test on a new multidev and then connect with you about adding the content to Tandem2.

I have been spot checking the user import. One thing I have noticed is that our current version of myUSF has Display Name in the profile but I dont see this on the Drupal 8 version. Can this be added?

[drmyers1]

@dustinleblanc i have been spot checking webforms. It looks like most of the date migrated over. I do see that if a taken is being used it doesn't seem to have migrated the brackets. Here is an example where the form will pre-populate username and email for logging in users. If I add in the brackets it works correctly. Not sure how many forms have these tokens. Is there a way to include the brackets?

Here is an example of a form:

http://pr-tandem2-dgreat.pantheonsite.io/form/webform-6817

[drmyers1]

@dustinleblanc I also see the alias for the form was not included with the migration. The above mentioned form (http://pr-tandem2-dgreat.pantheonsite.io/form/webform-6817) has the following alias on production.

https://myusf.usfca.edu/its/contact-us

[drmyers1]

@dustinleblanc

@rjbain confirmed that he deleted all the nodes on pr-tandem2. Can we schedule importing the users? Do you have an estimate of when this can be completed?

[dustinleblanc]

Punch list of things to do

• [x] Review that the user display names get migrated, I've stubbed this but haven't confirmed it works
• [ ] Review the authmap migration to make sure it will actually allow CAS login (see #82)
• [ ] Aliases weren't part of the migration at all, per @drmyers1 we should add them
• [x] See https://github.com/rjbain/dgreat/issues/80#issuecomment-396670877, I don't know how this works, can we do some kind of magic token replacement?

[drmyers1]

@dustinleblanc should i test these on tandem2?

[drmyers1]

@dustinleblanc welcome back. Hope everything is well. Do you have an estimate on when we will be able to test the migration with @rjbain? Please let me know if you need anything from us.

[drmyers1]

@dustinleblanc is there anything you need us to test?

[dustinleblanc]

@drmyers1

Tokens in webforms: http://pr-tandem2-dgreat.pantheonsite.io/form/webform-6817

User with display name: http://pr-tandem2-dgreat.pantheonsite.io/user/35192/edit

@reynoldsalec said you checked in on the aliases, so not including that here.

We should now be all set for @rjbain to test importing all of the data.

[drmyers1]

@dustinleblanc the tokens look to be working.

I see the display name in your example. Will the other users in the system have their username populated once we test another import? I also see that the CAS username is not populated. If I compare to our production site. Users have both the username field and the CAS username field populated with their username. I have attached a screenshot.

[drmyers1]

@rjbain can you let @dustinleblanc know if you have any questions about testing the import.

[drmyers1]

@dustinleblanc @rjbain I was looking at the pdfs that were migrated and i get a 404 when i try and access. In the file list is shows the file name and file size but I am not able to view the actual file. Any ideas on how we can fix?

[drmyers1]

@dustinleblanc @rjbain For webforms, i am seeing that the html field and the checkbox multi-select are not coming over correctly. The html field is showing the field name and the checkbox is missing all of the values. Here is an example: http://pr-tandem4-dgreat.pantheonsite.io/form/webform-132654

This is what is looks like on our current production site. https://myusf.usfca.edu/content/one-stop-pulse-survey

Please let me know if you have any questions.

[drmyers1]

@dustinleblanc @rjbain doing some more digging it looks like the two field types listed above are not migrating to the correct field. The HTML field becomes the Advanced HTML/Text field on the new site. It should be Basic HTML. The checkbox multi select is becoming a single checkbox field. It should get migrated as Checkboxes (plural).

I have set up a basic html field on the form and will set up a checkboxes field to show the difference.

http://pr-tandem4-dgreat.pantheonsite.io/admin/structure/webform/manage/webform_132654

[drmyers1]

@dustinleblanc @rjbain I found over 350 pages of example data. Where did the users come from? Almost all the admin accounts did not get the CAS username. Most of the users did have a cas username but non had display name. Is the mapping not set up correctly to bring over the display name?

Rob, were there no users when you started the import or did any of these account exist?

[rjbain]

@drmyers1 @dustinleblanc I'm not sure where those example accounts came from. They're not in the D8 or D7 db. The D8 db had user accounts in it. Dustin, do I need to delete all the users in the D8 db before running the migration?

[drmyers1]

@dustinleblanc here is an example of a test account. http://pr-tandem4-dgreat.pantheonsite.io/user/35262/edit?destination=/admin/people%3Fuser%3D%26status%3DAll%26role%3DAll%26permission%3DAll%26order%3Dstatus%26sort%3Dasc

I also noticed that one of our team members (Michael Cole) did not have any roles or groups other than administrator. He also did not have cas username and display name. On production his profile has the employee role and group. Here is the profile on the test branch: http://pr-tandem4-dgreat.pantheonsite.io/user/35262/edit?destination=/admin/people%3Fuser%3D%26status%3DAll%26role%3DAll%26permission%3DAll%26order%3Dstatus%26sort%3Dasc

[drmyers1]

@dustinleblanc we also tested deleting my account. I logged back have no roles or groups other than authenticated. I should at a minimum have the employee role and group.

My username is drmyers if you want to look at the profile.

[dustinleblanc]

@drmyers1 I've filed an issue on the webform migration plugin here: https://github.com/heshanlk/webform_migrate/issues/7

I'll be trying to solve that

[drmyers1]

@dustinleblanc how are things going with the cas users. Have you been able to include the display name? Any thoughts on why admin users are not getting the cas username? Any updates on new users logging with but not getting any roles or groups?

[dustinleblanc]

@drmyers1 going quite well actually!

Have you been able to include the display name?

Yes this is being mapped in the migrations, I can see the names coming over. I think I had introduced a bug into the code for the user migration when trying to merge in upstream changes, it should now be fixed.

Any thoughts on why admin users are not getting the cas username?

My guess is that what is actually happening here is that existing users in the D8 site aren't getting mapped. I suggested to @rjbain that we might want to drop those users, or they will have to be manually fixed.

Any updates on new users logging with but not getting any roles or groups?

Yep! This was fixed today, figured out how we had the mapping broken and fixed it up and confirmed by deleting dfaculty and then re-authenticating them. As a bonus, I also setup the givenname field to populate display name on user registration.

[dustinleblanc]

Another note @drmyers1, re: deleting accounts and groups.

I don't believe there is currently any code to assign a new account to any groups (I could be wrong, @labboy0276?) So upon deletion, I've got things fixed to populate your roles from CAS, but it doesn't do anything to handle groups.

[drmyers1]

@dustinleblanc @rjbain i add my note to the wrong card with my user testing. sorry about this. I will delete these notes until we have more information from @rjbain