dzhw / zofar

10 stars 1 forks source link

As a MDM user, I want to get a FDZ Question export to reimport in MDM #89

Closed kpstephan closed 5 years ago

kpstephan commented 6 years ago

this means

We need the files to have

dzhwmeisner commented 6 years ago

http://vmdevwiki.dzhw.local/fdz/mdm_ifq-mdm-mod_Update310718.zip send to Robert

UteH commented 6 years ago

@UteH: get feedback from @rbirkelbach and @svietgen about the 3rd zofar export https://github.com/dzhw/Effizienzprojekt_Modul_H/issues/12

UteH commented 6 years ago

Feedback zur 3. Lieferung

Fazit questions

Fazit variables

UteH commented 6 years ago

as we have not identified the FDZ-question #87 yet, we will just use this format: Page-ID.#

UteH commented 6 years ago

Hi @dzhwmeisner should I plan to be testing this issue today?

dzhwmeisner commented 6 years ago

Here are current Updates for the IFQ-Survey and the SE21-Survey

http://vmdevwiki.dzhw.local/fdz/MDM_ifq_Update02102018.zip http://vmdevwiki.dzhw.local/fdz/MDM_se21_Update02102018.zip

with the request to test

UteH commented 6 years ago

~work in progress, will be further edited~

hidden, because referring to old files. See below

thanks! I have some first remarks, but I need more time to test the exports thoroughly.

Wissenschaftlerbefragung

files

Generally, I need more time to test such a complex issue.

UteH commented 6 years ago

@dzhwmeisner is this the right project? https://metadatamanagement-test.cfapps.io/#!/de/studies/stu-meisner1$ ? There seem to be many oddities concerning the sequence of the questions and the filenames of the images do not correspond to the files you uploaded earlier. Am I missing something here? Please provide help

edit: I am waiting for feedback before further testing

UteH commented 6 years ago

Ute replace with new files

UteH commented 6 years ago

I uploaded the files you sent earliert to the mdm (DAP: meisner1)

Wissenschaftlerbefragung

Generally, a lot of details seem to be messed up whereas they had been working in the actual mdm export. Normally, I would have stopped testing because the export has so many bugs. But in terms of time I tried to test the export so that we have a list to work on. We should discuss this.

I often compared the new export with the real export in the mdm with the new test project. Here are some examples of what I found:

questions

additionalQuestionText.en

content (jsons)

content (images)

I found these errors absolutely randomly, please investigate further

completeness

sequence

topic

encoding

images

english version

no claim to completeness! I've been looking for "???" in the images, "zofar" in the questionText and some I detected randomly. Please investigate further

instrument.title

file structure

file name / folder name / question.number

variables

encoding

@dzhwmeisner

Generally, I need more time to test such a complex issue. Also, please do upload the files into the MDM and test the export yourself first. Next time, please wait to build the final version (e. g. with the correct sequence and with topic) so that I can test a more final versions.

UteH commented 6 years ago

~as discussed in the retro we will go back to the last question export that had worked and try to improve from there.~

@dzhwmeisner did edit the new export, so this to do list is valid

In our file system it looks like the import was called "mdm_ifq-mdm-mod_Update240518" -> @dzhwmeisner can you work with this?

UteH commented 6 years ago

~I updated the To Do list.~

@dzhwmeisner did edit the new export, so this to do list is valid

UteH commented 6 years ago

PS: @dzhwmeisner @vdick do you know about our "post validation button"? grafik

with clicking the button, several dependecies are tested, for questions this is (according to the mdm wiki):

dzhwmeisner commented 6 years ago

newest Release is DAP: https://metadatamanagement-test.cfapps.io/#!/de/studies/stu-zofar221018$

Wissenschaftlerbefragung

Generally, a lot of details seem to be messed up whereas they had been working in the actual mdm export. Normally, I would have stopped testing because the export has so many bugs. But in terms of time I tried to test the export so that we have a list to work on. We should discuss this.

I often compared the new export with the real export in the mdm with the new test project. Here are some examples of what I found:

questions

additionalQuestionText.en

(dzhwmeisner) ==> seems to be. will be checked

content (jsons)

(dzhwmeisner) ==> fixed. JSON Attribute has changed

content (images)

I found these errors absolutely randomly, please investigate further

(dzhwmeisner) ==> maybe reworked for mdm by FDZ? Fixed in current Test-Version

(dzhwmeisner) ==> maybe reworked for mdm by FDZ? Fixed in current Test-Version

(dzhwmeisner) ==> fixed.

(dzhwmeisner) ==> fixed.

(dzhwmeisner) ==> Soft reminders not separated anymore. Now we have 135 Questions including index,start,end,cancel

(dzhwmeisner) ==> Soft reminders not separated anymore.

completeness

(dzhwmeisner) ==> Seems to be87_bewerberauswahl

(dzhwmeisner) ==> current Test Version include these questions

sequence

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

(dzhwmeisner) ==> fixed.

topic

(dzhwmeisner) ==> implemented for Questions on which page an Topic is set. Not for following questions.

encoding

(dzhwmeisner) ==> fixed.

(dzhwmeisner) ==> fixed.

images

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

(dzhwmeisner) ==> fixed

-> the soft reminders etc. should be part of the image

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

english version

no claim to completeness! I've been looking for "???" in the images, "zofar" in the questionText and some I detected randomly. Please investigate further

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> not fixed. this is an placeholder for an answer of a previous question. Questions will not be answered while screenshotting.

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

instrument.title

file structure

file name / folder name / question.number

(dzhwmeisner) ==> fixed. Pages can named individual. in the current Test-Version only the 'page' will be replaced from name.

(dzhwmeisner) ==> not fixed. the schema page# is not required. Pages can named individual. in the current Test-Version only the 'page' will be replaced from name.

variables

encoding

(dzhwmeisner) ==> the CSV-File is UTF-8 encoded. In the current ZIP is an additional SO-8859-1 encoded Version

dzhwmeisner commented 6 years ago

MDM_stu-zofar221018.zip According Archive to stu-zofar221018$

UteH commented 6 years ago

@dzhwmeisner thanks for the new export! I found some inconsitencies again, I think it's easiest, if we talk about it in person. I will contact you via Outlook :calendar:

UteH commented 6 years ago

Info:

Wissenschaftlerbefragung

questions

additionalQuestionText.en

content (jsons)

(dzhwmeisner) ==> fixed. JSON Attribute has changed -> Ute: ok, see section discussion

content (images)

I found these errors absolutely randomly, please investigate further

(dzhwmeisner) ==> fixed. JSON Attribute has changed

(dzhwmeisner) ==> maybe reworked for mdm by FDZ? Fixed in current Test-Version

(dzhwmeisner) ==> maybe reworked for mdm by FDZ? Fixed in current Test-Version

(dzhwmeisner) ==> fixed. -> Ute: ok. How can that happen? Do we need to do something about this?

(dzhwmeisner) ==> fixed. -> Ute: ok. How can that happen? Do we need to do something about this?

(dzhwmeisner) ==> Soft reminders not separated anymore. Now we have 135 Questions including index,start,end,cancel -> Ute: ok

(dzhwmeisner) ==> Soft reminders not separated anymore. -> Ute: ok

completeness

(dzhwmeisner) ==> Seems to be87_bewerberauswahl -> Ute: ok, seems fine

(dzhwmeisner) ==> current Test Version include these questions -> Ute: we will leave it like this!

sequence

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective -> Ute: Ok, sequence still seems odd, see above

(dzhwmeisner) ==> fixed. -> Ute: Ok, sequence still seems odd, see above

topic

(dzhwmeisner) ==> implemented for Questions on which page an Topic is set. Not for following questions. -> Ok

encoding

(dzhwmeisner) ==> fixed. -> Ute: ok

(dzhwmeisner) ==> fixed.

images

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

(dzhwmeisner) ==> fixed

-> the soft reminders etc. should be part of the image

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

english version

no claim to completeness! I've been looking for "???" in the images, "zofar" in the questionText and some I detected randomly. Please investigate further

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> not fixed. this is an placeholder for an answer of a previous question. Questions will not be answered while screenshotting.

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

instrument.title

file structure

file name / folder name / question.number

(dzhwmeisner) ==> fixed. Pages can named individual. in the current Test-Version only the 'page' will be replaced from name. -> Ute: that's fine. We will take the name exactly as it is in zofar. SISO.

(dzhwmeisner) ==> not fixed. the schema page# is not required. Pages can named individual. in the current Test-Version only the 'page' will be replaced from name. -> Ute: that's fine. We will take the name exactly as it is in zofar. SISO.

variables

UteH commented 6 years ago

@andreaschu @dzhwmeisner do you have any kind of question flow diagram (Filterführungsdiagramm) for the Wissenschaftlerbefragung 2016?

I can't work out the "real" question flow

UteH commented 6 years ago

@dzhwmeisner I think I am done for now, thank you. Feel free to make an appointment if you think we should talk about some remarks face to face.

UteH commented 6 years ago

@UteH: compare qml sequence with export, nothing more.

kastirke commented 6 years ago

@UteH : Concerning your mail from 5th November 2018: Question flow within Wissenschaftlerbefragung 2016

grafik

dzhwmeisner and I checked the Wissenschaftlerbefragung-Programmieranleitung (last version we own is from 21th October 2015; this is not the final one; there were changes after this date; please ask the project members for the final version). To us, the qml ist right with respect to the variable definition.

For example: grafik

Here you find the whole Anleitung: iFQ_WissBefr_2015_Fragebogen_Kodiert_2015_10_15korr.pdf

UteH commented 6 years ago

@kastirke @dzhwmeisner thank you for these information!

We also talked about how to test the export regarding the question flow of the scs2016. I will only check if the export is correct with respect to the qml and not the Anleitung (because it could contain false information that do not concern the export.)

Thank you for clarifying the situation!

kastirke commented 6 years ago

To us, you will be right by only checking the qml. It defines all variables inluding visible conditions, question flow, instructions, assisting variables and so on. We always advice the projekct teams to update their PV, but we can't quarantee on this.

dzhwmeisner commented 6 years ago

Info:

Wissenschaftlerbefragung

questions

additionalQuestionText.en

content (jsons)

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed. JSON Attribute has changed -> Ute: ok, see section discussion

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> Part of the section problem

(dzhwmeisner) ==> Code Conventions needed to make QML-Structure more reliable

content (images)

I found these errors absolutely randomly, please investigate further

(dzhwmeisner) ==> fixed. JSON Attribute has changed

(dzhwmeisner) ==> maybe reworked for mdm by FDZ? Fixed in current Test-Version

(dzhwmeisner) ==> maybe reworked for mdm by FDZ? Fixed in current Test-Version

(dzhwmeisner) ==> fixed. -> Ute: ok. How can that happen? Do we need to do something about this?

(dzhwmeisner) ==> it was a bug in export logic. No need to do something

(dzhwmeisner) ==> fixed. -> Ute: ok. How can that happen? Do we need to do something about this?

(dzhwmeisner) ==> it was a bug in export logic. No need to do something

(dzhwmeisner) ==> Soft reminders not separated anymore. Now we have 135 Questions including index,start,end,cancel -> Ute: ok

(dzhwmeisner) ==> Soft reminders not separated anymore. -> Ute: ok

completeness

(dzhwmeisner) ==> Seems to be87_bewerberauswahl -> Ute: ok, seems fine

(dzhwmeisner) ==> current Test Version include these questions -> Ute: we will leave it like this!

sequence

(dzhwmeisner) ==> Nadin uploaded a document the implementation of QML based on. The MDM-Version seems to base on a different information source.

(dzhwmeisner) ==> Nadin uploaded a document the implementation of QML based on. The MDM-Version seems to base on a different information source.

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective -> Ute: Ok, sequence still seems odd, see above

(dzhwmeisner) ==> fixed. -> Ute: Ok, sequence still seems odd, see above

topic

(dzhwmeisner) ==> implemented for Questions on which page an Topic is set. Not for following questions. -> Ok

(dzhwmeisner) ==> fixed.

(dzhwmeisner) ==> already fixed manually. But part of the section problem

(dzhwmeisner) ==> Part of the Code-conventions problem

(dzhwmeisner) ==> Part of the Code-conventions problem

encoding

(dzhwmeisner) ==> fixed. -> Ute: ok

(dzhwmeisner) ==> fixed.

images

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

(dzhwmeisner) ==> fixed

-> the soft reminders etc. should be part of the image

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

english version

no claim to completeness! I've been looking for "???" in the images, "zofar" in the questionText and some I detected randomly. Please investigate further

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> Translation is missing in live survey

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> not fixed. this is an placeholder for an answer of a previous question. Questions will not be answered while screenshotting.

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

instrument.title

file structure

file name / folder name / question.number

(dzhwmeisner) ==> fixed. Pages can named individual. in the current Test-Version only the 'page' will be replaced from name. -> Ute: that's fine. We will take the name exactly as it is in zofar. SISO.

(dzhwmeisner) ==> not fixed. the schema page# is not required. Pages can named individual. in the current Test-Version only the 'page' will be replaced from name. -> Ute: that's fine. We will take the name exactly as it is in zofar. SISO.

variables

UteH commented 6 years ago

@dzhwmeisner thanks! could you please also provide the new zip?

UteH commented 6 years ago

Info:

Wissenschaftlerbefragung

questions

additionalQuestionText.en

content (jsons)

(dzhwmeisner) ==> fixed Ute: ok! (de/en)

(dzhwmeisner) ==> fixed. JSON Attribute has changed -> Ute: ok, see section discussion

(dzhwmeisner) ==> fixed -> Ute: seems correct, I need the jsons for clarification

(dzhwmeisner) ==> Part of the section problem

(dzhwmeisner) ==> Code Conventions needed to make QML-Structure more reliable Ute: image (de) is still broken, was this the case for the actual survey? --> @dzhwmeisner please check!

content (images)

I found these errors absolutely randomly, please investigate further

(dzhwmeisner) ==> fixed. JSON Attribute has changed

(dzhwmeisner) ==> maybe reworked for mdm by FDZ? Fixed in current Test-Version

(dzhwmeisner) ==> maybe reworked for mdm by FDZ? Fixed in current Test-Version

(dzhwmeisner) ==> fixed. -> Ute: ok. How can that happen? Do we need to do something about this?

(dzhwmeisner) ==> it was a bug in export logic. No need to do something

(dzhwmeisner) ==> fixed. -> Ute: ok. How can that happen? Do we need to do something about this?

(dzhwmeisner) ==> it was a bug in export logic. No need to do something

(dzhwmeisner) ==> Soft reminders not separated anymore. Now we have 135 Questions including index,start,end,cancel -> Ute: ok

(dzhwmeisner) ==> Soft reminders not separated anymore. -> Ute: ok

completeness

(dzhwmeisner) ==> Seems to be87_bewerberauswahl -> Ute: ok, seems fine

(dzhwmeisner) ==> current Test Version include these questions -> Ute: we will leave it like this!

sequence

(dzhwmeisner) ==> Nadin uploaded a document the implementation of QML based on. The MDM-Version seems to base on a different information source.

-> Ute: I compared the new export randomly with the qml -> seems correct!

(dzhwmeisner) ==> Nadin uploaded a document the implementation of QML based on. The MDM-Version seems to base on a different information source.

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective -> Ute: Ok, sequence still seems odd, see above

(dzhwmeisner) ==> fixed. -> Ute: Ok, sequence still seems odd, see above

topic

(dzhwmeisner) ==> implemented for Questions on which page an Topic is set. Not for following questions. -> Ok

(dzhwmeisner) ==> fixed. -> seems correct, Ute check jsons randomly

(dzhwmeisner) ==> already fixed manually. But part of the section problem

(dzhwmeisner) ==> Part of the Code-conventions problem

(dzhwmeisner) ==> Part of the Code-conventions problem

encoding

(dzhwmeisner) ==> fixed. -> Ute: ok

(dzhwmeisner) ==> fixed. -> Ute: ok (is this version how it was in the actual survey?)

images

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

(dzhwmeisner) ==> fixed

-> the soft reminders etc. should be part of the image

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

english version

no claim to completeness! I've been looking for "???" in the images, "zofar" in the questionText and some I detected randomly. Please investigate further

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> Translation is missing in live survey -> Ute: ok

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> not fixed. this is an placeholder for an answer of a previous question. Questions will not be answered while screenshotting.

(dzhwmeisner) ==> fixed. the old Test Version based on Zofar-question perspective. not on on Zofar-page perspective

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

(dzhwmeisner) ==> fixed

instrument.title

file structure

file name / folder name / question.number

(dzhwmeisner) ==> fixed. Pages can named individual. in the current Test-Version only the 'page' will be replaced from name. -> Ute: that's fine. We will take the name exactly as it is in zofar. SISO.

(dzhwmeisner) ==> not fixed. the schema page# is not required. Pages can named individual. in the current Test-Version only the 'page' will be replaced from name. -> Ute: that's fine. We will take the name exactly as it is in zofar. SISO.

variables

dzhwmeisner commented 5 years ago

mdm_ifq-mdm-mod_Update151118.zip

UteH commented 5 years ago

please check question 72.1 @dzhwmeisner