Walkthrough Analysis Phase

[timo-b-roettger]

Detailed walkthrough of what they are supposed to do in phases one.

[timo-b-roettger]

@jvcasillas @stefanocoretta let's first compile a bullet point road map

General information:

• website including overview of research question

PHASE II - 2021-12-15 to 2021-04-14

• Everybody fills in intake form with general information about themselves as well as agreeing to the contributor agreement.
• Everybody fills in recruitment form
• Everybody fill in [analytical approach questionnaire]

COMMENT: It's silly to have that spread out across three different questionnaires.

If filled out and submitted, gain access to the data component of OSF repo. The wiki gives relevant information about the structure and the files in this repository.

Suggested workflow:

• First carefully read the description of the data collection.
• Download the production folder which contains the audio recordings and pretagged TextGrids (/audio) and the trial-lists containing the randomized presentation sequence for each individual speaker (/trial-lists).
• Analyse the recordings as you see suited to answer the research question, including extraction of acoustic information and statistical analysis.

"Do speakers phonetically modulate utterances to signal atypical word combinations?"

• After analysis, upload analysis files (including additionally derived data and text files that were used to extract and pre-process the acoustic data), analysis code (if applicable), and a detailed journal-ready analysis section.

TO DO:

• [ ] specify where to upload their materials (and in what form?)
• [ ] specify the form of the journal-ready analysis section
• [x] tidy up / merge questionnaires at beginning?

[timo-b-roettger]

Comments from Slack:

• in intake form, Q15, we refer to “sign” and agreement. Can we link to the contributor agreement we have drafted (also where do we put that contributor agreement)?
• also recruitment form has Q1-3 scrambled and Q2 refers to May-August 2021. I don’t think referring to the github is useful? We probably want to the website?
• More: analytical approach questionnaire. Whats the purpose of Q3? https://osf.io/xmj4v/
• and why is it called analytical approach questionnaire, it merely asks about analytical experience, right? (do we still do this at all?)
• Another thing that I don’t understand is: how do we associate some of the questionnaires with the respective analysts? Some of them (e.g https://osf.io/ad862/) have no identification that helps mapping.

[jvcasillas]

Comments from Slack:

• in intake form, Q15, we refer to “sign” and agreement. Can we link to the contributor agreement we have drafted (also where do we put that contributor agreement)?

How about a google form?

• also recruitment form has Q1-3 scrambled and Q2 refers to May-August 2021. I don’t think referring to the github is useful? We probably want to the website?

Fixed the order and removed the reference to the dates. Also, the link is to the website (i.e., https://many-speech-analyses.github.io)

• More: analytical approach questionnaire. Whats the purpose of Q3? https://osf.io/xmj4v/

I have no recollection of why we wanted to ask this. @stefanocoretta ? I'm not sure it still fits in our plans. We probably should delete it.

• and why is it called analytical approach questionnaire, it merely asks about analytical experience, right? (do we still do this at all?)

Not sure about the name. Is it still useful to change the name? We would have to find and replace all the other places we refer to this.

• Another thing that I don’t understand is: how do we associate some of the questionnaires with the respective analysts? Some of them (e.g https://osf.io/ad862/) have no identification that helps mapping.

Good catch. We can add a text box at the beginning asking them to enter their assigned label (sexy_turtle).

[stefanocoretta]

I think we can delete Q3 from the AAQ and it would be good to rename it (I was confused about its purpose initially because of the name). It would also be good to have one single form, which I did suggest some time back but there were concerns that would differ too much from the RR. I think it's worth doing a single form and ask/tell AMPPS about it.

[jvcasillas]

@stefanocoretta @troettge Following my notes from our last meeting I have done the following:

• COMBINE QUESTIONNAIRES
  • analytic approach
  • recruitment
  • analytic quest
• delete Q3 from the AAQ

The new questionnaire that combines the three is called "many_analyses_questionnaire". I still am a bit hesitant about this. I get the feeling we are forgetting/overlooking something. In any case, I have documented the changes in the google doc change log and Im attaching a word version of the questionnaire here for you both to check if you want.

many_analyses_questionnaire.docx

[stefanocoretta]

I would make it so that we don't differentiate between the Main Contact person and the other members of the team in the questionnaire. I would rather have a general First name, Surname field followed by Name of Main Contact person so that we know the teams. and then we don't need Q6.

So to summarise I would do:

Q2 First name Q3 Last name Q4 Academic institution Q5 Name of Team Main researcher/contact person (no particular preference as to which to use) REMOVE Q6 Q7 > Q6 and so on

[jvcasillas]

Updated. Here are the two forms:

msa_intake_form.docx
msa_data_analysis_questionnaire.docx

UPDATE: question 5 of the intake form still asked for the email of main contact person. I just fixed this so ignore it in the word doc attached here.

[stefanocoretta]

• 2021 Dec 6
  • Briefing
  • Release Intake Form
• 2021 Dec 14
  • Due date for Intake Form
• 2021 Dec 15
  • View-only link of OSF "Data" component sent to all via Eventbrite. (You can't add contributors in bulk on OSF so it's easier this way).
• 2022 April 15
  • Due date for submission of analysis (report with Methods and Results, materials, and Data Analysis Questionnaire).
  • Submission of report and materials will be done via OSF (each team creates a private project and adds us as contributors) or WeTransfer if > 5 GB.