Pre-conference questionnaire / statement

agbarnett commented 6 years ago

To help get the most out of the day, it may be useful to canvas ideas prior to the day and/or begin work on an agreed statement of action. See Joshua's notes.

SuzanneDixon-Suen commented 5 years ago

DRAFT PRE-MEETING QUESTIONNAIRE, FOR COMMENT EXECUTE IN E.G. SURVEYMONKEY?

SuzanneDixon-Suen commented 5 years ago

Q1: Please tell us your professional role and research area.

SuzanneDixon-Suen commented 5 years ago

Q2: Please select which five of the following problems in research you think are the most important to address, and rank them 1 (most important) to 5.

Low numbers of replication studies performed
Low rates of data sharing
Low rates of pre-registration of analysis protocols
Lack of involvement of statisticians and epidemiologists on research teams
Failure to register clinical trials
Low publication rates after studies are performed
Unwillingness of journals to publish null results or replication studies
Inappropriate academic incentives
Lack of funding for replication studies
Insufficient training of young scientists in research reproducibility principles
Over-emphasis on p-values/statistical significance
Lack of reference to research design and reporting guidelines (EQUATOR)
Resistance to correcting or retracting articles
Insufficient oversight of research studies
Poor-quality meta-analyses

Add more items as needed

SuzanneDixon-Suen commented 5 years ago

Q3: Are there other issues that should be discussed? Please tell us below:

SuzanneDixon-Suen commented 5 years ago

Q4: Which of the following potential policy changes or actions would you endorse?

Better and continued training in research methods at all career stages
Increased coordination/consistency between medical/public health schools on research reproducibility syllabus components including data management training
Mandating the inclusion of statisticians and data management experts on research teams
Requiring all Australian trials to be registered and a protocol published
Petitioning journals to include a research registration section for publishing protocols for trials and analyses using cohort study data
Requiring all Australian trials to publish their results within a set timeframe
Dedicated journal for replication studies?
Funding dedicated specifically for researchers to write up null findings, recent or past
Requiring a replication component as part of grant proposals
Requiring depositing of research data in an open repository as part of grant proposals
Dedicated teams within schools/institutions for reviewing research protocols
Australian data repository for raw research data?
Revised academic incentives that prioritise replication studies (e.g. better metrics)

Add more items as needed

SuzanneDixon-Suen commented 5 years ago

Q5: Please suggest other possible policy changes or actions:

SuzanneDixon-Suen commented 5 years ago

Q6: Please share the practices you, or your institution, have already implemented to maximise research quality:

VBOz commented 5 years ago

For Q2 can we amend this Inappropriate academic incentives to be more explicit that it relates to publication in specific venues. And can we add an option on the culture of institutions/research groups as an issue

agbarnett commented 5 years ago

Chatting with @SuzanneDixon-Suen today we thought we would send the questionnaire to people 2 weeks before the meeting. We also talked about adding an example of a policy change to the preamble, possibly the culture change around not using impact factors and/or registering clinical trials. This will help focus people's minds on policy.

agbarnett commented 5 years ago

We might add some optional pre-reading to the end of the questionnaire in case there are any really enthusiastic people. We could point people to the Waste in Research series in the Lancet.

VBOz commented 5 years ago

The slides from the NHMRC meeting is now available also https://nhmrc.gov.au/event/2018-nhmrc-symposium-research-translation

agbarnett commented 5 years ago

A reminder e-mail will go out to all attendees on Monday March 11. This e-mail will also contain a link to the questionnaire. So we need to have this finalised by then.

agbarnett commented 5 years ago

I've created a draft survey here. Please test and comment.

agbarnett commented 5 years ago

I've changed some wording in the survey and added some new problems and policies after chatting with David Moher today.

SuzanneDixon-Suen commented 5 years ago

See attached file for my suggestions. I assume you've tested the "submit" function so I didn't click this. PreConf Qre test version SDS comments 20190302.docx

SuzanneDixon-Suen commented 5 years ago

NB - when I downloaded the file I just posted, my suggestions presented using track-changes and Word comments were not immediately visible even after I clicked 'enable editing'. I closed the document and re-opened it to solve this problem.

VBOz commented 5 years ago

I added some comments. See attached. The two big options are a bit overwhelming at first sight but will be ok if worded clearly I think Survey 7 March VB comments.docx

agbarnett commented 5 years ago

I'm closing this now because I think the survey is done and it will be sent out on Monday. Thanks for all your feedback.

agbarnett / crisis.meeting

Pre-conference questionnaire / statement #4