Open softloud opened 2 years ago
Hey Charles! Great to hear from you! What's the Cochrane review you mention here? I'm a little confused, but possibly because I've got my head in about 8 ongoing hackathon projects right now... so I'm not sure how much help I would be, I'm afraid...
From: Charles T. Gray @.> Sent: 11 April 2022 16:29 To: softloud/spunk @.> Cc: nealhaddaway @.>; Mention @.> Subject: [softloud/spunk] impromptu eshackathon (Cochrane submission) or whenever (living analysis) (Issue #8)
heya evisynth peeps, @DrMattGhttps://github.com/DrMattG, @nealhaddawayhttps://github.com/nealhaddaway, @mjwestgatehttps://github.com/mjwestgate, @befriendabacteriumhttps://github.com/befriendabacterium, @dmphillippohttps://github.com/dmphillippo and opensci peeps, @yochannahhttps://github.com/yochannah, @debruinehttps://github.com/debruine, @steelehttps://github.com/steele (Lisa and James have rockstar handles) thought you might be interested in trying out living analysis collaboration workflows with me. I can email you a link to the manuscript whenever you decide to get involved.
I've put together first thoughts on workflow herehttps://softloud.github.io/spunk/extending.html.
Whenever suits.
arse backwards
Things are moving fast with data scaling up. Traditional diagnostic methods for statistics are less useful at combinatorially-many comparisons. And reproducibility is widely viewed as a end of production component.
I am sorry to not give you more time to be part of this Cochrane review. This is why I am going to write in the methods section about why I think making an analysis patchable and provide shortcuts for common analyses in the discipline, that this should be done before implementing more advanced models. This is a phase one of an analysis, setting it up so that it's really easy to get help from the community, because science is better when collaborative.
An Australian might say implementing reproducibility and living analysis after the advanced models is done is arse backwards. Collaborative data science brings it's own challenges, but will absolutely help with the advanced algorithms.
Cochrane submission hackathon
I am pushing hard to wrap my component of the writing on the manuscript right now, I'm very behind because anxiety problems on top of the methodological concerns.
But I imagine some work will be done by the postdoc leading the paper, and the PI. So, if you see an issue you can do easily right now, your name will go into the Cochrane submission. And hey, there'll be revisions, too, most likely. So there'll be some weeks before final submission, surely. I'll update when I know more.
But also, whenever
It is a living analysis, however, and I don't see why major extensions aren't publishable. Makes it more useful, the peeps would want to know. I'm in this project to tinker with minimal workflows for this kind of thing, so publishing is a secondary concern for me. Happy to work on big and small aspects of this.
where has Charles been?
Long time mostly I've been quiet on the research front for a while. Feels like years since I've been able to think clearly. This happened in my twenties, but not for such a prolonged time since. I stopped speaking to everyone for about six months, trauma-induced anxiety at such a deafening roar. Suffice to say Mr Robothttps://youtu.be/N6HGuJC--rk is basically porn for me at the moment.
I moved to Copenhagen for a job at a start up a few weeks ago, but they are okay with me investing time in this project. Life is better than ever here. I finally was in a good enough place to get some science done on spunk::, a side project I've had going for about a year.
— Reply to this email directly, view it on GitHubhttps://github.com/softloud/spunk/issues/8, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AKOBNXGDWASWRSDX6VRAPETVERHPJANCNFSM5TDYDPZA. You are receiving this because you were mentioned.Message ID: @.***>
Thanks for the questions, @nealhaddaway. It's highly unlikely now would be a good time for most people. But there might be people on that list for whom it'd be beneficial to be able to demonstrate experience on a Cochrane review. This is a study on male infertility evidence.
One of those odd side projects I don't know how I stumbled into, but was so similar to my pdoc, and much smaller in scale, I said yes. I have no idea how the PI knew to message me. She's in Australia, and I met her at some public speaking thing I did. Super lovely.
This is definitely a no pressure tag, just an if you want to.
Ah cool! Yeah, I think I could dip in very briefly, but I'm leaving research this summer so wouldn't have any time after that - I'll probably be a no, sadly... Thanks tho!
From: Charles T. Gray @.> Sent: 11 April 2022 17:56 To: softloud/spunk @.> Cc: nealhaddaway @.>; Mention @.> Subject: Re: [softloud/spunk] impromptu eshackathon (Cochrane submission) or whenever (living analysis) (Issue #8)
Thanks for the questions, @nealhaddawayhttps://github.com/nealhaddaway. It's highly unlikely now would be a good time for most people. But there might be people on that list for whom it'd be beneficial to be able to demonstrate experience on a Cochrane review. This is a study on male infertilityhttps://softloud.github.io/spunk/ evidence.
One of those odd side projects I don't know how I stumbled into, but was so similar to my pdoc, and much smaller in scale, I said yes. I have no idea how the PI knew to message me. She's in Australia, and I met her at some public speaking thing I did. Super lovely.
This is definitely a no pressure tag, just an if you want to.
— Reply to this email directly, view it on GitHubhttps://github.com/softloud/spunk/issues/8#issuecomment-1095356778, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AKOBNXGDV675SWWJNRMVX3TVERRTLANCNFSM5TDYDPZA. You are receiving this because you were mentioned.Message ID: @.***>
Hei hei @softloud! This sounds interesting - I haven't got much time at the moment but will try and do what I can. @nealhaddaway do you know that everytime you say "I'm leaving research this summer..." a research pixie dies :( Dont go! We need you. (But I am also very happy for you :) )
Haha - I’m afraid I’m the research pixie who already died from exasperation and mismanagement. Lol
Sent from my iPhone
On 11 Apr 2022, at 21:09, Matthew Grainger @.***> wrote:
Hei hei @softloudhttps://github.com/softloud! This sounds interesting - I haven't got much time at the moment but will try and do what I can. @nealhaddawayhttps://github.com/nealhaddaway do you know that everytime you say "I'm leaving research this summer..." a research pixie dies :( Dont go! We need you. (But I am also very happy for you :) )
— Reply to this email directly, view it on GitHubhttps://github.com/softloud/spunk/issues/8#issuecomment-1095516894, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AKOBNXDVBKRLGYWZUSNZ7ZLVESBHFANCNFSM5TDYDPZA. You are receiving this because you were mentioned.Message ID: @.***>
Well I thought I'd be done with research, but now I'm at a tech start up I'm doing way more research than before :joy:
Even comments contributing to this discussion to say you're too busy ever is useful; will inform my methods section. And further goes to support what I'm saying in methods; if we want to do collaborative research data science, the living analysis and reproducibility needs to be implemented first. People need notice and time to be involved in a project like this and the reproducibility is a great way to share what is known, unknown, easy and not easy, etc. for the person implementing the analysis.
@drmattg, I'll email you a link to the paper. Methods are in draft form, need another edit, but are followable. Also not necessary to read manuscript, that's where I pontificate about collaborative research software engineering.
This is a living analysis, so you don't have to do anything immediately, whenever suits.
The person for whom I hope there's really low-hanging fruit to easily work on is @dmphillippo, who could implement SMD calculations, threshold analysis, etc. All of this analysis is based of David's wonderful multinma::
:package:. Hope is he can spin this into an easy and, crucially, not time consuming, publication by patching in more nuanced statistical analyses. And beauty is can be done any time, whenever, if ever, David has a spare couple of days and is so inclined.
Hi Charles - thanks for the invite here. Good to hear from you and congrats on new ventures. Think I'm a bit more out of the loop as to what this project is compared to some others here but happy to try and be of help if I can if it's just running/reviewing code? I'm pretty stuck into getting my head around my own meta-analysis right now but if there's certain things I can assist with let me know. If you could share the manuscript I could maybe get a better idea of how I may or may not be able to contribute too? Might team up with @DrMattG if I think I can offer anything!
Thanks for tentatively putting up your hands, @befriendabacterium and @DrMattG. There's a bunch of issues up on small and big things. If and only if you have time, of course.
The PI and I are working on the manuscript and final run of analyses now. I'm reasonably happy with what we have for BMJ (update, it's a BMJ submission where we're using Cochrane protocols, not a Cochrane submission, me being vague).
So, don't feel any pressure, it's only if you want to be associated with the package for submisison. Otherwise, anytime, and if no one updates, well that's the same as a static submission which it would've been anyways. I can at least feel good I set up everything for patching when/if peeps want to improve the analysis, or update the dataset.
heya evisynth peeps, @drmattg, @nealhaddaway, @mjwestgate, @befriendabacterium, @dmphillippo and opensci peeps, @yochannah, @ljcolling, @debruine, @steele (Lisa and James have rockstar handles) thought you might be interested in trying out living analysis collaboration workflows with me. I can email you a link to the manuscript whenever you decide to get involved.
I've put together first thoughts on workflow here.
Whenever suits.
arse backwards
Things are moving fast with data scaling up. Traditional diagnostic methods for statistics are less useful at combinatorially-many comparisons. And reproducibility is widely viewed as a end of production component. I was given free rein on this project, and because of that, I think I did better science than if I had attempted to implement fancy models. I followed the reasoning and guidance I'd been given before, but this was a road to frustration. Decided to go in a different direction, seeing as PI is letting me take the lead on this. Because there is so little time to get an analysis done in evidence synthesis. This seems more useful for the time allocated, if it makes it easy for others to also volunteer their time.
I am sorry to not give you more time to be part of this Cochrane review. This is why I am going to (wait, no, I wrote that bit already, almost done with draft) write in the methods section about why I think making an analysis patchable and provide shortcuts for common analyses in the discipline, that this should be done before implementing more advanced models. This is a phase one of an analysis, setting it up so that it's really easy to get help from the community, because science is better when collaborative.
An Australian might say implementing reproducibility and living analysis after the advanced models is done is arse backwards. Collaborative data science brings it's own challenges, but will absolutely help with the advanced algorithms.
Cochrane submission hackathon
I am pushing hard to wrap my component of the writing on the manuscript right now, I'm very behind because anxiety problems on top of the methodological concerns.
But I imagine some work will be done by the postdoc leading the paper, and the PI. So, if you see an issue you can do easily right now, your name will go into the Cochrane submission. And hey, there'll be revisions, too, most likely. So there'll be some weeks before final submission, surely. I'll update when I know more.
But also, whenever
It is a living analysis, however, and I don't see why major extensions aren't publishable. Makes it more useful, the peeps would want to know. I'm in this project to tinker with minimal workflows for this kind of thing, so publishing is a secondary concern for me. Happy to work on big and small aspects of this.
where has Charles been?
Long time mostly I've been quiet on the research front for a while. Feels like years since I've been able to think clearly. This happened in my twenties, but not for such a prolonged time since. I stopped speaking to everyone for about six months, trauma-induced anxiety at such a deafening roar. Suffice to say Mr Robot is basically porn for me at the moment.
I moved to Copenhagen for a job at a start up a few weeks ago, but they are okay with me investing a little time in this project. Life is better than ever here. I finally was in a good enough place to get some science done on
spunk::
, a side project I've had going (anxiety-induced procrastination) for about a year. PI has been so amazing and understanding every step of the way. I couldn't let a grrl down, or her postdoc.