[REVIEW]: An open learning resource on Reproducible Data Science with Open-Source Python Tools and Real-World Data

[whedon]

Submitting author: @valdanchev (Valentin Danchev) Repository: https://github.com/valdanchev/reproducible-data-science-python Version: v2.1.2 Editor: @ShanEllis Reviewer: @TomDonoghue, @lechten Archive: 10.5281/zenodo.6895578

:warning: JOSE reduced service mode :warning:

Due to the challenges of the COVID-19 pandemic, JOSE is currently operating in a "reduced service mode".

Status

Status badge code:

HTML: <a href="https://jose.theoj.org/papers/3e1de7c74161a5b2c4ce74e536ef6898"><img src="https://jose.theoj.org/papers/3e1de7c74161a5b2c4ce74e536ef6898/status.svg"></a>
Markdown: [![status](https://jose.theoj.org/papers/3e1de7c74161a5b2c4ce74e536ef6898/status.svg)](https://jose.theoj.org/papers/3e1de7c74161a5b2c4ce74e536ef6898)

Reviewers and authors:

Please avoid lengthy details of difficulties in the review thread. Instead, please create a new issue in the target repository and link to those issues (especially acceptance-blockers) by leaving comments in the review thread below. (For completists: if the target issue tracker is also on GitHub, linking the review thread in the issue or vice versa will create corresponding breadcrumb trails in the link target.)

Reviewer instructions & questions

@TomDonoghue & @lechten, please carry out your review in this issue by updating the checklist below. If you cannot edit the checklist please:

1. Make sure you're logged in to your GitHub account
2. Be sure to accept the invite at this URL: https://github.com/openjournals/jose-reviews/invitations

The reviewer guidelines are available here: https://joss.readthedocs.io/en/latest/reviewer_guidelines.html. Any questions/concerns please let @ShanEllis know.

✨ Please start on your review when you are able, and be sure to complete your review in the next six weeks, at the very latest ✨

Review checklist for @TomDonoghue

Conflict of interest

• [x] As the reviewer I confirm that I have read the JOSE conflict of interest policy and that there are no conflicts of interest for me to review this work.

Code of Conduct

• [x] I confirm that I read and will adhere to the JOSE code of conduct.

General checks

• [x] Repository: Is the source for this learning module available at the repository url?
• [x] License: Does the repository contain a plain-text LICENSE file with the contents of a standard license? (OSI-approved for code, Creative Commons for content)
• [x] Version: v2.1.2
• [x] Authorship: Has the submitting author (@valdanchev) made visible contributions to the module? Does the full list of authors seem appropriate and complete?

Documentation

• [x] A statement of need: Do the authors clearly state the need for this module and who the target audience is?
• [x] Installation instructions: Is there a clearly stated list of dependencies?
• [x] Usage: Does the documentation explain how someone would adopt the module, and include examples of how to use it?
• [x] Community guidelines: Are there clear guidelines for third parties wishing to 1) Contribute to the module 2) Report issues or problems with the module 3) Seek support

Pedagogy / Instructional design (Work-in-progress: reviewers, please comment!)

• [x] Learning objectives: Does the module make the learning objectives plainly clear? (We don't require explicitly written learning objectives; only that they be evident from content and design.)
• [x] Content scope and length: Is the content substantial for learning a given topic? Is the length of the module appropriate?
• [x] Pedagogy: Does the module seem easy to follow? Does it observe guidance on cognitive load? (working memory limits of 7 +/- 2 chunks of information)
• [x] Content quality: Is the writing of good quality, concise, engaging? Are the code components well crafted? Does the module seem complete?
• [x] Instructional design: Is the instructional design deliberate and apparent? For example, exploit worked-example effects; effective multi-media use; low extraneous cognitive load.

JOSE paper

• [x] Authors: Does the paper.md file include a list of authors with their affiliations?
• [x] A statement of need: Does the paper clearly state the need for this module and who the target audience is?
• [x] Description: Does the paper describe the learning materials and sequence?
• [x] Does it describe how it has been used in the classroom or other settings, and how someone might adopt it?
• [x] Could someone else teach with this module, given the right expertise?
• [x] Does the paper tell the "story" of how the authors came to develop it, or what their expertise is?
• [x] References: Do all archival references that should have a DOI list one (e.g., papers, datasets, software)?

Review checklist for @lechten

Conflict of interest

• [x] As the reviewer I confirm that I have read the JOSE conflict of interest policy and that there are no conflicts of interest for me to review this work.

Code of Conduct

• [x] I confirm that I read and will adhere to the JOSE code of conduct.

General checks

• [x] Repository: Is the source for this learning module available at the repository url?
• [x] License: Does the repository contain a plain-text LICENSE file with the contents of a standard license? (OSI-approved for code, Creative Commons for content)
• [x] Version: v2.1.2
• [x] Authorship: Has the submitting author (@valdanchev) made visible contributions to the module? Does the full list of authors seem appropriate and complete?

Documentation

• [x] A statement of need: Do the authors clearly state the need for this module and who the target audience is?
• [x] Installation instructions: Is there a clearly stated list of dependencies?
• [x] Usage: Does the documentation explain how someone would adopt the module, and include examples of how to use it?
• [x] Community guidelines: Are there clear guidelines for third parties wishing to 1) Contribute to the module 2) Report issues or problems with the module 3) Seek support

Pedagogy / Instructional design (Work-in-progress: reviewers, please comment!)

• [x] Learning objectives: Does the module make the learning objectives plainly clear? (We don't require explicitly written learning objectives; only that they be evident from content and design.)
• [x] Content scope and length: Is the content substantial for learning a given topic? Is the length of the module appropriate?
• [x] Pedagogy: Does the module seem easy to follow? Does it observe guidance on cognitive load? (working memory limits of 7 +/- 2 chunks of information)
• [x] Content quality: Is the writing of good quality, concise, engaging? Are the code components well crafted? Does the module seem complete?
• [x] Instructional design: Is the instructional design deliberate and apparent? For example, exploit worked-example effects; effective multi-media use; low extraneous cognitive load.

JOSE paper

• [x] Authors: Does the paper.md file include a list of authors with their affiliations?
• [x] A statement of need: Does the paper clearly state the need for this module and who the target audience is?
• [x] Description: Does the paper describe the learning materials and sequence?
• [x] Does it describe how it has been used in the classroom or other settings, and how someone might adopt it?
• [x] Could someone else teach with this module, given the right expertise?
• [x] Does the paper tell the "story" of how the authors came to develop it, or what their expertise is?
• [x] References: Do all archival references that should have a DOI list one (e.g., papers, datasets, software)?

[whedon]

Hello human, I'm @whedon, a robot that can help you with some common editorial tasks. @TomDonoghue it looks like you're currently assigned to review this paper :tada:.

:warning: JOSS reduced service mode :warning:

Due to the challenges of the COVID-19 pandemic, JOSS is currently operating in a "reduced service mode". You can read more about what that means in our blog post.

:star: Important :star:

If you haven't already, you should seriously consider unsubscribing from GitHub notifications for this (https://github.com/openjournals/jose-reviews) repository. As a reviewer, you're probably currently watching this repository which means for GitHub's default behaviour you will receive notifications (emails) for all reviews 😿

To fix this do the following two things:

1. Set yourself as 'Not watching' https://github.com/openjournals/jose-reviews:

2. You may also like to change your default settings for this watching repositories in your GitHub profile here: https://github.com/settings/notifications

For a list of things I can do to help you, just type:

@whedon commands

For example, to regenerate the paper pdf after making changes in the paper's md or bib files, type:

@whedon generate pdf

[whedon]

Wordcount for paper.md is 1603

[whedon]

Software report (experimental):

github.com/AlDanial/cloc v 1.88  T=1.30 s (88.3 files/s, 108947.1 lines/s)
-------------------------------------------------------------------------------
Language                     files          blank        comment           code
-------------------------------------------------------------------------------
HTML                            22           1735            128          37365
SVG                              6              0             13           9323
JavaScript                      16           2342           2391           8757
Jupyter Notebook                32              0          71448           2037
Python                          13           1433            546           1963
CSS                             14            237             96           1321
Markdown                         7             82              0            251
TeX                              2             23              0            238
YAML                             2             16             16             52
JSON                             1              0              0              1
-------------------------------------------------------------------------------
SUM:                           115           5868          74638          61308
-------------------------------------------------------------------------------

Statistical information for the repository '75c25ff7f7e841b795a1a850' was
gathered on 2022/01/12.
The following historical commit information, by author, was found:

Author                     Commits    Insertions      Deletions    % of changes
valdanchev                       5         17466             34          100.00

Below are the number of rows from each author that have survived and are still
intact in the current revision:

Author                     Rows      Stability          Age       % in comments
Valentin Danchev          17432          100.0          0.0               16.85

[whedon]

:point_right::page_facing_up: Download article proof :page_facing_up: View article proof on GitHub :page_facing_up: :point_left:

[whedon]

Reference check summary (note 'MISSING' DOIs are suggestions that need verification):

OK DOIs

- 10.1162/99608f92.cb0fa8d2 is OK
- 10.17226/25104 is OK
- 10.1145/3408877.3432586 is OK
- 10.1371/journal.pcbi.1008770 is OK
- 10.1080/09332480.2019.1579578 is OK
- 10.21105/joss.03021 is OK
- 10.18148/srm/2020.v14i2.7746 is OK
- 10.1371/journal.pcbi.1007007 is OK

MISSING DOIs

- 10.1038/d41586-018-07196-1 may be a valid DOI for title: Why Jupyter is data scientists’ computational notebook of choice
- 10.25080/majora-92bf1922-00a may be a valid DOI for title: Data Structures for Statistical Computing in Python
- 10.25080/majora-92bf1922-011 may be a valid DOI for title: statsmodels: Econometric and statistical modeling with python

INVALID DOIs

- None

[TomDonoghue]

I've worked through my review, including exploring through the content, and checking I can run some examples through Binder etc. As a note I did skim the notebooks, and read sections, but I did do a full read of the content. I've checked off most things above, with the remainer being left open for small potential updates detailed here.

I have some practical suggestions, that I have described in detail on the resource repository, including:

• a suggestion to organize and more explicitly order the content
• some minor formatting and content notes for the notebooks

Other notes:

• In terms of requirements, I think there is an implicit dependency whereby some notebooks only work on Collab (not Binder), because they load the google module. This is captured in this pre-existing issue. I don't think this is a huge issue, per se, but I think some notes in the notebooks about this kind of extra dependency (what works where and/or what would need to be installed) could be added somewhere.
• There is not a version identifier that I found, though I admit I'm not entirely sure how versions are supposed to work for this kind of resource
• Though it's perhaps implicit, for Community Guidelines, an explicit note in the README, and/or textbook landing page about what to do to make a suggestion / report a problem (open an issue, presumably) might be useful, especially for students who might not be clear on standard Github practices.

In terms of the literal content - I don't have as much to say. Based on skimming it all, I think all the content (ideas and concepts) look good to me. It's a bit tricky for me to know exactly how an unfamiliar student would feel about the progression through things. My sense is perhaps that there is a lot introduced quite quickly, and one might need a bit of a sense of basic coding to really be able to jump in - but under the idea of it as a "crash course", I think it broadly works, and is a useful resource to have available.

My one more practical content note is that I think the end_to_end_data_science_project, which in particular feels like jumping in the deep end, could be more explicit that it skims through topics as an introduction (it effectively overviews the course), and that these topics are dealt with in more detail in future notebooks, and that it might make sense for students "jump ahead" to practice these topics there first (at first I even thought maybe this notebook was supposed to come at the end?).

Overall, I think this looks like an interesting resource, with it's strengths being that it:

• introduces a lot of topics in data science, with a focus on practical elements (working with data, reproducibility, ethics, etc)
• has a lot of links to other resources to map out other places to learn things
• uses some real data to demonstrate these things in practice, and is re-runnable by students
• is focused at a particular area / group of students (social science / sociology) for whom there be fewer dedicated materials

Conclusion: I think if the relatively minor notes I've mentioned can be fixed up a bit, my overall impression is that this is a useful resource, responsive to JOSE's aims and requirements, and after the review edits I'd be happy to sign off on it as a reviewer.

[whedon]

:wave: @TomDonoghue, please update us on how your review is going (this is an automated reminder).

[valdanchev]

Thank you so much for these very helpful comments @TomDonoghue. Will go through all of your notes and issues and will write back when I have a revised version that addresses them.

[lechten]

I agree with all points raised by @TomDonoghue above. In summary, this is a valuable and ambitious course/resource.

I’d like to emphasize that I also believe the first notebook to need more descriptions: How might this be presented to students? What is expected of them? What should they be able to do?

For other comments, I opened issues in the source repository.

[valdanchev]

Thanks so much, @lechten for your very helpful comments and suggestions for improvements. The pointer to nbqa is extremely useful. My teaching-heavy term will be over in a few weeks, and I am looking forward to then revising the resource based on your and @TomDonoghue comments.

[ShanEllis]

Thanks to both reviewers!

@valdanchev Just checking in on your current expected timeline? (I totally understand the chaos that is the end of teaching-heavy terms...so not rushing just wanted to get a possible timeline established.)

[valdanchev]

Totally understand @ShanEllis, I'll plan to finalise all the revisions by the end of April if that sounds good.

[valdanchev]

@ShanEllis thank you for organising the review process, @TomDonoghue and @lechten thank you for your very helpful and constructive feedback and suggestions. The review process was very valuable for improving the resource, repository, and paper. Sorry for my delayed revisions.

I have now made the revisions and addressed all the feedback and comments above as well as the issues #5, #6, #7, #8, #9, #10. Specifically,

• In relation to code quality #8 and code formating #5:
  • The code now conforms to PEP 8 by running automated code formatters Black and flake8 on Jupyter through nbQA, following very helpful recommendations in #8.
  • Added a section entitled Readability of your Python code in which PEP 8 style guide for Python code is introduced and key relevant recommendations for writing a readable Python code are outlined, including (i) naming conventions, (ii) maximum line length, (iii) indentation, (iv) tabs or spaces?, (v) whitespace in expressions and statements.
  • Added also a new section on code reusability named Code reuse: creating your own functions, related to #8.
• In relation to content #5, added the following sections in the notebook Python for Data Analysis on the Cloud:
  • Running Terminal commands in Jupyter/Colab notebook
  • Installing packages with pip
  • Jupyter magic commands
• Regarding the structure of the resource GitHub repository, following the very helpful suggestions #6, the files are now reorganised and ordered in a more structured and intuitive manner:
  • different types of content are now assigned to sub-folders notebooks/, images/, data/, paper/;
  • notebooks are sorted in ascending order;
  • unused/unnecessary files are deleted.
• To address issues #9 and #6, the role of the resource website, GitHub, MyBinder, and Colab are now clarified and differentiated in:
  • the JOSE paper
  • the learning resource website, section How to get the most of the open learning resource?
  • the README in the resource repository
  • Also, links to notebooks on GitHub, MyBidner, and Colab are provided in a table on the resource website and in the README.
• Added a release version identifier.
• Added notes in the resource and the repository README file addressing dependencies issues, as noted in comment above and in a pre-existing issue.
• Regarding Community Guidelines, the README includes now a note about how to contribute to the resource, create an issue etc.
• The first notebook End-to-End Data Science Project includes a note describing the purpose of the notebook and what is expected by the learners, as suggested by @TomDonoghue here and by @lechten here.

I've shortened the title of the resource to "Reproducible Data Science with Python" and would like to also shorten the title of the paper to "Reproducible Data Science with Python: An open learning resource".

Thank you again for the very constructive and transparent review process and feedback.

[lechten]

@whedon generate pdf

[whedon]

PDF failed to compile for issue #156 with the following error:

 pandoc: paper.bib: openBinaryFile: does not exist (No such file or directory)
Looks like we failed to compile the PDF

[lechten]

@whedon commands

[whedon]

Here are some things you can ask me to do:

# List Whedon's capabilities
@whedon commands

# List of editor GitHub usernames
@whedon list editors

# List of reviewers together with programming language preferences and domain expertise
@whedon list reviewers

EDITORIAL TASKS

# Compile the paper
@whedon generate pdf

# Compile the paper from alternative branch
@whedon generate pdf from branch custom-branch-name

# Ask Whedon to check the references for missing DOIs
@whedon check references

# Ask Whedon to check repository statistics for the submitted software
@whedon check repository

[lechten]

@whedon generate pdf

[whedon]

PDF failed to compile for issue #156 with the following error:

 /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:456:in `parse': (da632d62dda40da88c8646e4/paper/paper.md): mapping values are not allowed in this context at line 2 column 45 (Psych::SyntaxError)
    from /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:456:in `parse_stream'
    from /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:390:in `parse'
    from /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:277:in `load'
    from /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:578:in `block in load_file'
    from /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:577:in `open'
    from /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:577:in `load_file'
    from /app/vendor/bundle/ruby/2.6.0/bundler/gems/whedon-c5c16aedb3d6/lib/whedon.rb:127:in `load_yaml'
    from /app/vendor/bundle/ruby/2.6.0/bundler/gems/whedon-c5c16aedb3d6/lib/whedon.rb:87:in `initialize'
    from /app/vendor/bundle/ruby/2.6.0/bundler/gems/whedon-c5c16aedb3d6/lib/whedon/processor.rb:38:in `new'
    from /app/vendor/bundle/ruby/2.6.0/bundler/gems/whedon-c5c16aedb3d6/lib/whedon/processor.rb:38:in `set_paper'
    from /app/vendor/bundle/ruby/2.6.0/bundler/gems/whedon-c5c16aedb3d6/bin/whedon:66:in `prepare'
    from /app/vendor/bundle/ruby/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:in `run'
    from /app/vendor/bundle/ruby/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:in `invoke_command'
    from /app/vendor/bundle/ruby/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:in `dispatch'
    from /app/vendor/bundle/ruby/2.6.0/gems/thor-0.20.3/lib/thor/base.rb:466:in `start'
    from /app/vendor/bundle/ruby/2.6.0/bundler/gems/whedon-c5c16aedb3d6/bin/whedon:131:in `<top (required)>'
    from /app/vendor/bundle/ruby/2.6.0/bin/whedon:23:in `load'
    from /app/vendor/bundle/ruby/2.6.0/bin/whedon:23:in `<main>'

[valdanchev]

@whedon generate pdf

[lechten]

@whedon generate pdf

[lechten]

@ShanEllis Whedon does not seem to work any more. Are you able to generate a new PDF?

[TomDonoghue]

I have checked through the updates to the resource and everything looks good to me! I have checked of my remaining review items, and as far as I'm concerned, this is good to go!

Quick note: as things get wrapped up, I think the version number that is listed in this issue (1.0.0) needs to be updated to reflect the version number listed in the most recent release (I think there is a whedon command to do this).

[valdanchev]

@whedon set v2.0.0 as version

[whedon]

I'm sorry @valdanchev, I'm afraid I can't do that. That's something only editors are allowed to do.

[valdanchev]

Many thanks, @TomDonoghue. On the version number, it seems that only editors can do the update. @ShanEllis will know best how to update the version number.

[lechten]

@whedon generate pdf

[ShanEllis]

Sorry y'all! Recently had a baby and am just super behind on things. Just wanted to reply here to say that I'm looking into what's going on re: PDF generation (after which I can update the version).

Will update/tag others as there's progress!

[ShanEllis]

@valdanchev I'm not 100% sure, but I believe the PDF won't compile due to YAML formatting issues at the top of paper.md. Specifically, for each bullet point entry, it looks to me like a space is missing before each dash (-).

Sharing a link to a random accepted paper whose YAML formatting looks right to me in case helpful: https://raw.githubusercontent.com/americocunhajr/EPIDEMIC/master/paper/paper.md

Mind making these edits and trying to recompile PDF? (If this isn't the issue I'll dig deeper.)

[valdanchev]

@whedon generate pdf

[whedon]

PDF failed to compile for issue #156 with the following error:

 /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:456:in `parse': (4d4bd54800247dd4827f3cec/paper/paper.md): did not find expected '-' indicator while parsing a block collection at line 15 column 2 (Psych::SyntaxError)
    from /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:456:in `parse_stream'
    from /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:390:in `parse'
    from /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:277:in `load'
    from /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:578:in `block in load_file'
    from /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:577:in `open'
    from /app/vendor/ruby-2.6.6/lib/ruby/2.6.0/psych.rb:577:in `load_file'
    from /app/vendor/bundle/ruby/2.6.0/bundler/gems/whedon-c5c16aedb3d6/lib/whedon.rb:127:in `load_yaml'
    from /app/vendor/bundle/ruby/2.6.0/bundler/gems/whedon-c5c16aedb3d6/lib/whedon.rb:87:in `initialize'
    from /app/vendor/bundle/ruby/2.6.0/bundler/gems/whedon-c5c16aedb3d6/lib/whedon/processor.rb:38:in `new'
    from /app/vendor/bundle/ruby/2.6.0/bundler/gems/whedon-c5c16aedb3d6/lib/whedon/processor.rb:38:in `set_paper'
    from /app/vendor/bundle/ruby/2.6.0/bundler/gems/whedon-c5c16aedb3d6/bin/whedon:66:in `prepare'
    from /app/vendor/bundle/ruby/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:in `run'
    from /app/vendor/bundle/ruby/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:in `invoke_command'
    from /app/vendor/bundle/ruby/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:in `dispatch'
    from /app/vendor/bundle/ruby/2.6.0/gems/thor-0.20.3/lib/thor/base.rb:466:in `start'
    from /app/vendor/bundle/ruby/2.6.0/bundler/gems/whedon-c5c16aedb3d6/bin/whedon:131:in `<top (required)>'
    from /app/vendor/bundle/ruby/2.6.0/bin/whedon:23:in `load'
    from /app/vendor/bundle/ruby/2.6.0/bin/whedon:23:in `<main>'

[valdanchev]

@whedon generate pdf

[ShanEllis]

I see that it's still not generating....but also not throwing an error. Pinging people who know the system better than I to see what's going on/how to fix.

[ShanEllis]

@whedon generate pdf

[labarba]

@openjournals/dev – S.O.S. We're stumped with a paper compilation error here. Can you help?

[arfon]

This is probably because you have three paper.md files in your repo, and @whedon will just pick the first by default:

1. tmp/156/_build/html/_sources/JOSE_paper/paper.md
2. tmp/156/_build/html/_sources/paper/paper.md
3. tmp/156/paper/paper.md

The third one (at tmp/156/paper/paper.md) seems to compile fine. I would suggest either removing or renaming the first two (to not be called paper.md).

[valdanchev]

@whedon generate pdf

[whedon]

:point_right::page_facing_up: Download article proof :page_facing_up: View article proof on GitHub :page_facing_up: :point_left:

[valdanchev]

Thanks a million, @arfon. That was the problem indeed; removed the unnecessary files and the file compiles now.

[valdanchev]

@whedon generate pdf

[whedon]

:point_right::page_facing_up: Download article proof :page_facing_up: View article proof on GitHub :page_facing_up: :point_left:

[lechten]

Given the new PDF, I just closed my final issue at the source repository. I vote to accept this paper.

[ShanEllis]

@whedon set v2.0.0 as version

[whedon]

OK. v2.0.0 is the version.

[ShanEllis]

Just did a final read-through of the manuscript and a review of all the issues that have been resolved. Would like to thank @TomDonoghue and @lechten for their careful review of this manuscript and @valdanchev for being so responsive to their feedback.

(And, thanks for hanging in there with me as I've been a tad slower getting back to things here than I typically would be.)

[ShanEllis]

@whendon recommend-accept

[valdanchev]

Thank you @ShanEllis, @TomDonoghue, and @lechten for the very constructive and helpful review process!

[ShanEllis]

@whedon recommend-accept

[whedon]

No archive DOI set. Exiting...

[labarba]

@valdanchev — As this review is finalized, please make an archive of the target repository on Zenodo, and report the archive DOI here. We request that authors edit the metadata of the Zenodo deposit so title and author list match the JOSE paper.