[PRE REVIEW]: madupite: A High-Performance Distributed Solver for Large-Scale Markov Decision Processes

[editorialbot]

Submitting author: !--author-handle-->@gmatilde<!--end-author-handle-- (Matilde Gargiani) Repository: https://github.com/madupite/madupite Branch with paper.md (empty if default branch): Version: v1.0.0 Editor: Pending Reviewers: Pending Managing EiC: Daniel S. Katz

Status

Status badge code:

HTML: <a href="https://joss.theoj.org/papers/b7796be0782d9feb0bf5fb3bc37bc7e4"><img src="https://joss.theoj.org/papers/b7796be0782d9feb0bf5fb3bc37bc7e4/status.svg"></a>
Markdown: [![status](https://joss.theoj.org/papers/b7796be0782d9feb0bf5fb3bc37bc7e4/status.svg)](https://joss.theoj.org/papers/b7796be0782d9feb0bf5fb3bc37bc7e4)

Author instructions

Thanks for submitting your paper to JOSS @gmatilde. Currently, there isn't a JOSS editor assigned to your paper.

@gmatilde if you have any suggestions for potential reviewers then please mention them here in this thread (without tagging them with an @). You can search the list of people that have already agreed to review and may be suitable for this submission.

Editor instructions

The JOSS submission bot @editorialbot is here to help you find and assign reviewers and start the main review. To find out what @editorialbot can do for you type:

@editorialbot commands

[editorialbot]

Hello human, I'm @editorialbot, a robot that can help you with some common editorial tasks.

For a list of things I can do to help you, just type:

@editorialbot commands

For example, to regenerate the paper pdf after making changes in the paper's md or bib files, type:

@editorialbot generate pdf

[editorialbot]

Reference check summary (note 'MISSING' DOIs are suggestions that need verification):

✅ OK DOIs

- 10.5281/zenodo.11844058 is OK
- 10.1111/ecog.00888 is OK
- 10.1287/inte.15.6.73 is OK
- 10.1016/j.ifacol.2016.07.012 is OK
- 10.2172/2205494 is OK
- 10.1016/j.parco.2021.102831 is OK
- 10.1007/s10107-014-0783-z is OK
- 10.1109/LCSYS.2022.3181213 is OK

🟡 SKIP DOIs

- No DOI given, and none found for title: Inexact Policy Iteration Methods for Large-Scale M...
- No DOI given, and none found for title: Markov decision processes with applications to fin...
- No DOI given, and none found for title: Handbook of Markov Decision Processes: Methods and...
- No DOI given, and none found for title: PETSc Web page
- No DOI given, and none found for title: nanobind: tiny and efficient C++/Python bindings
- No DOI given, and none found for title: Dynamic Programming and Optimal Control, Vol. II
- No DOI given, and none found for title: Dynamic Programming
- No DOI given, and none found for title: Reinforcement Learning: An Introduction

❌ MISSING DOIs

- 10.1016/j.ifacol.2023.10.316 may be a valid DOI for title: Inexact GMRES Policy Iteration for Large-Scale Mar...
- 10.1109/tac.2023.3270060 may be a valid DOI for title: Parallel and Flexible Dynamic Programming via the ...
- 10.1007/978-3-319-47766-4_6 may be a valid DOI for title: Markov Decision Processes for Screening and Treatm...
- 10.1007/978-1-4612-1986-6_8 may be a valid DOI for title: Efficient Management of Parallelism in Object Orie...

❌ INVALID DOIs

- None

[editorialbot]

Software report:

github.com/AlDanial/cloc v 1.90  T=0.05 s (1137.0 files/s, 301559.6 lines/s)
-------------------------------------------------------------------------------
Language                     files          blank        comment           code
-------------------------------------------------------------------------------
SVG                              2              0             39           9447
C++                             11            300            113           1417
Python                          14            300            125            898
C/C++ Header                     8            157            123            554
Jupyter Notebook                 3              0            657            379
reStructuredText                 8            305            397            216
TeX                              1              0              0            180
CMake                            1             26             18            122
YAML                             4             10             13            122
Markdown                         3             40              0            116
DOS Batch                        1              8              1             26
TOML                             1              3              0             23
make                             1              4              7              9
Bourne Shell                     3              6             11              7
-------------------------------------------------------------------------------
SUM:                            61           1159           1504          13516
-------------------------------------------------------------------------------

Commit count by author:

   148  Robin Sieber
   125  Robin
    79  Philip Pawlowsky
    64  Vaclav Hapla
    44  gmatilde
     6  vhapla
     5  ppawlowsky
     4  philippawlowsky
     2  Matilde Gargiani

[editorialbot]

Paper file info:

📄 Wordcount for paper.md is 1253

✅ The paper includes a Statement of need section

[editorialbot]

License info:

✅ License found: MIT License (Valid open source OSI approved license)

[editorialbot]

:point_right::page_facing_up: Download article proof :page_facing_up: View article proof on GitHub :page_facing_up: :point_left:

[editorialbot]

Five most similar historical JOSS papers:

PyBADS: Fast and robust black-box optimization in Python Submitting author: @GurjeetSinghSangra Handling editor: @rkurchin (Active) Reviewers: @jungtaekkim, @vankesteren Similarity score: 0.7104

pyOptSparse: A Python framework for large-scale constrained nonlinear optimization of sparse systems Submitting author: @nwu63 Handling editor: @poulson (Retired) Reviewers: @jgoldfar, @vissarion, @matbesancon Similarity score: 0.7063

Pakman: a modular, efficient and portable tool for approximate Bayesian inference Submitting author: @ThomasPak Handling editor: @jedbrown (Active) Reviewers: @jmlarson1, @gonsie Similarity score: 0.7061

PySD: System Dynamics Modeling in Python Submitting author: @rogersamso Handling editor: @pdebuyl (Active) Reviewers: @blsqr, @sixpearls Similarity score: 0.6982

pymdp: A Python library for active inference in discrete state spaces Submitting author: @conorheins Handling editor: @emdupre (Active) Reviewers: @seankmartin, @patrickmineault Similarity score: 0.6966

⚠️ Note to editors: If these papers look like they might be a good match, click through to the review issue for that paper and invite one or more of the authors before considering asking the reviewers of these papers to review again for JOSS.

[danielskatz]

👋 @gmatilde - thanks for your submission.

While I look for an editor, you could work on the possibly missing DOIs that editorialbot suggests, but note that some may be incorrect. Please feel free to make changes to your .bib file, then use the command @editorialbot check references to check again, and the command @editorialbot generate pdf when the references are right to make a new PDF. editorialbot commands need to be the first entry in a new comment.

[danielskatz]

👋 @faroit - would you be able to edit this JOSS submission?

[danielskatz]

@editorialbot invite @faroit as editor

[editorialbot]

Invitation to edit this submission sent!