[PRE REVIEW]: Recommendation.jl: A Framework for Building Recommender Systems in Julia

[whedon]

Submitting author: !--author-handle-->@takuti<!--end-author-handle-- (Takuya Kitazawa) Repository: https://github.com/takuti/Recommendation.jl Branch with paper.md (empty if default branch): Version: Editor: !--editor-->@lucaferranti<!--end-editor-- Reviewers: @lucaferranti, @abhijithch, @pgimenez Managing EiC: Valentin Churavy

Author instructions

Thanks for submitting your paper to JCON @takuti. Currently, there isn't an JCON editor assigned to your paper.

The author's suggestion for the handling editor is @carstenbauer.

@takuti if you have any suggestions for potential reviewers then please mention them here in this thread (without tagging them with an @). In addition, this list of people have already agreed to review for JCON and may be suitable for this submission (please start at the bottom of the list).

Editor instructions

The JCON submission bot @whedon is here to help you find and assign reviewers and start the main review. To find out what @whedon can do for you type:

@whedon commands

[whedon]

Hello human, I'm @whedon, a robot that can help you with some common editorial tasks.

:warning: JOSS reduced service mode :warning:

Due to the challenges of the COVID-19 pandemic, JOSS is currently operating in a "reduced service mode". You can read more about what that means in our blog post.

For a list of things I can do to help you, just type:

@whedon commands

For example, to regenerate the paper pdf after making changes in the paper's md or bib files, type:

@whedon generate pdf

[whedon]

PDF failed to compile for issue #119 with the following error:

 Latexmk: This is Latexmk, John Collins, 17 Jan. 2018, version: 4.55.
Rule 'pdflatex': Rules & subrules not known to be previously run:
   pdflatex
Rule 'pdflatex': The following rules & subrules became out-of-date:
      'pdflatex'
------------
Run number 1 of rule 'pdflatex'
------------
------------
Running 'pdflatex  -recorder  "paper.tex"'
------------
===========Latexmk: Missing input file: 'enumitem.sty' from line
  '! LaTeX Error: File `enumitem.sty' not found.'
Latexmk: Missing input file: 'enumitem.sty' from line
  '! LaTeX Error: File `enumitem.sty' not found.'
Failure to make 'paper.pdf'
Collected error summary (may duplicate other messages):
  pdflatex: Command for 'pdflatex' gave return code 1
      Refer to 'paper.log' for details
Looks like we failed to compile the PDF

[whedon]

Failed to discover a Statement of need section in paper

[whedon]

Wordcount for paper.tex is 146

[whedon]

Software report (experimental):

github.com/AlDanial/cloc v 1.88  T=0.08 s (1165.2 files/s, 102258.8 lines/s)
-------------------------------------------------------------------------------
Language                     files          blank        comment           code
-------------------------------------------------------------------------------
TeX                             14            399            178           2938
Julia                           55            645            120           2805
Markdown                        12            144              0            303
YAML                             3              0              0             96
Ruby                             1              8              4             45
TOML                             2              5              0             23
make                             1              3              0              7
-------------------------------------------------------------------------------
SUM:                            88           1204            302           6217
-------------------------------------------------------------------------------

Statistical information for the repository '0ffdc87fc8d681b1b44375e0' was
gathered on 2022/12/12.
The following historical commit information, by author, was found:

Author                     Commits    Insertions      Deletions    % of changes
Takuya Kitazawa                  1            57              0          100.00

Below are the number of rows from each author that have survived and are still
intact in the current revision:

Author                     Rows      Stability          Age       % in comments
Takuya Kitazawa              57          100.0          0.0                7.02

[carstenbauer]

@whedon assign @ranjanan as editor

[whedon]

OK, the editor is @ranjanan

[ranjanan]

@whedon generate pdf

[whedon]

PDF failed to compile for issue #119 with the following error:

 Latexmk: This is Latexmk, John Collins, 17 Jan. 2018, version: 4.55.
Rule 'pdflatex': Rules & subrules not known to be previously run:
   pdflatex
Rule 'pdflatex': The following rules & subrules became out-of-date:
      'pdflatex'
------------
Run number 1 of rule 'pdflatex'
------------
------------
Running 'pdflatex  -recorder  "paper.tex"'
------------
===========Latexmk: Missing input file: 'enumitem.sty' from line
  '! LaTeX Error: File `enumitem.sty' not found.'
Latexmk: Missing input file: 'enumitem.sty' from line
  '! LaTeX Error: File `enumitem.sty' not found.'
Failure to make 'paper.pdf'
Collected error summary (may duplicate other messages):
  pdflatex: Command for 'pdflatex' gave return code 1
      Refer to 'paper.log' for details
Looks like we failed to compile the PDF

[ranjanan]

@takuti could you fix the above error please?

[takuti]

@whedon commands

[whedon]

Here are some things you can ask me to do:

# List Whedon's capabilities
@whedon commands

# List of editor GitHub usernames
@whedon list editors

# List of reviewers together with programming language preferences and domain expertise
@whedon list reviewers

EDITORIAL TASKS

# Compile the paper
@whedon generate pdf

# Compile the paper from alternative branch
@whedon generate pdf from branch custom-branch-name

# Ask Whedon to check the references for missing DOIs
@whedon check references

# Ask Whedon to check repository statistics for the submitted software
@whedon check repository

[takuti]

@whedon generate pdf from branch paper-fix

[whedon]

Attempting PDF compilation from custom branch paper-fix. Reticulating splines etc...

[whedon]

PDF failed to compile for issue #119 with the following error:

 Latexmk: This is Latexmk, John Collins, 17 Jan. 2018, version: 4.55.
Rule 'pdflatex': Rules & subrules not known to be previously run:
   pdflatex
Rule 'pdflatex': The following rules & subrules became out-of-date:
      'pdflatex'
------------
Run number 1 of rule 'pdflatex'
------------
------------
Running 'pdflatex  -recorder  "paper.tex"'
------------
===========Latexmk: Missing input file: 'dsfont.sty' from line
  '! LaTeX Error: File `dsfont.sty' not found.'
Latexmk: Missing input file: 'dsfont.sty' from line
  '! LaTeX Error: File `dsfont.sty' not found.'
Failure to make 'paper.pdf'
Collected error summary (may duplicate other messages):
  pdflatex: Command for 'pdflatex' gave return code 1
      Refer to 'paper.log' for details
Looks like we failed to compile the PDF

[takuti]

@whedon generate pdf from branch paper-fix

[whedon]

Attempting PDF compilation from custom branch paper-fix. Reticulating splines etc...

[whedon]

PDF failed to compile for issue #119 with the following error:

 Latexmk: This is Latexmk, John Collins, 17 Jan. 2018, version: 4.55.
Rule 'pdflatex': Rules & subrules not known to be previously run:
   pdflatex
Rule 'pdflatex': The following rules & subrules became out-of-date:
      'pdflatex'
------------
Run number 1 of rule 'pdflatex'
------------
------------
Running 'pdflatex  -recorder  "paper.tex"'
------------
===========Latexmk: Missing input file: 'mathtools.sty' from line
  '! LaTeX Error: File `mathtools.sty' not found.'
Latexmk: Missing input file: 'mathtools.sty' from line
  '! LaTeX Error: File `mathtools.sty' not found.'
Failure to make 'paper.pdf'
Collected error summary (may duplicate other messages):
  pdflatex: Command for 'pdflatex' gave return code 1
      Refer to 'paper.log' for details
Looks like we failed to compile the PDF

[takuti]

@whedon generate pdf from branch paper-fix

[whedon]

Attempting PDF compilation from custom branch paper-fix. Reticulating splines etc...

[whedon]

PDF failed to compile for issue #119 with the following error:

 Latexmk: This is Latexmk, John Collins, 17 Jan. 2018, version: 4.55.
Rule 'pdflatex': Rules & subrules not known to be previously run:
   pdflatex
Rule 'pdflatex': The following rules & subrules became out-of-date:
      'pdflatex'
------------
Run number 1 of rule 'pdflatex'
------------
------------
Running 'pdflatex  -recorder  "paper.tex"'
------------
===========Latexmk: Missing input file: 'mhsetup.sty' from line
  '! LaTeX Error: File `mhsetup.sty' not found.'
Latexmk: Missing input file: 'mhsetup.sty' from line
  '! LaTeX Error: File `mhsetup.sty' not found.'
Failure to make 'paper.pdf'
Collected error summary (may duplicate other messages):
  pdflatex: Command for 'pdflatex' gave return code 1
      Refer to 'paper.log' for details
Looks like we failed to compile the PDF

[takuti]

@whedon generate pdf from branch paper-fix

[whedon]

Attempting PDF compilation from custom branch paper-fix. Reticulating splines etc...

[whedon]

PDF failed to compile for issue #119 with the following error:

 Latexmk: This is Latexmk, John Collins, 17 Jan. 2018, version: 4.55.
Rule 'pdflatex': Rules & subrules not known to be previously run:
   pdflatex
Rule 'pdflatex': The following rules & subrules became out-of-date:
      'pdflatex'
------------
Run number 1 of rule 'pdflatex'
------------
------------
Running 'pdflatex  -recorder  "paper.tex"'
------------
===========Latexmk: Missing input file: 'blkarray.sty' from line
  '! LaTeX Error: File `blkarray.sty' not found.'
Latexmk: Missing input file: 'blkarray.sty' from line
  '! LaTeX Error: File `blkarray.sty' not found.'
Failure to make 'paper.pdf'
Collected error summary (may duplicate other messages):
  pdflatex: Command for 'pdflatex' gave return code 1
      Refer to 'paper.log' for details
Looks like we failed to compile the PDF

[takuti]

@whedon generate pdf from branch paper-fix

[whedon]

Attempting PDF compilation from custom branch paper-fix. Reticulating splines etc...

[whedon]

PDF failed to compile for issue #119 with the following error:

 Latexmk: This is Latexmk, John Collins, 17 Jan. 2018, version: 4.55.
Rule 'pdflatex': Rules & subrules not known to be previously run:
   pdflatex
Rule 'pdflatex': The following rules & subrules became out-of-date:
      'pdflatex'
------------
Run number 1 of rule 'pdflatex'
------------
------------
Running 'pdflatex  -recorder  "paper.tex"'
------------
===========Latexmk: Missing input file: 'bigstrut.sty' from line
  '! LaTeX Error: File `bigstrut.sty' not found.'
Latexmk: Missing input file: 'bigstrut.sty' from line
  '! LaTeX Error: File `bigstrut.sty' not found.'
Failure to make 'paper.pdf'
Collected error summary (may duplicate other messages):
  pdflatex: Command for 'pdflatex' gave return code 1
      Refer to 'paper.log' for details
Looks like we failed to compile the PDF

[takuti]

@whedon generate pdf from branch paper-fix

[whedon]

Attempting PDF compilation from custom branch paper-fix. Reticulating splines etc...

[whedon]

:point_right::page_facing_up: Download article proof :page_facing_up: View article proof on GitHub :page_facing_up: :point_left:

[takuti]

@ranjanan Thank you for working on the matter. I have fixed the errors as shown above. Working PR is https://github.com/takuti/Recommendation.jl/pull/66 on the paper-fix branch - let me know if I should merge the branch or I can keep working on it throughout the review process.

[ranjanan]

Thank you @takuti. Would you like to recommend anyone to review this?

[takuti]

@ranjanan If possible, I'd like to get some comments from Adrian Salceanu, the author of "Julia Programming Projects" using the Recommendation package, and Abhijith Chandraprabhu who I had a meaningful discussion about the package at JuliaCon 2019.

[takuti]

Hi @ranjanan , just wanted to check-in what's the status of my submission and see an anticipated timeline if any. Thank you.

[matbesancon]

@whedon assign lucaferranti as editor

[lucaferranti]

Hi @takuti :wave: ,

I am very sorry for the long waiting time, we went through some restructuring in the editorial team and now getting back on track with pending reviews.

I will be the editor of this submission and will try my best to have a smooth and pleasurable process.

[lucaferranti]

@whedon generate pdf from branch paper-fix

[whedon]

Attempting PDF compilation from custom branch paper-fix. Reticulating splines etc...

[whedon]

:point_right::page_facing_up: Download article proof :page_facing_up: View article proof on GitHub :page_facing_up: :point_left:

[lucaferranti]

@whedon check references

[whedon]

Reference check summary (note 'MISSING' DOIs are suggestions that need verification):

OK DOIs

- None

MISSING DOIs

- 10.1137/141000671 may be a valid DOI for title:  Julia: A Fresh Approach to Numerical Computing 
- 10.1145/3340531.3412778 may be a valid DOI for title:  LensKit for Python: Next-Generation Software for Recommender Systems Experiments 
- 10.18653/v1/d19-1018 may be a valid DOI for title:  Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained Aspects 
- 10.1145/138859.138867 may be a valid DOI for title:  Using Collaborative Filtering to Weave an Information Tapestry 
- 10.1145/3130348.3130372 may be a valid DOI for title:  An Algorithmic Framework for Performing Collaborative Filtering 
- 10.1007/978-0-387-85820-3_3 may be a valid DOI for title:  Content-Based Recommender Systems: State of the Art and Trends 
- 10.1145/2792838.2796542 may be a valid DOI for title:  Factorization Machines for Hybrid Recommendation Systems Based on Behavioral, Product, and Customer Data 
- 10.1145/2168752.2168771 may be a valid DOI for title:  Factorization Machines with libFM 
- 10.1145/2124295.2124313 may be a valid DOI for title:  Learning Recommender Systems with Adaptive Regularization 
- 10.1007/978-0-387-85820-3_8 may be a valid DOI for title:  Evaluating Recommendation Systems 
- 10.1145/1060745.1060754 may be a valid DOI for title:  Improving Recommendation Lists through Topic Diversification 
- 10.2139/ssrn.3378581 may be a valid DOI for title:  Recommender Systems and Their Ethical Challenges 

INVALID DOIs

- None

[lucaferranti]

@takuti , it seems some references have missing DOIs. While I look for reviewers, you may start filling those if you like. This could speed up the review process a bit later on.

[lucaferranti]

Hi @essenciary :wave: ,

would you be willing to review this JuliaCon submission? You can read more details about JuliaCon proceedings review process here and you are of course welcome to ask me any clarifying questions you may have.

[lucaferranti]

Hi @abhijithch 👋 ,

would you be willing to review this JuliaCon submission? You can read more details about JuliaCon proceedings review process here and you are of course welcome to ask me any clarifying questions you may have.

[takuti]

Thank you @lucaferranti for the update. Noted. I'll address the missing DOI errors in the meantime.

[takuti]

@whedon generate pdf from branch paper-fix

[whedon]

Attempting PDF compilation from custom branch paper-fix. Reticulating splines etc...

[whedon]

PDF failed to compile for issue #119 with the following error:

 Latexmk: This is Latexmk, John Collins, 17 Jan. 2018, version: 4.55.
Rule 'pdflatex': Rules & subrules not known to be previously run:
   pdflatex
Rule 'pdflatex': The following rules & subrules became out-of-date:
      'pdflatex'
------------
Run number 1 of rule 'pdflatex'
------------
------------
Running 'pdflatex  -recorder  "paper.tex"'
------------

kpathsea: Running mktexpk --mfmode / --bdpi 600 --mag 0+525/600 --dpi 525 ectt0800
mktexpk: Running mf-nowin -progname=mf \mode:=ljfour; mag:=0+525/600; nonstopmode; input ectt0800
This is METAFONT, Version 2.7182818 (TeX Live 2017) (preloaded base=mf)

(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/ectt0800.mf
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exbase.mf)
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/ectt.mf
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exroman.mf
 Ok (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exaccess.mf
 Ok) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/expseudo.mf
 Ok) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exruwest.mf
 Ok [192] [193] [194] [195] [196] [197] [198] [199] [200] [201] [202] [203]
[204] [205] [206] [207] [208] [209] [210] [211] [212] [213] [214] [215]
[216] [217] [218] [219] [220] [221] [222] [223])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrlwest.mf
 Ok [224] [225] [226] [227] [228] [229] [230] [231] [232] [233] [234] [235]
[236] [237] [238] [239] [240] [241] [242] [243] [244] [245] [246] [247]
[248] [249] [250] [251] [252] [253] [254] [255])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrueast.mf
 Ok [128] [129] [130] [131] [132] [133] [134] [135] [136] [137] [138] [139]
[140] [141] [142] [143] [144] [145] [146] [147] [148] [149] [150] [151]
[152] [153] [154] [155] [156] [157])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrleast.mf
 Ok [158] [160] [161] [162] [163] [164] [165] [166] [167] [168] [169] [170]
[171] [172] [173] [174] [175] [176] [177] [178] [179] [180] [181] [182]
[183] [184] [185] [186] [187] [188])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exbraces.mf
 Ok [94] [126] [23] [40] [41] [60] [124] [62] [91] [93] [92] [123] [125]
[95] [127] [32]) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/expunct.mf
 Ok [14] [15] [19] [20] [13] [18] [33] [39] [42] [43] [44] [46] [47] [58]
[59] [61] [96] [189] [17] [45] [16] [21] [22])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exaccent.mf
 Ok [0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exsign.mf
 Ok [24] [34] [35] [36] [37] [64] [191] [159])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrlig.mf
 Ok [25] [26] [28] [27] [29] [30] [31])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exromp.mf
 Ok [38] [63] [190])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrulett.mf
 Ok [65] [66] [67] [68] [69] [70] [71] [72] [73] [74] [75] [76] [77] [78]
[79] [80] [81] [82] [83] [84] [85] [86] [87] [88] [89] [90])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrllett.mf
 Ok [97] [98] [99] [100] [101] [102] [103] [104] [105] [106] [107] [108]
[109] [110] [111] [112] [113] [114] [115] [116] [117] [118] [119] [120]
[121] [122]) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrdigit.mf
 Ok [48] [49] [50] [51] [52] [53] [54] [55] [56] [57])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exmligtb.mf
 Ok) ) ) )
Font metrics written on ectt0800.tfm.
Output written on ectt0800.525gf (256 characters, 31804 bytes).
Transcript written on ectt0800.log.
mktexpk: /app/.texlive/var/texmf-var/fonts/pk/ljfour/jknappen/ec/ectt0800.525pk: successfully generated.

kpathsea: Running mktexpk --mfmode / --bdpi 600 --mag 1+0/600 --dpi 600 ectt0900
mktexpk: Running mf-nowin -progname=mf \mode:=ljfour; mag:=1+0/600; nonstopmode; input ectt0900
This is METAFONT, Version 2.7182818 (TeX Live 2017) (preloaded base=mf)

(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/ectt0900.mf
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exbase.mf)
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/ectt.mf
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exroman.mf
 Ok (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exaccess.mf
 Ok) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/expseudo.mf
 Ok) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exruwest.mf
 Ok [192] [193] [194] [195] [196] [197] [198] [199] [200] [201] [202] [203]
[204] [205] [206] [207] [208] [209] [210] [211] [212] [213] [214] [215]
[216] [217] [218] [219] [220] [221] [222] [223])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrlwest.mf
 Ok [224] [225] [226] [227] [228] [229] [230] [231] [232] [233] [234] [235]
[236] [237] [238] [239] [240] [241] [242] [243] [244] [245] [246] [247]
[248] [249] [250] [251] [252] [253] [254] [255])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrueast.mf
 Ok [128] [129] [130] [131] [132] [133] [134] [135] [136] [137] [138] [139]
[140] [141] [142] [143] [144] [145] [146] [147] [148] [149] [150] [151]
[152] [153] [154] [155] [156] [157])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrleast.mf
 Ok [158] [160] [161] [162] [163] [164] [165] [166] [167] [168] [169] [170]
[171] [172] [173] [174] [175] [176] [177] [178] [179] [180] [181] [182]
[183] [184] [185] [186] [187] [188])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exbraces.mf
 Ok [94] [126] [23] [40] [41] [60] [124] [62] [91] [93] [92] [123] [125]
[95] [127] [32]) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/expunct.mf
 Ok [14] [15] [19] [20] [13] [18] [33] [39] [42] [43] [44] [46] [47] [58]
[59] [61] [96] [189] [17] [45] [16] [21] [22])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exaccent.mf
 Ok [0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exsign.mf
 Ok [24] [34] [35] [36] [37] [64] [191] [159])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrlig.mf
 Ok [25] [26] [28] [27] [29] [30] [31])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exromp.mf
 Ok [38] [63] [190])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrulett.mf
 Ok [65] [66] [67] [68] [69] [70] [71] [72] [73] [74] [75] [76] [77] [78]
[79] [80] [81] [82] [83] [84] [85] [86] [87] [88] [89] [90])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrllett.mf
 Ok [97] [98] [99] [100] [101] [102] [103] [104] [105] [106] [107] [108]
[109] [110] [111] [112] [113] [114] [115] [116] [117] [118] [119] [120]
[121] [122]) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrdigit.mf
 Ok [48] [49] [50] [51] [52] [53] [54] [55] [56] [57])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exmligtb.mf
 Ok) ) ) )
Font metrics written on ectt0900.tfm.
Output written on ectt0900.600gf (256 characters, 39464 bytes).
Transcript written on ectt0900.log.
mktexpk: /app/.texlive/var/texmf-var/fonts/pk/ljfour/jknappen/ec/ectt0900.600pk: successfully generated.

kpathsea: Running mktexpk --mfmode / --bdpi 600 --mag 1+0/600 --dpi 600 ectt0800
mktexpk: Running mf-nowin -progname=mf \mode:=ljfour; mag:=1+0/600; nonstopmode; input ectt0800
This is METAFONT, Version 2.7182818 (TeX Live 2017) (preloaded base=mf)

(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/ectt0800.mf
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exbase.mf)
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/ectt.mf
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exroman.mf
 Ok (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exaccess.mf
 Ok) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/expseudo.mf
 Ok) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exruwest.mf
 Ok [192] [193] [194] [195] [196] [197] [198] [199] [200] [201] [202] [203]
[204] [205] [206] [207] [208] [209] [210] [211] [212] [213] [214] [215]
[216] [217] [218] [219] [220] [221] [222] [223])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrlwest.mf
 Ok [224] [225] [226] [227] [228] [229] [230] [231] [232] [233] [234] [235]
[236] [237] [238] [239] [240] [241] [242] [243] [244] [245] [246] [247]
[248] [249] [250] [251] [252] [253] [254] [255])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrueast.mf
 Ok [128] [129] [130] [131] [132] [133] [134] [135] [136] [137] [138] [139]
[140] [141] [142] [143] [144] [145] [146] [147] [148] [149] [150] [151]
[152] [153] [154] [155] [156] [157])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrleast.mf
 Ok [158] [160] [161] [162] [163] [164] [165] [166] [167] [168] [169] [170]
[171] [172] [173] [174] [175] [176] [177] [178] [179] [180] [181] [182]
[183] [184] [185] [186] [187] [188])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exbraces.mf
 Ok [94] [126] [23] [40] [41] [60] [124] [62] [91] [93] [92] [123] [125]
[95] [127] [32]) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/expunct.mf
 Ok [14] [15] [19] [20] [13] [18] [33] [39] [42] [43] [44] [46] [47] [58]
[59] [61] [96] [189] [17] [45] [16] [21] [22])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exaccent.mf
 Ok [0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exsign.mf
 Ok [24] [34] [35] [36] [37] [64] [191] [159])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrlig.mf
 Ok [25] [26] [28] [27] [29] [30] [31])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exromp.mf
 Ok [38] [63] [190])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrulett.mf
 Ok [65] [66] [67] [68] [69] [70] [71] [72] [73] [74] [75] [76] [77] [78]
[79] [80] [81] [82] [83] [84] [85] [86] [87] [88] [89] [90])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrllett.mf
 Ok [97] [98] [99] [100] [101] [102] [103] [104] [105] [106] [107] [108]
[109] [110] [111] [112] [113] [114] [115] [116] [117] [118] [119] [120]
[121] [122]) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrdigit.mf
 Ok [48] [49] [50] [51] [52] [53] [54] [55] [56] [57])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exmligtb.mf
 Ok) ) ) )
Font metrics written on ectt0800.tfm.
Output written on ectt0800.600gf (256 characters, 35488 bytes).
Transcript written on ectt0800.log.
mktexpk: /app/.texlive/var/texmf-var/fonts/pk/ljfour/jknappen/ec/ectt0800.600pk: successfully generated.

kpathsea: Running mktexpk --mfmode / --bdpi 600 --mag 1+0/600 --dpi 600 ectt1000
mktexpk: Running mf-nowin -progname=mf \mode:=ljfour; mag:=1+0/600; nonstopmode; input ectt1000
This is METAFONT, Version 2.7182818 (TeX Live 2017) (preloaded base=mf)

(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/ectt1000.mf
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exbase.mf)
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/ectt.mf
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exroman.mf
 Ok (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exaccess.mf
 Ok) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/expseudo.mf
 Ok) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exruwest.mf
 Ok [192] [193] [194] [195] [196] [197] [198] [199] [200] [201] [202] [203]
[204] [205] [206] [207] [208] [209] [210] [211] [212] [213] [214] [215]
[216] [217] [218] [219] [220] [221] [222] [223])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrlwest.mf
 Ok [224] [225] [226] [227] [228] [229] [230] [231] [232] [233] [234] [235]
[236] [237] [238] [239] [240] [241] [242] [243] [244] [245] [246] [247]
[248] [249] [250] [251] [252] [253] [254] [255])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrueast.mf
 Ok [128] [129] [130] [131] [132] [133] [134] [135] [136] [137] [138] [139]
[140] [141] [142] [143] [144] [145] [146] [147] [148] [149] [150] [151]
[152] [153] [154] [155] [156] [157])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrleast.mf
 Ok [158] [160] [161] [162] [163] [164] [165] [166] [167] [168] [169] [170]
[171] [172] [173] [174] [175] [176] [177] [178] [179] [180] [181] [182]
[183] [184] [185] [186] [187] [188])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exbraces.mf
 Ok [94] [126] [23] [40] [41] [60] [124] [62] [91] [93] [92] [123] [125]
[95] [127] [32]) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/expunct.mf
 Ok [14] [15] [19] [20] [13] [18] [33] [39] [42] [43] [44] [46] [47] [58]
[59] [61] [96] [189] [17] [45] [16] [21] [22])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exaccent.mf
 Ok [0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exsign.mf
 Ok [24] [34] [35] [36] [37] [64] [191] [159])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrlig.mf
 Ok [25] [26] [28] [27] [29] [30] [31])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exromp.mf
 Ok [38] [63] [190])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrulett.mf
 Ok [65] [66] [67] [68] [69] [70] [71] [72] [73] [74] [75] [76] [77] [78]
[79] [80] [81] [82] [83] [84] [85] [86] [87] [88] [89] [90])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrllett.mf
 Ok [97] [98] [99] [100] [101] [102] [103] [104] [105] [106] [107] [108]
[109] [110] [111] [112] [113] [114] [115] [116] [117] [118] [119] [120]
[121] [122]) (/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exrdigit.mf
 Ok [48] [49] [50] [51] [52] [53] [54] [55] [56] [57])
(/app/.texlive/texmf-dist/fonts/source/jknappen/ec/exmligtb.mf
 Ok) ) ) )
Font metrics written on ectt1000.tfm.
Output written on ectt1000.600gf (256 characters, 43832 bytes).
Transcript written on ectt1000.log.
mktexpk: /app/.texlive/var/texmf-var/fonts/pk/ljfour/jknappen/ec/ectt1000.600pk: successfully generated.
Latexmk: Non-existent bbl file 'paper.bbl'
 No file paper.bbl.
Latexmk: References changed.
Latexmk: References changed.
Latexmk: Log file says output to 'paper.pdf'
Latexmk: List of undefined refs and citations:
  Citation `10.5555/1795114.1795167' on page 5 undefined on input line 156
  Citation `Aharon2013' on page 2 undefined on input line 60
  Citation `Bennett07thenetflix' on page 4 undefined on input line 130
  Citation `Cantador:RecSys2011' on page 2 undefined on input line 60
  Citation `Chen2011' on page 5 undefined on input line 156
  Citation `Deshpande2004' on page 4 undefined on input line 88
  Citation `Funk2006' on page 4 undefined on input line 130
  Citation `Geuens2015' on page 5 undefined on input line 167
  Citation `Goldberg1992' on page 3 undefined on input line 46
  Citation `Herlocker1999' on page 4 undefined on input line 82
  Citation `Karatzoglou2010' on page 5 undefined on input line 154
  Citation `Koren2009' on page 4 undefined on input line 128
  Citation `Koren2009' on page 5 undefined on input line 154
  Citation `Lops2011' on page 6 undefined on input line 200
  Citation `Manning2008' on page 6 undefined on input line 204
  Citation `Rendle2012-1' on page 5 undefined on input line 167
  Citation `Rendle2012-1' on page 5 undefined on input line 181
  Citation `Rendle2012-3' on page 5 undefined on input line 167
  Citation `Sarwar2000' on page 4 undefined on input line 116
  Citation `Sarwar2000' on page 4 undefined on input line 97
  Citation `Sarwar2001' on page 3 undefined on input line 57
  Citation `Sarwar2001' on page 3 undefined on input line 68
  Citation `Sarwar2001' on page 4 undefined on input line 88
  Citation `balbaert2019julia' on page 2 undefined on input line 23
  Citation `bezanson2017julia' on page 1 undefined on input line 10
  Citation `ekstrand2020lenskit' on page 1 undefined on input line 12
  Citation `gantner2011mymedialite' on page 1 undefined on input line 12
  Citation `guo2015librec' on page 1 undefined on input line 12
  Citation `harper2015movielens' on page 2 undefined on input line 60
  Citation `harper2015movielens' on page 9 undefined on input line 1
  Citation `kotkov2016survey' on page 8 undefined on input line 165
  Citation `michiels2022recpack' on page 6 undefined on input line 23
  Citation `milano2020recommender' on page 6 undefined on input line 1
  Citation `ni2019justifying' on page 2 undefined on input line 60
  Citation `salceanu2018julia' on page 2 undefined on input line 23
  Citation `shani2011evaluating' on page 8 undefined on input line 132
  Citation `ziegler2005improving' on page 8 undefined on input line 209
  Reference `eq:FMs' on page 5 undefined on input line 181
  Reference `fig:accessor' on page 2 undefined on input line 1
  Reference `fig:accessor' on page 2 undefined on input line 3
  Reference `fig:cf' on page 3 undefined on input line 52
  Reference `fig:components' on page 1 undefined on input line 14
  Reference `fig:mf' on page 5 undefined on input line 145
  Reference `fig:recommender' on page 1 undefined on input line 1
  Reference `fig:recommender' on page 2 undefined on input line 1
  Reference `fig:tradeoff' on page 9 undefined on input line 14
  Reference `sec:aggregated-metrics' on page 9 undefined on input line 43
  Reference `sec:algorithm' on page 1 undefined on input line 14
  Reference `sec:algorithm' on page 9 undefined on input line 1
  Reference `sec:data' on page 1 undefined on input line 14
  Reference `sec:data' on page 9 undefined on input line 1
  Reference `sec:evaluation' on page 1 undefined on input line 14
  Reference `sec:evaluation' on page 10 undefined on input line 5
  Reference `sec:evaluation' on page 9 undefined on input line 1
  Reference `sec:experiment' on page 1 undefined on input line 14
  Reference `sec:intra-list-metrics' on page 9 undefined on input line 43
  Reference `sec:intra-list-metrics' on page 9 undefined on input line 49
  Reference `sec:introduction' on page 10 undefined on input line 5
  Reference `sec:introduction' on page 9 undefined on input line 47
  Reference `sec:ranking-metrics' on page 8 undefined on input line 191
  Reference `sec:ranking-metrics' on page 9 undefined on input line 43
  Reference `sec:rating-metrics' on page 9 undefined on input line 43
  Reference `sec:svd' on page 9 undefined on input line 1
  Reference `tab:results' on page 9 undefined on input line 14
  Reference `tab:results' on page 9 undefined on input line 19
  Reference `tab:results' on page 9 undefined on input line 49
Latexmk: Found bibliography file(s) [ref.bib]
Latexmk: Summary of warnings:
  Latex failed to resolve 36 reference(s)
  Latex failed to resolve 38 citation(s)
Rule 'bibtex paper': File changes, etc:
   Changed files, or newly in use since previous run(s):
      'paper.aux'
   Non-existent destination files:
      'paper.bbl'
------------
Run number 1 of rule 'bibtex paper'
------------
------------
Running 'bibtex  "paper"'
------------
Rule 'pdflatex': File changes, etc:
   Changed files, or newly in use since previous run(s):
      'paper.aux'
      'paper.bbl'
      'paper.out'
------------
Run number 2 of rule 'pdflatex'
------------
------------
Running 'pdflatex  -recorder  "paper.tex"'
------------
Latexmk: Found input bbl file 'paper.bbl'
Latexmk: List of undefined refs and citations:
  Citation `10.5555/1795114.1795167' on page 5 undefined on input line 156
  Citation `Aharon2013' on page 2 undefined on input line 60
  Citation `Bennett07thenetflix' on page 4 undefined on input line 130
  Citation `Cantador:RecSys2011' on page 2 undefined on input line 60
  Citation `Chen2011' on page 5 undefined on input line 156
  Citation `Deshpande2004' on page 4 undefined on input line 88
  Citation `Funk2006' on page 4 undefined on input line 130
  Citation `Geuens2015' on page 5 undefined on input line 167
  Citation `Goldberg1992' on page 3 undefined on input line 46
  Citation `Herlocker1999' on page 4 undefined on input line 82
  Citation `Karatzoglou2010' on page 5 undefined on input line 154
  Citation `Koren2009' on page 4 undefined on input line 128
  Citation `Koren2009' on page 5 undefined on input line 154
  Citation `Lops2011' on page 6 undefined on input line 200
  Citation `Manning2008' on page 6 undefined on input line 204
  Citation `Rendle2012-1' on page 5 undefined on input line 167
  Citation `Rendle2012-1' on page 5 undefined on input line 181
  Citation `Rendle2012-3' on page 5 undefined on input line 167
  Citation `Sarwar2000' on page 4 undefined on input line 116
  Citation `Sarwar2000' on page 4 undefined on input line 97
  Citation `Sarwar2001' on page 3 undefined on input line 57
  Citation `Sarwar2001' on page 3 undefined on input line 68
  Citation `Sarwar2001' on page 4 undefined on input line 88
  Citation `balbaert2019julia' on page 2 undefined on input line 23
  Citation `bezanson2017julia' on page 1 undefined on input line 10
  Citation `ekstrand2020lenskit' on page 1 undefined on input line 12
  Citation `gantner2011mymedialite' on page 1 undefined on input line 12
  Citation `guo2015librec' on page 1 undefined on input line 12
  Citation `harper2015movielens' on page 2 undefined on input line 60
  Citation `harper2015movielens' on page 9 undefined on input line 1
  Citation `kotkov2016survey' on page 8 undefined on input line 165
  Citation `michiels2022recpack' on page 6 undefined on input line 23
  Citation `milano2020recommender' on page 6 undefined on input line 1
  Citation `ni2019justifying' on page 2 undefined on input line 60
  Citation `salceanu2018julia' on page 2 undefined on input line 23
  Citation `shani2011evaluating' on page 8 undefined on input line 132
  Citation `ziegler2005improving' on page 8 undefined on input line 209
Latexmk: Found bibliography file(s) [ref.bib]
Latexmk: Summary of warnings:
  Latex failed to resolve 38 citation(s)
Rule 'bibtex paper': File changes, etc:
   Changed files, or newly in use since previous run(s):
      'paper.aux'
------------
Run number 2 of rule 'bibtex paper'
------------
------------
Running 'bibtex  "paper"'
------------
Rule 'pdflatex': File changes, etc:
   Changed files, or newly in use since previous run(s):
      'paper.aux'
      'paper.out'
------------
Run number 3 of rule 'pdflatex'
------------
------------
Running 'pdflatex  -recorder  "paper.tex"'
------------
Latexmk: Found input bbl file 'paper.bbl'
Latexmk: List of undefined refs and citations:
  Citation `10.5555/1795114.1795167' on page 5 undefined on input line 156
  Citation `Manning2008' on page 6 undefined on input line 204
  Citation `Rendle2012-1' on page 5 undefined on input line 167
  Citation `Rendle2012-1' on page 5 undefined on input line 181
  Citation `Rendle2012-3' on page 5 undefined on input line 167
  Citation `Sarwar2000' on page 4 undefined on input line 116
  Citation `Sarwar2000' on page 4 undefined on input line 97
  Citation `Sarwar2001' on page 3 undefined on input line 57
  Citation `Sarwar2001' on page 3 undefined on input line 68
  Citation `Sarwar2001' on page 4 undefined on input line 88
  Citation `michiels2022recpack' on page 6 undefined on input line 23
  Citation `milano2020recommender' on page 6 undefined on input line 1
  Citation `ni2019justifying' on page 2 undefined on input line 60
  Citation `salceanu2018julia' on page 2 undefined on input line 23
  Citation `shani2011evaluating' on page 8 undefined on input line 132
  Citation `ziegler2005improving' on page 8 undefined on input line 209
Latexmk: Found bibliography file(s) [ref.bib]
Latexmk: Summary of warnings:
  Latex failed to resolve 17 citation(s)
Failure to make 'paper.pdf'
Collected error summary (may duplicate other messages):
  pdflatex: Command for 'pdflatex' gave return code 1
      Refer to 'paper.log' for details
Looks like we failed to compile the PDF

[takuti]

@whedon generate pdf from branch paper-fix

[whedon]

Attempting PDF compilation from custom branch paper-fix. Reticulating splines etc...