[PRE REVIEW]: sweater: Speedy Word Embedding Association Test and Extras Using R

[whedon]

Submitting author: @chainsawriot (Chung-hong Chan) Repository: https://github.com/chainsawriot/sweater Version: v0.1.0 Editor: @sbenthall Reviewers: @kbenoit, @cmaimone Managing EiC: Kevin M. Moerman

:warning: JOSS reduced service mode :warning:

Due to the challenges of the COVID-19 pandemic, JOSS is currently operating in a "reduced service mode". You can read more about what that means in our blog post.

Status

Status badge code:

HTML: <a href="https://joss.theoj.org/papers/0439a212239383d3ca9e81c65e3b0052"><img src="https://joss.theoj.org/papers/0439a212239383d3ca9e81c65e3b0052/status.svg"></a>
Markdown: [![status](https://joss.theoj.org/papers/0439a212239383d3ca9e81c65e3b0052/status.svg)](https://joss.theoj.org/papers/0439a212239383d3ca9e81c65e3b0052)

Author instructions

Thanks for submitting your paper to JOSS @chainsawriot. Currently, there isn't an JOSS editor assigned to your paper.

@chainsawriot if you have any suggestions for potential reviewers then please mention them here in this thread (without tagging them with an @). In addition, this list of people have already agreed to review for JOSS and may be suitable for this submission (please start at the bottom of the list).

Editor instructions

The JOSS submission bot @whedon is here to help you find and assign reviewers and start the main review. To find out what @whedon can do for you type:

@whedon commands

[whedon]

Hello human, I'm @whedon, a robot that can help you with some common editorial tasks.

:warning: JOSS reduced service mode :warning:

Due to the challenges of the COVID-19 pandemic, JOSS is currently operating in a "reduced service mode". You can read more about what that means in our blog post.

For a list of things I can do to help you, just type:

@whedon commands

For example, to regenerate the paper pdf after making changes in the paper's md or bib files, type:

@whedon generate pdf

[whedon]

Wordcount for paper.md is 1324

[whedon]

Software report (experimental):

github.com/AlDanial/cloc v 1.88  T=0.12 s (370.3 files/s, 131109.7 lines/s)
-------------------------------------------------------------------------------
Language                     files          blank        comment           code
-------------------------------------------------------------------------------
SVG                              1             27              0          11226
Markdown                         6            305              0           1204
R                               27            109            361            843
TeX                              3            135             22            694
XML                              1              0              2            441
YAML                             4             36              5            334
C++                              2             16             16            187
Rmd                              1             90            133             92
Python                           1              1              2              4
-------------------------------------------------------------------------------
SUM:                            46            719            541          15025
-------------------------------------------------------------------------------

Statistical information for the repository 'b38ca9c8e5922434a9e7973f' was
gathered on 2021/11/21.
The following historical commit information, by author, was found:

Author                     Commits    Insertions      Deletions    % of changes
chainsawriot                     8           238             12          100.00

Below are the number of rows from each author that have survived and are still
intact in the current revision:

Author                     Rows      Stability          Age       % in comments
chainsawriot                226           95.0          1.9                7.96

[whedon]

Reference check summary (note 'MISSING' DOIs are suggestions that need verification):

OK DOIs

- 10.1111/jcom.12056 is OK
- 10.1126/science.aal4230 is OK
- 10.1073/pnas.1720347115 is OK
- 10.1177/1077699020932304 is OK
- 10.1177/0146167204271418 is OK
- 10.3115/v1/d14-1162 is OK
- 10.1145/3345645.3351107 is OK
- 10.1007/978-1-4614-6868-4 is OK

MISSING DOIs

- 10.18653/v1/p18-1228 may be a valid DOI for title: Semaxis: A lightweight framework to characterize domain-specific word semantics beyond sentiment
- 10.18653/v1/2021.acl-long.148 may be a valid DOI for title: Bad seeds: Evaluating lexical methods for bias measurement
- 10.24963/ijcai.2020/60 may be a valid DOI for title: WEFE: The Word Embeddings Fairness Evaluation Framework.
- 10.1145/3342220.3343658 may be a valid DOI for title: Identifying biases in politically biased wikis through word embeddings
- 10.18653/v1/n19-1062 may be a valid DOI for title: Black is to criminal as caucasian is to police: Detecting and removing multiclass bias in word embeddings
- 10.1145/3351095.3372837 may be a valid DOI for title: Reducing sentiment polarity for demographic attributes in word embeddings using adversarial learning

INVALID DOIs

- None

[whedon]

:point_right::page_facing_up: Download article proof :page_facing_up: View article proof on GitHub :page_facing_up: :point_left:

[chainsawriot]

@whedon generate pdf

[whedon]

:point_right::page_facing_up: Download article proof :page_facing_up: View article proof on GitHub :page_facing_up: :point_left:

[chainsawriot]

I've edited the paper a bit to add the missing DOIs.

May I suggest the following reviewers: pmyteh kbenoit alexhanna

[Kevin-Mattheus-Moerman]

@chainsawriot thanks for this submission and for suggesting potential reviewers. A first step is to confirm whether this work is in scope for JOSS. I have just assigned the query-scope label here. This means I have triggered an additional scope review by the editorial board. This is typical for submissions of this size so essentially we will determine whether this work presents with sufficient scholarly effort to be in scope for JOSS. This scope review should take about 2 weeks.

[kthyng]

Hi @chainsawriot! I've removed the query-scope label because the editorial board thought this is in scope. So, we can proceed.

@sbenthall Would you be able to take this on as editor?

[kthyng]

@whedon invite @sbenthall as editor

[whedon]

@sbenthall has been invited to edit this submission.

[kthyng]

note for future AEIC: If sbenthall is not able to do this, I currently recommend putting this in a waitlist for an editor in the social sciences/humanities/text-related fields to open up. Choices include chartgerink, gkthiruvathukal, and ajstewartlang.

[kthyng]

@chainsawriot One note that came up multiple times in feedback from the editorial board is that the "speedy" claim is dubious and that if they were judging based on that claim, this would be deemed not in scope. So, perhaps that should not be an emphasis or perhaps you can elaborate on the claim if you do want to continue in that direction.

[chainsawriot]

@kthyng Thank you for taking care of the paper.

I can provide a benchmark later to back the speedy claim. If it is not convincing, then I can be creative and change the name of the package to a recursive acronym (sweater: Word Embedding Association Test and Extras Using R).

[sbenthall]

@whedon assign me as editor

[whedon]

OK, the editor is @sbenthall

[sbenthall]

@paragkulkarni11 Would you be able to review this package?

[sbenthall]

@mbod Would you be able to review this package?

[chainsawriot]

@sbenthall Thanks for being the editor of the paper. Previously, I have suggested some potential reviewers. They are listed in the reviewer database and I know they are experts in either text analysis, developing text analytic software, or algorithmic accountability. You might also consider them.

https://github.com/openjournals/joss-reviews/issues/3938#issuecomment-974899645

[chainsawriot]

@whedon generate pdf

[whedon]

:point_right::page_facing_up: Download article proof :page_facing_up: View article proof on GitHub :page_facing_up: :point_left:

[sbenthall]

Right on. Thanks @chainsawriot

[sbenthall]

@pmyteh Would you be able to review this package?

[sbenthall]

@kbenoit Would you be able to review this package?

[sbenthall]

@alexhanna Would you be able to review this package?

[alexhanna]

Don't have bandwidth right now, but thanks for thinking of me.

On Thu, Dec 9, 2021 at 6:09 AM Sebastian Benthall @.***> wrote:

@alexhanna https://github.com/alexhanna Would you be able to review this package?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/openjournals/joss-reviews/issues/3938#issuecomment-989886098, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAGC6DJ73TIMOKG4WHAQEO3UQCZ75ANCNFSM5IPCAFUA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

-- Alex Hanna, PhD alex-hanna.com Senior Research Scientist | Google Lecturer | UC Berkeley School of Information Co-Chair, Sociologists for Trans Justice (s4tj.com) Book some time with me: https://calendly.com/dr-alex-hanna

[kbenoit]

Sure

[chainsawriot]

@sbenthall

more potential reviewers: lmullen trinker cmaimone

[sbenthall]

Thanks @kbenoit I'll sign you up!

[sbenthall]

@whedon add @kbenoit as reviewer

[whedon]

OK, @kbenoit is now a reviewer

[sbenthall]

Hello @lmullen Would you be able to review this submission?

[sbenthall]

Hello @trinker would you be able to review this submission?

[lmullen]

With apologies, I don't have the capacity now.

[chainsawriot]

@sbenthall more

bagheria saurabh-khanna noamross

[sbenthall]

Hello @cmaimone Would you be able to review this package?

[cmaimone]

yes

[sbenthall]

Thank you @cmaimone ! I'll sign up up.

[sbenthall]

@whedon add @cmaimone as reviewer

[whedon]

OK, @cmaimone is now a reviewer

[sbenthall]

@whedon start review

[whedon]

OK, I've started the review over in https://github.com/openjournals/joss-reviews/issues/4036.