search

openjournals / joss-reviews

Reviews for the Journal of Open Source Software
Creative Commons Zero v1.0 Universal
722 stars 38 forks source link

[PRE REVIEW]: Generating Visualizations Conversationally using LLMs #7328

Open editorialbot opened 1 month ago

editorialbot commented 1 month ago

Submitting author: !--author-handle-->@buddyroo30<!--end-author-handle-- (Andrew Smith) Repository: https://github.com/buddyroo30/canvasxpress_gen Branch with paper.md (empty if default branch): JOSS-submission Version: V1.0.1 Editor: !--editor-->@crvernon<!--end-editor-- Reviewers: Pending Managing EiC: Chris Vernon

Status

status

Status badge code:

HTML: <a href="https://joss.theoj.org/papers/280321271949ddca3d68624b431a9c47"><img src="https://joss.theoj.org/papers/280321271949ddca3d68624b431a9c47/status.svg"></a>
Markdown: [![status](https://joss.theoj.org/papers/280321271949ddca3d68624b431a9c47/status.svg)](https://joss.theoj.org/papers/280321271949ddca3d68624b431a9c47)

Author instructions

Thanks for submitting your paper to JOSS @buddyroo30. Currently, there isn't a JOSS editor assigned to your paper.

@buddyroo30 if you have any suggestions for potential reviewers then please mention them here in this thread (without tagging them with an @). You can search the list of people that have already agreed to review and may be suitable for this submission.

Editor instructions

The JOSS submission bot @editorialbot is here to help you find and assign reviewers and start the main review. To find out what @editorialbot can do for you type:

@editorialbot commands
editorialbot commented 1 month ago

Hello human, I'm @editorialbot, a robot that can help you with some common editorial tasks.

For a list of things I can do to help you, just type:

@editorialbot commands

For example, to regenerate the paper pdf after making changes in the paper's md or bib files, type:

@editorialbot generate pdf
editorialbot commented 1 month ago

Software report:

github.com/AlDanial/cloc v 1.90  T=2.53 s (15.8 files/s, 12681.3 lines/s)
-------------------------------------------------------------------------------
Language                     files          blank        comment           code
-------------------------------------------------------------------------------
JSON                             5              0              0          28157
Python                          17            465            203           2019
HTML                             1             38              0            265
CSS                              3             30              3            226
TeX                              1             18              0            197
Markdown                         5             52              0            136
make                             2             27              0             83
Perl                             3             16             26             68
Dockerfile                       2              4              0             22
YAML                             1              1              4             19
-------------------------------------------------------------------------------
SUM:                            40            651            236          31192
-------------------------------------------------------------------------------

Commit count by author:

    76  EC2 Default User
    32  Andrew K Smith
    10  Andrew Smith
editorialbot commented 1 month ago

Paper file info:

📄 Wordcount for paper.md is 1896

✅ The paper includes a Statement of need section

editorialbot commented 1 month ago

License info:

🔴 Failed to discover a valid open source license

editorialbot commented 1 month ago 
Reference check summary (note 'MISSING' DOIs are suggestions that need verification):

✅ OK DOIs

- 10.48550/arXiv.2402.03216 is OK
- 10.1145/3397271.3401075 is OK
- 10.48550/arXiv.2407.21783 is OK

🟡 SKIP DOIs

- No DOI given, and none found for title: Showing Examples
- No DOI given, and none found for title: CanvasXpress: A JavaScript Library for Data Analyt...
- No DOI given, and none found for title: Better language models and their implications
- No DOI given, and none found for title: Retrieval-Augmented Generation for Large Language ...
- No DOI given, and none found for title: Long-context LLMs Struggle with Long In-context Le...
- No DOI given, and none found for title: milvus-io/pymilvus
- No DOI given, and none found for title: A Quick Intro to Leave-One-Out Cross-Validation (L...
- No DOI given, and none found for title: Hello GPT-4o \textbar OpenAI
- No DOI given, and none found for title: Meet Claude
- No DOI given, and none found for title: Large Enough
- No DOI given, and none found for title: Google AI Gemini API \textbar Google AI Studio \te...
- No DOI given, and none found for title: Phi-3 Open Models - Small Language Models \textbar...
- No DOI given, and none found for title: Introducing DBRX: A New State-of-the-Art Open LLM
- No DOI given, and none found for title: GPT-4
- No DOI given, and none found for title: OpenAI vs Open-Source Multilingual Embedding Model...
- No DOI given, and none found for title: CanvasXpress: AI using LLM

❌ MISSING DOIs

- None

❌ INVALID DOIs

- None
editorialbot commented 1 month ago

:point_right::page_facing_up: Download article proof :page_facing_up: View article proof on GitHub :page_facing_up: :point_left:

editorialbot commented 1 month ago

Five most similar historical JOSS papers:

AstronomicAL: an interactive dashboard for visualisation, integration and classification of data with Active Learning Submitting author: @grant-m-s Handling editor: @crvernon (Active) Reviewers: @crhea93, @rmorgan10 Similarity score: 0.6453

SAMBA: A Trainable Segmentation Web-App with Smart Labelling Submitting author: @rmdocherty Handling editor: @Kevin-Mattheus-Moerman (Active) Reviewers: @pchlap, @jingpengw Similarity score: 0.6318

TLViz: Visualising and analysing tensor decomposition models with Python Submitting author: @marieroald Handling editor: @faroit (Active) Reviewers: @sara-02, @yiitozer Similarity score: 0.6280

TX$^2$: Transformer eXplainability and eXploration Submitting author: @WarmCyan Handling editor: @fabian-s (Active) Reviewers: @assenmacher-mat, @deniederhut Similarity score: 0.6272

Jury: A Comprehensive Evaluation Toolkit Submitting author: @devrimcavusoglu Handling editor: @crvernon (Active) Reviewers: @evamaxfield, @KennethEnevoldsen Similarity score: 0.6241

⚠️ Note to editors: If these papers look like they might be a good match, click through to the review issue for that paper and invite one or more of the authors before considering asking the reviewers of these papers to review again for JOSS.

crvernon commented 3 weeks ago

:wave: @buddyroo30 - while I am finding you an editor, please reduce the word count of your paper to around 1000 words. Also, please add an open source license to your repository (see https://opensource.org/licenses).

crvernon commented 3 weeks ago

@editorialbot invite @logological as editor

:wave: @logological are you able to take this on one as editor? Thanks!

editorialbot commented 3 weeks ago

Invitation to edit this submission sent!

logological commented 3 weeks ago

@crvernon This submission presents a problem similar to the one we had with PYLIWC (#7119) in that it is targeted at users of a proprietary tool, CanvasXpress. (Note that CanvasXpress falsely claims to be open source; it is actually distributed under a licence that covers only uses that are "personal and educational" and places heavy-handed restrictions on redistribution.) I am concerned about our ability to find reviewers who can (legally) use CanvasXpress to test the software. Before PYLIWC was rejected (for unrelated reasons), I tried and failed to find reviewers who held a licence to the proprietary software it depended on.

In any case, even if it's not strictly outside JOSS's scope, I'm not particularly comfortable editing a submission on a free/open-source tool whose only purpose is to facilitate the use of proprietary software.

What are your thoughts?

crvernon commented 3 weeks ago

@editorialbot query scope

Thank you for raising this issue @logological. I am going to place this on in review with our larger editorial board as well. So let's hold off on finding reviewers.

@buddyroo30 - please feel free to provide any comment here to address the above.

editorialbot commented 3 weeks ago

Submission flagged for editorial review.

buddyroo30 commented 3 weeks ago

Hi, Thank you for the feedback on our submission. I went ahead and added an open source license as requested and I will work to reduce the word count. As for the issue around the license for CanvasXpress itself, let me discuss that with my co-author and get back to you soon.  Best,Andrew Smith

Yahoo Mail: Search, Organize, Conquer

On Thu, Oct 24, 2024 at 4:39 PM, Chris @.***> wrote:

@editorialbot query scope

Thank you for raising this issue @logological. I am going to place this on in review with our larger editorial board as well. So let's hold off on finding reviewers.

@buddyroo30 - please feel free to provide any comment here to address the above.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

buddyroo30 commented 2 weeks ago

Hi, So I discussed the license issue around CanvasXpress itself with my collaborator and he feels its current license is reasonable and does not want to change it. First, practically, the vast majority of users of CanvasXpress are academic or not for profit users, so they would be able to freely use CanvasXpress (and the associated AI enhancements we discuss in our paper) without limitation. Second, the license for CanvasXpress itself is essentially what most of the other large visualization packages use (e.g. Plotly) so CanvasXpress's license is not anything out of the ordinary. Please let us know your thoughts and if you think you could proceed with the review of the paper. thanks,Andrew Smith On Friday, October 25, 2024 at 09:57:54 AM EDT, Andrew Smith @.***> wrote:

Hi, Thank you for the feedback on our submission. I went ahead and added an open source license as requested and I will work to reduce the word count. As for the issue around the license for CanvasXpress itself, let me discuss that with my co-author and get back to you soon.  Best,Andrew Smith

Yahoo Mail: Search, Organize, Conquer

On Thu, Oct 24, 2024 at 4:39 PM, Chris @.***> wrote:

@editorialbot query scope

Thank you for raising this issue @logological. I am going to place this on in review with our larger editorial board as well. So let's hold off on finding reviewers.

@buddyroo30 - please feel free to provide any comment here to address the above.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

crvernon commented 57 minutes ago

@editorialbot assign me as editor

@buddyroo30 - I will see if we can find you reviewers who have free access to this platform. If not, then we will have to reject. But let's give it a shot. I'll take this one on.

editorialbot commented 57 minutes ago

Assigned! @crvernon is now the editor

crvernon commented 52 minutes ago

👋 @RahulSundar - Would you be willing to review this submission to JOSS? We carry out our checklist-driven reviews here in GitHub issues and follow these guidelines: https://joss.readthedocs.io/en/latest/review_criteria.html

Note: this review requires access to CanvasXpress

crvernon commented 51 minutes ago

👋 @luisaforozco - Would you be willing to review this submission to JOSS? We carry out our checklist-driven reviews here in GitHub issues and follow these guidelines: https://joss.readthedocs.io/en/latest/review_criteria.html

Note: this review requires access to CanvasXpress

crvernon commented 50 minutes ago

👋 @ahmadawais - Would you be willing to review this submission to JOSS? We carry out our checklist-driven reviews here in GitHub issues and follow these guidelines: https://joss.readthedocs.io/en/latest/review_criteria.html

Note: this review requires access to CanvasXpress