C2DH / jdh-notebook

A collection of Jupyter notebooks for the Journal of Digital History
https://journalofdigitalhistory.org
GNU Affero General Public License v3.0
4 stars 1 forks source link

Investigation discrepancy between Jupyterlab - Jupyter notebook for R script / Merge revisions #69

Closed eliselavy closed 2 years ago

eliselavy commented 2 years ago

I have attached two pictures of which words are assigned to the topics by LDA in the journal webpage and how they appear in JupyterLab on my machine. Since I added the labels manually, only the JupyterLab version makes sense. After that, all the other results are jumbled. I have scouted the internet to look what might have provoked the different results, but I have not found an answer in the queries. I notice that the error is consistent, not random. The words produced in the journal webpage are the same that come out when I run the program in Jupyter Notebook, while running the program in RStudio and JupyterLab produce a different set of results. So I guess there must be a hidden parameter somewhere.

I also changed the "SI_metadata.csv" file to respond to the comments of the reviewer, so please include the new file. I have also changed runtime.txt

TOPICS in the journal:

Topics (Journal)

TOPICS in JupyterLab Topics (JupyterLab)

eliselavy commented 2 years ago

Problem occurs also for the following notebook: https://github.com/jdh-observer/jdh001-9HcfToh7EYm8 plot_7075_parties1

Any version of R Studio that supports R 3.5.0 (april 2018) or newer has to work according to my information (and experience). The R version initially used to create the scripts was R 3.5.0 as well, but the scripts also run on newer versions.

eliselavy commented 2 years ago

Kernel not found with FROM rocker/binder:4.1.1

Screenshot 2022-04-29 at 14 21 10

Get back to version FROM rocker/binder:3.6.3

eliselavy commented 2 years ago

On mybinder the good topic modelling

Screenshot 2022-04-29 at 14 39 25
eliselavy commented 2 years ago

with image FROM rocker/binder:3.6.3 OK with image FROM rocker/binder:4.1.1 NOK

eliselavy commented 2 years ago

Locally 3.6.3: R_ettore_local My binder: R_ettore_mybinder

But not the good result

=> solution download the notebook from mybinder

eliselavy commented 2 years ago

for the following notebook not linked to the R's version but more to the version of the file: https://github.com/jdh-observer/jdh001-9HcfToh7EYm8/blob/main/stuff.RDS