Full-text Jupyter Notebook

archivesunleashed / auk-notebooks

Jupyter notebooks to assist in creating additional analysis and visualizations of Archives Unleashed Cloud derivatives.

https://cloud.archivesunleashed.org

Other

11 stars 5 forks source link

Closed ianmilligan1 closed 5 years ago

ianmilligan1 commented 5 years ago

Here are the things we'd want in the full-text Jupyter notebook:

[x] Break down full-text file into separate files by year;
[x] Break down full-text file into separate files by domain (all);
[x] Simple word token frequency (maybe just a big list, show the top 20 words and frequency by default)
[ ] Could have an option for NER with a warning that it takes forever;
[x] Something visual as a way to connect to matplotlib? (something simple like a text dispersion plot or something from here

greebie commented 5 years ago

We have all of these down, except for NER. I think this is good enough for prototype and we can add later if it's in high demand.

ianmilligan1 commented 5 years ago

Agreed - thanks @greebie