Ingest Gibbon + named entities for Chapter 1

jacobwegner commented 3 years ago

Process for ingesting Gibbon content and Named Entities so far

Ran through a Jupyter Notebook created by @pnadelofficial and extracted a JSON document mapping entities to Plieades URIs (chap1_places.json)
Extracted Chapter 1 from https://www.ccel.org/g/gibbon/decline/volume1/chap1.htm
- extract_gibbon_text.py
- gibbon.decline.ccel-eng1.txt
Processed chap1_places.json against the extracted Chapter 1 text and created named entities + standoff annotations
- build_gibbon_entities.py
- gibbon_ch1_places.yml
- gibbon_ch1_places.csv
- For further details on the named entity annotation format for ATLAS, see scaife-viewer.org#16
Processed gibbon.decline.ccel-eng1.txt through a pipeline to extract a syntax tree annotation
- gibbon.decline.ccel-eng1.json
- Processing was done in ogl-pdl-annotations , but the processing code has not yet been committed into the repo
These annotations are currently visible on a beyond-translation preview instance (https://beyond-translation-gibbon-dev.herokuapp.com/reader/urn:cts:engLit:gibbon.decline.ccel-eng1:01.00-01.04?mode=named-entities&rs=mapStateHorizontal) and are pending merge via beyond-translation-site#21

TODOs for @jacobwegner

[x] Extract text for chapter 1
[x] Extract Pleiades places from Peter's data
[x] Create annotation
[x] Commit extraction script to VCS for reuse
[ ] Ingest from https://github.com/gregorycrane/DHFall2021/blob/c717c67152c773cdeeb8c710fb02910b60ed5ee5/texts/bury-all.xml
[ ] Rework annotations off of sentence IDs
[ ] Follow up with @pnadelofficial and @PatrickFeeney about next steps (additional annotations, GeoJSON support, etc) (via https://github.com/scaife-viewer/scaife-viewer.org/discussions/17)

jacobwegner commented 3 years ago

jacobwegner commented 3 years ago

jacobwegner commented 3 years ago

This should be the next file we base the prose and annotations on: