create and run blog and journal loader - Githubissues

TheScienceMuseum / heritage-connector

Heritage Connector: Transforming text into data to extract meaning and make connections

https://www.sciencemuseumgroup.org.uk/projects/heritage-connector

MIT License

21 stars 3 forks source link

create and run blog and journal loader #296

Closed kdutia closed 3 years ago

kdutia commented 3 years ago

[x] basic loader
[x] test NER/NEL
[x] add NER/NEL to loader
[x] limit size of journal text (first paragraph?)
[x] normalise URLs for blog
[x] add blink to loader
[x] run loader

[x] also remove old adlib loader