search

PTrottier / Boojum-Web

Boojum Technical Reports Website in Flask
0 stars 2 forks source link

Parse Zone for Technical Papers #3

Open PTrottier opened 6 years ago

PTrottier commented 6 years ago

Parse the Zone repository for Technical Papers and convert the relevant information to JSON using lxml.

PTrottier commented 6 years ago

See: https://docs.google.com/spreadsheets/d/1LYsmfnEH7F_l98UDMr2DgXIKqMH1_wVXFudORFqTrFk for a comparison of the OAI-PMH Metadata formats.

PTrottier commented 6 years ago

For qualified dc, when web scrapping the Zone OAI-PMH, there is only 100 elements visible per page, and so multiple requests to the OAI may be required to get all the reports