[WIP] Comply with the public crossref dump and some cleaning

kermitt2 / biblio-glutton

A high performance bibliographic information service: https://biblio-glutton.readthedocs.io

117 stars 15 forks source link

[WIP] Comply with the public crossref dump and some cleaning #51

Closed Aazhar closed 3 years ago

Aazhar commented 3 years ago

Hello,

Here are some update I 've made to build the resolver using the dump from crossref : https://www.crossref.org/blog/free-public-data-file-of-112-million-crossref-records/

Also some dependency files cleaning , node_modules ..

I didn't manage to update the node js script yet, I'll look at it later (I've used a php script for the indexing part..)

karatekaneen commented 3 years ago

Mate, I think we both solved the same problem 😁 My PR is aimed to solve the same issue, among others

Aazhar commented 3 years ago

hello @karatekaneen ,

actually I didn't test it yet but the two PRs are for the same purpose, this PR updates the java part for building the LMDB mappings while yours updates the indexing part with ES using the node js script ?

Aazhar commented 3 years ago

sorry I've added some unrelated commits to my master fork, I've created a dedicated branch , please look at the PR #52