Openalex Data Importer - Githubissues

desci-labs / nodes

Secure PID containers for interoperable research objects

https://dpid.org

MIT License

41 stars 5 forks source link

Openalex Data Importer #439

Open shadrach-tayo opened 3 months ago

shadrach-tayo commented 3 months ago

Description of the Problem / Feature

Create script to update self hosted Open alex database everyday

Explanation of the solution

Instrospect remote Db to pull schema
Setup local db with pgvector and local setup script using docker
Integrate drizzle for database client
Run script with node-cron
Manage process using pm2
Integrate pino for logging