pyvandenbussche / sparqles

SPARQL Endpoint Status
BSD 2-Clause "Simplified" License
27 stars 6 forks source link

Fork and alt host interest? #66

Open berezovskyi opened 2 years ago

berezovskyi commented 2 years ago

Hello,

https://sparqles.ai.wu.ac.at/ which to my best knowledge was the main endpoint of SPARQLes, is down for quite a long time now. Additionally, the software is quite old and needs at least a refresh of dependencies and a dockerization. I have two questions:

  1. Does anyone have interest in helping maintain a fork of this repo? Main aim would be to do low-key dependency updates to catch up with security updates and new formats/protocols.
  2. Does anyone know of an existing instance of SPARQLes running elsewhere? I am interested from the point of asking for MongoDB backups such as to retain the uptime history as much as possible.

Cheers, Andrew

berezovskyi commented 2 years ago

So far, I have dockerized the whole setup using Docker Compose and got it to run again (I forgot it since I ran it 5 years ago). Almost 600 endpoints loaded from datahub.io and just short of 20% of them are alive.

image

I also registered the sparqles organization on Github to transfer the repo. For now, I am planning to transfer my repo (berezovkyi/sparqles) over there unless @pyvandenbussche or others suggest otherwise. My plan is to mitigate biggest security holes by updating some libraries to the supported versions and deploy the server on one of the cheapest VMs on Hetzner (2vCPU/2GB RAM/40GB disk at ~€5/mo) and see how it goes (I am also thinking of disabling performance checks to avoid hammering servers with unnecessary load; we may also want to split robots.txt agents for general uptime checks and the rest of extended checks). Some immediately relevant issues on this repo are:

image

However, my knowledge of Node and Mongo is quite limited. Thus I am asking here if someone would be interested to help or point me to some other effort.

AxelPolleres commented 2 years ago

Hello,

https://sparqles.ai.wu.ac.at/ which to my best knowledge was the main endpoint of SPARQLes, is down for quite a long time now. Additionally, the software is quite old and needs at least a refresh of dependencies and a dockerization. I have two questions:

1. Does anyone have interest in helping maintain a fork of this repo? Main aim would be to do low-key dependency updates to catch up with security updates and new formats/protocols.

2. Does anyone know of an existing instance of SPARQLes running elsewhere? I am interested from the point of asking for MongoDB backups such as to retain the uptime history as much as possible.

Cheers, Andrew

Hi Andrew,

it's up again now and was down mainly for log4J issues (fixed now) ... we'd be happy to join forces if you want to contribute. I think though, it's not a good idea to run it on two different sites/servers ... and we're still happy to "sponsor" the running server from our institute. Let us know what you think, we'd be happy to have a call and sort out the best way to collaborate/join forces!

Axel