search

openassistive / OpenATBackend

Back end api for Open Assistive built using nodeJS.
https://api.openassistive.org
4 stars 1 forks source link

Need a service that refreshes one or all items at weekly intervals #5

Open willwade opened 7 years ago

willwade commented 7 years ago

Not sure how we do this. Not really part of api

hosseinzoda commented 7 years ago

A crawler is needed for this.

willwade commented 7 years ago

Just to clarify:

  1. For each OpenATFrontend/item/*.md get projectURL.
  2. If OpenATFrontend/item/*.md has marked do-not-update just see if downloadURL still active. If is - leave md file. If not tag "possible-404"
    • Else
  3. Get projectURL and parse as in GET /service/{service}/project
  4. Update *.md file