search

UTMediaCAT / mediacat-docs

Repository with documentation
0 stars 1 forks source link

New Repository with API based code #14

Closed kstapelfeldt closed 3 years ago

kstapelfeldt commented 3 years ago
  1. Create a new repository called mediacat-twitter-API
  2. Push and document code relating to the mediacat API-based crawler
  3. Ensure we can make the same export format (that can be accepted by the post-processor, or scope this work if it is significant)

The idea is that people could plug in the API-based crawler and it would be interoperable with the rest of the stack

kstapelfeldt commented 3 years ago

Danhua has an application but the output is not quite the same. Ideally, the output would mirror the output of the Twitter crawler so that it could be plugged in as an alternative, but this is a lower priority ticket. Double check if the pre- post processor functions work on the API crawler.

kstapelfeldt commented 3 years ago

Yesterday and today Danhua worked on the twitter crawler output. Still an error on the .csv part. Needs to also function with the mini-processor code.

kstapelfeldt commented 3 years ago

This is finished and hasn't been uploaded yet. @danhuacai to make a pull request and merge.

kstapelfeldt commented 3 years ago

Pushed to new repo and merged.