search

UUDigitalHumanitieslab / parseport

Dutch sentence parser for Spindle + Æthel (and maybe others in the future).
BSD 3-Clause "New" or "Revised" License
0 stars 0 forks source link

Add Celery + Redis #4

Closed XanderVertegaal closed 1 week ago

XanderVertegaal commented 10 months ago

Can we use docker-compose with this, in combination with the cookie-cutter backend (+ frontend)?

JeltevanBoheemen commented 10 months ago

See https://github.com/UUDigitalHumanitieslab/sasta/blob/develop/docker-compose.yml and https://github.com/UUDigitalHumanitieslab/I-analyzer/blob/develop/docker-compose.yaml for inspiration. SASTA uses rabbitmq instead of redis, but that's easily adaptable.

XanderVertegaal commented 10 months ago

Celery should also periodically clean up any remaining files on the latex-service server (cronjob). Latexmk provides a command for this (latexmk -C).

XanderVertegaal commented 3 weeks ago

Instead of Celery/Redis, we can also use crontabs on the server.

XanderVertegaal commented 1 week ago

Cronjob set up for all ParsePort servers: 30 2 * * * /usr/bin/docker exec pp-latex sh -c 'latexmk -C && rm *.tex'