search

mediacloud / nyt-news-labeler

Tag news stories based on models trained on the NYT corpus.
Apache License 2.0
39 stars 12 forks source link

Apple M1 incompatibility #38

Open rodighiero opened 8 months ago

rodighiero commented 8 months ago

The package appears to be incompatible with Apple M1. Here is the recurring error I get from running it.

nyt-news-labeler-1 | [2023-12-27 19:39:53 +0000] [1] [INFO] Starting gunicorn 20.1.0 nyt-news-labeler-1 | [2023-12-27 19:39:53 +0000] [1] [INFO] Listening at: http://0.0.0.0:8000 (1) nyt-news-labeler-1 | [2023-12-27 19:39:53 +0000] [1] [INFO] Using worker: sync nyt-news-labeler-1 | [2023-12-27 19:39:53 +0000] [24] [INFO] Booting worker with pid: 24 nyt-news-labeler-1 | [2023-12-27 19:39:54 +0000] [1] [WARNING] Worker with pid 24 was terminated due to signal 4 nyt-news-labeler-1 | [2023-12-27 19:39:54 +0000] [34] [INFO] Booting worker with pid: 34 nyt-news-labeler-1 | [2023-12-27 19:39:54 +0000] [1] [WARNING] Worker with pid 34 was terminated due to signal 4 nyt-news-labeler-1 | [2023-12-27 19:39:54 +0000] [44] [INFO] Booting worker with pid: 44 nyt-news-labeler-1 | [2023-12-27 19:39:54 +0000] [1] [WARNING] Worker with pid 44 was terminated due to signal 4 nyt-news-labeler-1 | [2023-12-27 19:39:54 +0000] [54] [INFO] Booting worker with pid: 54 nyt-news-labeler-1 | [2023-12-27 19:39:55 +0000] [1] [WARNING] Worker with pid 54 was terminated due to signal 4 nyt-news-labeler-1 | [2023-12-27 19:39:55 +0000] [64] [INFO] Booting worker with pid: 64 nyt-news-labeler-1 | [2023-12-27 19:39:55 +0000] [1] [WARNING] Worker with pid 64 was terminated due to signal 4

rahulbot commented 8 months ago

Dockerhub has builds for linux/arm64 - those don't work for you?

rodighiero commented 8 months ago

It doesn't work. I do not know whether others have the same issue. The image is constantly shut down and reopened as in the screenshot.

Screenshot 2024-01-03 at 12 00 23 PM

The sequence I am running is this: docker pull rahulbot/nyt-news-labeler:latest docker run --platform linux/amd64 -p 8000:8000 -m 8G -d rahulbot/nyt-news-labeler:latest

And I don't have any answers from the command line curl -X POST http://localhost:8000/predict.json -H "Content-Type: application/json" -d '{"text": "Federal agents show stronger force at Portland protests despite order to withdraw" }'

Perhaps the problem is different, but the docker is working smoothly on our Linux machine.

rahulbot commented 8 months ago

Ah I see what you mean. Yes, I see the same problem here. I also can't get the image to build on my M1 from source due to tensorflow version nonsense. Sorry, I don't see a quick solution here for M1 🤷🏽‍♂️