search

domschl / HuggingFaceGuidedTourForMac

A guided tour on how to use HuggingFace large language models on Macs with Apple Silicon
MIT License
122 stars 14 forks source link

'bus error python' on M1 Mac in the 00-SystemCheck notebook #3

Open cip22 opened 3 months ago

cip22 commented 3 months ago

When I try to run the sentiment analysis, as soon as I execute nlp("I feel good"), I get

zsh: bus error python

The problem turned out to be this code: nlp = pipeline("sentiment-analysis") After this step, I get - among other info - this line back:

Hardware accelerator e.g. GPU is available in the environment, but no device argument is passed to the Pipeline object. Model will be on CPU.

So I decided to provide the 'device' argument. If MPS is present on the machine, I can create the pipeline like this: nlp = pipeline("sentiment-analysis", device="mps") The documentation is here: https://huggingface.co/docs/transformers/v4.44.0/en/main_classes/pipelines#transformers.pipeline

Now the sentiment analysis runs.

BruceWong001 commented 1 week ago

Yeah, similar issue happened in Mac book M1 pro, keep crashing Jupiter notebook when running the pipeline. it works after specified GPU acceleration: nlp = pipeline("sentiment-analysis", framework='pt',device=0). device=0 means using GPU, -1 means use CPU, default value is -1.

cip22 commented 1 week ago

Interesting, so there seems to be more than one way to specify the device.