search

mlabonne / llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
https://mlabonne.github.io/blog/
Apache License 2.0
37.68k stars 3.96k forks source link

RuntimeWarning in Fine-tune Llama 3 with ORPO.ipynb #65

Open lxt3 opened 5 months ago

lxt3 commented 5 months ago

Could you please explain the runtime warning in cell 3 in Fine-tune Llama 3 with ORPO.ipynb:

/usr/local/lib/python3.10/dist-packages/multiprocess/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock. self.pid = os.fork()

Is JAX being somewhere in the notebook? I'm afraid I cannot see why this warning occurs.

mlabonne commented 5 months ago

No idea but you can use multiprocessing instead of os to get rid of this warning.

On Mon, Apr 22, 2024 at 12:35 AM lxt3 @.***> wrote:

Could you please explain the runtime warning in cell 3 in Fine-tune Llama 3 with ORPO.ipynb:

/usr/local/lib/python3.10/dist-packages/multiprocess/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock. self.pid = os.fork()

Is JAX being somewhere in the notebook? I'm afraid I cannot see why this warning occurs.

— Reply to this email directly, view it on GitHub https://github.com/mlabonne/llm-course/issues/65, or unsubscribe https://github.com/notifications/unsubscribe-auth/ATL5EGUQN5MY6DC46JV3TCDY6RELHAVCNFSM6AAAAABGRYOOGKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGI2TKMZSHAYTANI . You are receiving this because you are subscribed to this thread.Message ID: @.***>