RuntimeWarning in Fine-tune Llama 3 with ORPO.ipynb

[lxt3]

Could you please explain the runtime warning in cell 3 in Fine-tune Llama 3 with ORPO.ipynb:

/usr/local/lib/python3.10/dist-packages/multiprocess/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock. self.pid = os.fork()

Is JAX being somewhere in the notebook? I'm afraid I cannot see why this warning occurs.

[mlabonne]

No idea but you can use multiprocessing instead of os to get rid of this warning.

…

On Mon, Apr 22, 2024 at 12:35 AM lxt3 ***@***.***> wrote: Could you please explain the runtime warning in cell 3 in Fine-tune Llama 3 with ORPO.ipynb: /usr/local/lib/python3.10/dist-packages/multiprocess/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock. self.pid = os.fork() Is JAX being somewhere in the notebook? I'm afraid I cannot see why this warning occurs. — Reply to this email directly, view it on GitHub <#65>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ATL5EGUQN5MY6DC46JV3TCDY6RELHAVCNFSM6AAAAABGRYOOGKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGI2TKMZSHAYTANI> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>