[ISSUE] Unable to run devika getting error, Getting error of parelleisim has been already used

[kotharismeet-3]

Configuration

- OS: macOS - 14.4.1
- Python version: 3.9.6
- Node version: 18.17.1
- bun version: 1.1.8
- search engine: -
- Model: -

Getting error of parelleisim has been already used, ideally it should not because code is already os.environ["TOKENIZERS_PARALLELISM"] = "false"

How To Reproduce

Steps to reproduce the behavior (example): python3 devika.py

Expected behavior

devika.py should run

Screenshots and logs

huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
        - Avoid using `tokenizers` before the fork if possible
        - Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
        - Avoid using `tokenizers` before the fork if possible
        - Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
Traceback (most recent call last):
  File "/Users/smeetkothari/python/devik

[RobertWeijie]

same

[Polygons1]

just set it to true

[kotharismeet-3]

@Polygons1 it dosent work that way!, also unable to get context of error from the code

[RobertWeijie]

@Polygons1 it dosent work that way!, also unable to get context of error from the code

+1