search

su77ungr / CASALIOY

♾️ toolkit for air-gapped LLMs on consumer-grade hardware
Apache License 2.0
229 stars 32 forks source link

fix mp warning #88

Closed hippalectryon-0 closed 1 year ago

su77ungr commented 1 year ago

btw could recreate with. so this was critical

Scanning files
Traceback (most recent call last):
  File "/srv/CASALIOY/casalioy/ingest.py", line 164, in <module>
    main(sources_directory, cleandb)
  File "/srv/CASALIOY/casalioy/ingest.py", line 158, in main
    ingester.ingest_from_directory(sources_directory, chunk_size, chunk_overlap)
  File "/srv/CASALIOY/casalioy/ingest.py", line 136, in ingest_from_directory
    multiprocessing.set_start_method("spawn")
  File "/usr/local/lib/python3.11/multiprocessing/context.py", line 247, in set_start_method
    raise RuntimeError('context has already been set')
RuntimeError: context has already been set