Closed stevereiner closed 1 month ago
On linux ubuntu 22.04, relik 1.0.7 did also work with python 3.11 in addition to python 3.10 with virtualenv doing the switch to both.
\relik\retriever\indexers\document.py", line 11, in csv.field_size_limit(sys.maxsize) change to csv.field_size_limit(min(sys.maxsize, 2147483646)) fixes Windows problem
Also with a clean new python 3.12.6 install on linux ubuntu 22.04 with just pip install relik==1.0.6 in virtualenv The import relik worked fine (don't get the errors I had in issue #14 ) So I don't think the change in 1.0.7 to prevent install with python 3.12 is needed.
Fixed by #16, closing.
Hate to say it, but I don't think this issue was solved. I'm still encountering the same OverflowError on import in a clean conda environment using Python 3.10.x. Let me know if it makes sense for me to open a new issue.
Error Traceback:
---------------------------------------------------------------------------
OverflowError Traceback (most recent call last)
Cell In[3], line 1
----> 1 import relik
File c:\Users\XXXX\AppData\Local\miniconda3\envs\relik\lib\site-packages\relik\__init__.py:1
----> 1 from relik.inference.annotator import Relik
File c:\Users\XXXX\AppData\Local\miniconda3\envs\relik\lib\site-packages\relik\inference\data\objects.py:8
----> 8 from relik.retriever.indexers.document import Document
File c:\Users\XXXX\AppData\Local\miniconda3\envs\relik\lib\site-packages\relik\retriever\indexers\document.py:11
---> 11 csv.field_size_limit(sys.maxsize)
OverflowError: Python int too large to convert to C long
Error reproduced with: Python: 3.10.12 - 3.10.14 Relik: 1.0.7 Environment:
pip install relik[all]; pip install langchain langchain-experimental
)pip install relik
)
On ubuntu, relik 1.0.7 did prevent install with python 3.12, relik 1.0.7 worked with python 3.10, was having trouble switching to python 3.11 so didn't verify With python 3.12, 3.11, 3.10 still get this windows with 1.0.7 relik File "C:\newdev2\relik\relik-text.py", line 1, in
import relik
File "C:\Users\sreiner\AppData\Roaming\Python\Python310\site-packages\relik__init.py", line 1, in
from relik.inference.annotator import Relik
File "C:\Users\sreiner\AppData\Roaming\Python\Python310\site-packages\relik\inference\annotator.py", line 16, in
from relik.inference.data.objects import (
File "C:\Users\sreiner\AppData\Roaming\Python\Python310\site-packages\relik\inference\data\objects.py", line 8, in
from relik.retriever.indexers.document import Document
File "C:\Users\sreiner\AppData\Roaming\Python\Python310\site-packages\relik\retriever\ init.py", line 1, in
from relik.retriever.pytorch_modules.model import GoldenRetriever
File "C:\Users\sreiner\AppData\Roaming\Python\Python310\site-packages\relik\retriever\pytorch_modules\ init__.py", line 5, in
from relik.retriever.indexers.document import Document
File "C:\Users\sreiner\AppData\Roaming\Python\Python310\site-packages\relik\retriever\indexers\document.py", line 11, in
csv.field_size_limit(sys.maxsize)
OverflowError: Python int too large to convert to C long