search

run-llama / llama_index

LlamaIndex is a data framework for your LLM applications
https://docs.llamaindex.ai
MIT License
35.51k stars 5.01k forks source link

[Bug]: Cannot load NebulaGraphStore following official document #10987

Closed mw19930312 closed 7 months ago

mw19930312 commented 7 months ago

Bug Description

I'm following https://docs.llamaindex.ai/en/stable/examples/query_engine/knowledge_graph_rag_query_engine.html to create a graph query engine. However, I'm not able to load a NebulaGraphStore due to 

WARNING:nebula3.logger:Connect 143.244.220.150:9669 failed: socket error connecting to host 143.244.220.150, port 9669 (('143.244.220.150', 9669)): TimeoutError('timed out')
Exception ignored in: <function NebulaGraphStore.__del__ at 0x2b09d42c0>
Traceback (most recent call last):
  File "/Users/weimiao/Desktop/knowledge graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py", line 242, in __del__
    self._session_pool.close()
    ^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'close'

We can check from Nebular studio that the space is already created. I also tried to change the NEBULA_ADDRESS to be

Screenshot 2024-02-19 at 10 20 43 AM

Version

0.10.6

Steps to Reproduce

%pip install ipython-ngql nebula3-python

os.environ["NEBULA_USER"] = "root" os.environ["NEBULA_PASSWORD"] = "nebula" # default is "nebula" os.environ[ "NEBULA_ADDRESS" ] = "graphhd:9669" # assumed we have NebulaGraph installed locally

space_name = "llamaindex" edge_types, rel_prop_names = ["relationship"], [ "relationship" ] # default, could be omit if create from an empty kg tags = ["entity"] # default, could be omit if create from an empty kg

from llama_index.core import StorageContext from llama_index.graph_stores.nebula import NebulaGraphStore

graph_store = NebulaGraphStore( space_name=space_name, edge_types=edge_types, rel_prop_names=rel_prop_names, tags=tags, ) storage_context = StorageContext.from_defaults(graph_store=graph_store)

Relevant Logs/Tracbacks

---------------------------------------------------------------------------
RuntimeError                              Traceback (most recent call last)
Cell In[15], line 4
      1 from llama_index.core import StorageContext
      2 from llama_index.graph_stores.nebula import NebulaGraphStore
----> 4 graph_store = NebulaGraphStore(
      5     space_name=space_name,
      6     edge_types=edge_types,
      7     rel_prop_names=rel_prop_names,
      8     tags=tags,
      9 )
     10 storage_context = StorageContext.from_defaults(graph_store=graph_store)

File ~/Desktop/knowledge graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:142, in NebulaGraphStore.__init__(self, session_pool, space_name, edge_types, rel_prop_names, tags, tag_prop_names, include_vid, session_pool_kwargs, **kwargs)
    140 self._session_pool: Any = session_pool
    141 if self._session_pool is None:
--> 142     self.init_session_pool()
    144 self._vid_type = self._get_vid_type()
    146 self._tags = tags or ["entity"]

File ~/Desktop/knowledge graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:228, in NebulaGraphStore.init_session_pool(self)
    220 session_pool = SessionPool(
    221     os.environ["NEBULA_USER"],
    222     os.environ["NEBULA_PASSWORD"],
    223     self._space_name,
    224     [(graphd_host, int(graphd_port))],
    225 )
    227 seesion_pool_config = SessionPoolConfig()
--> 228 session_pool.init(seesion_pool_config)
    229 self._session_pool = session_pool
    230 return self._session_pool

File ~/Desktop/knowledge graph/.venv/lib/python3.11/site-packages/nebula3/gclient/net/SessionPool.py:103, in SessionPool.init(self, configs)
    101 ok_num = self.get_ok_servers_num()
    102 if ok_num < len(self._addresses):
--> 103     raise RuntimeError(
    104         'The services status exception: {}'.format(self._get_services_status())
    105     )
    107 # iterate all addresses and create sessions to fullfil the min_size
    108 for i in range(self._configs.min_size):

RuntimeError: The services status exception: [services: ('143.244.220.150', 9669), status: BAD]
dosubot[bot] commented 7 months ago

🤖

Hey there @mw19930312, great to see you reaching out again! I'm on it, and I'll get back to you with a detailed response soon.

logan-markewich commented 7 months ago

Isn't that "error" just printed when the application/code exits?

You aren't able to create the index and query engine from there?

mw19930312 commented 7 months ago

Isn't that "error" just printed when the application/code exits?

You aren't able to create the index and query engine from there?

@logan-markewich Sorry I'm not following. There seems to be some socket connection issues to the NEBULA_ADDRESS that I provided so that the graph store is not successfully created. There is a timeout error.

mw19930312 commented 7 months ago

@logan-markewich Is it possible to have someone to take a look? This is blocking me from running even a toy example.

logan-markewich commented 7 months ago

@mw19930312 oh lol missed the first part of the error. Lemme try

logan-markewich commented 7 months ago

@mw19930312 I followed the notebook, and was able to get it to work.

Since I did not have an existing KG in nebula, I ran these steps first

curl -fsSL nebula-up.siwei.io/install.sh | bash
~/.nebula-up/console.sh
> CREATE SPACE llamaindex(vid_type=FIXED_STRING(256), partition_num=1, replica_factor=1);
> :sleep 10;
> USE llamaindex;
> CREATE TAG entity(name string);
> CREATE EDGE relationship(relationship string);
> :sleep 10;
> CREATE TAG INDEX entity_index ON entity(name(256));

Then to populate my new KG

%pip install ipython-ngql nebula3-python

os.environ["NEBULA_USER"] = "root"
os.environ["NEBULA_PASSWORD"] = "nebula"  # default is "nebula"
os.environ[
    "NEBULA_ADDRESS"
] = "127.0.0.1:9669"  # assumed we have NebulaGraph installed locally

space_name = "llamaindex"
edge_types, rel_prop_names = ["relationship"], [
    "relationship"
]  # default, could be omit if create from an empty kg
tags = ["entity"]  # default, could be omit if create from an empty kg

from llama_index.core import StorageContext
from llama_index.graph_stores.nebula import NebulaGraphStore

graph_store = NebulaGraphStore(
    space_name=space_name,
    edge_types=edge_types,
    rel_prop_names=rel_prop_names,
    tags=tags,
)
storage_context = StorageContext.from_defaults(graph_store=graph_store)

from llama_index.core import SimpleDirectoryReader

documents = SimpleDirectoryReader("../data/paul_graham").load_data()

from llama_index.core import KnowledgeGraphIndex

index = KnowledgeGraphIndex.from_documents(documents, storage_context=storage_context)
mw19930312 commented 7 months ago

@logan-markewich Thanks for the reply. I'm able to load the graph store after changing the address to be 127.0.0.1:9669. However, I'm encountering another error of

---------------------------------------------------------------------------
NameError                                 Traceback (most recent call last)
Cell In[18], [line 1](vscode-notebook-cell:?execution_count=18&line=1)
----> [1](vscode-notebook-cell:?execution_count=18&line=1) graph_store

NameError: name 'graph_store' is not defined
Requirement already satisfied: ipython-ngql in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (0.8.0)
Requirement already satisfied: nebula3-python in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (3.5.0)
Requirement already satisfied: Jinja2 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from ipython-ngql) (3.1.3)
Requirement already satisfied: pandas in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from ipython-ngql) (2.2.0)
Requirement already satisfied: future>=0.18.0 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from nebula3-python) (0.18.3)
Requirement already satisfied: httplib2>=0.20.0 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from nebula3-python) (0.22.0)
Requirement already satisfied: pytz>=2021.1 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from nebula3-python) (2024.1)
Requirement already satisfied: six>=1.16.0 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from nebula3-python) (1.16.0)
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from httplib2>=0.20.0->nebula3-python) (3.1.1)
Requirement already satisfied: MarkupSafe>=2.0 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from Jinja2->ipython-ngql) (2.1.5)
Requirement already satisfied: numpy<2,>=1.23.2 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from pandas->ipython-ngql) (1.26.4)
Requirement already satisfied: python-dateutil>=2.8.2 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from pandas->ipython-ngql) (2.8.2)
Requirement already satisfied: tzdata>=2022.7 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from pandas->ipython-ngql) (2024.1)
Note: you may need to restart the kernel to use updated packages.
WARNING:nebula3.logger:Connect 143.244.220.150:9669 failed: socket error connecting to host 143.244.220.150, port 9669 (('143.244.220.150', 9669)): TimeoutError('timed out')
---------------------------------------------------------------------------
RuntimeError                              Traceback (most recent call last)
Cell In[17], [line 4](vscode-notebook-cell:?execution_count=17&line=4)
      [1](vscode-notebook-cell:?execution_count=17&line=1) from llama_index.core import StorageContext
      [2](vscode-notebook-cell:?execution_count=17&line=2) from llama_index.graph_stores.nebula import NebulaGraphStore
----> [4](vscode-notebook-cell:?execution_count=17&line=4) graph_store = NebulaGraphStore(
      [5](vscode-notebook-cell:?execution_count=17&line=5)     space_name=space_name,
      [6](vscode-notebook-cell:?execution_count=17&line=6)     edge_types=edge_types,
      [7](vscode-notebook-cell:?execution_count=17&line=7)     rel_prop_names=rel_prop_names,
      [8](vscode-notebook-cell:?execution_count=17&line=8)     tags=tags,
      [9](vscode-notebook-cell:?execution_count=17&line=9) )
     [10](vscode-notebook-cell:?execution_count=17&line=10) storage_context = StorageContext.from_defaults(graph_store=graph_store)

File [~/Desktop/knowledge](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge) graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:142, in NebulaGraphStore.__init__(self, session_pool, space_name, edge_types, rel_prop_names, tags, tag_prop_names, include_vid, session_pool_kwargs, **kwargs)
    [140](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:140) self._session_pool: Any = session_pool
    [141](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:141) if self._session_pool is None:
--> [142](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:142)     self.init_session_pool()
    [144](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:144) self._vid_type = self._get_vid_type()
    [146](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:146) self._tags = tags or ["entity"]

File [~/Desktop/knowledge](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge) graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:228, in NebulaGraphStore.init_session_pool(self)
    [220](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:220) session_pool = SessionPool(
    [221](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:221)     os.environ["NEBULA_USER"],
    [222](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:222)     os.environ["NEBULA_PASSWORD"],
    [223](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:223)     self._space_name,
    [224](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:224)     [(graphd_host, int(graphd_port))],
    [225](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:225) )
    [227](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:227) seesion_pool_config = SessionPoolConfig()
--> [228](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:228) session_pool.init(seesion_pool_config)
    [229](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:229) self._session_pool = session_pool
    [230](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/graph_stores/nebula/base.py:230) return self._session_pool

File [~/Desktop/knowledge](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge) graph/.venv/lib/python3.11/site-packages/nebula3/gclient/net/SessionPool.py:103, in SessionPool.init(self, configs)
    [101](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/nebula3/gclient/net/SessionPool.py:101) ok_num = self.get_ok_servers_num()
    [102](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/nebula3/gclient/net/SessionPool.py:102) if ok_num < len(self._addresses):
--> [103](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/nebula3/gclient/net/SessionPool.py:103)     raise RuntimeError(
    [104](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/nebula3/gclient/net/SessionPool.py:104)         'The services status exception: {}'.format(self._get_services_status())
    [105](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/nebula3/gclient/net/SessionPool.py:105)     )
    [107](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/nebula3/gclient/net/SessionPool.py:107) # iterate all addresses and create sessions to fullfil the min_size
    [108](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/nebula3/gclient/net/SessionPool.py:108) for i in range(self._configs.min_size):

RuntimeError: The services status exception: [services: ('143.244.220.150', 9669), status: BAD]
Requirement already satisfied: ipython-ngql in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (0.8.0)
Requirement already satisfied: nebula3-python in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (3.5.0)
Requirement already satisfied: Jinja2 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from ipython-ngql) (3.1.3)
Requirement already satisfied: pandas in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from ipython-ngql) (2.2.0)
Requirement already satisfied: future>=0.18.0 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from nebula3-python) (0.18.3)
Requirement already satisfied: httplib2>=0.20.0 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from nebula3-python) (0.22.0)
Requirement already satisfied: pytz>=2021.1 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from nebula3-python) (2024.1)
Requirement already satisfied: six>=1.16.0 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from nebula3-python) (1.16.0)
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from httplib2>=0.20.0->nebula3-python) (3.1.1)
Requirement already satisfied: MarkupSafe>=2.0 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from Jinja2->ipython-ngql) (2.1.5)
Requirement already satisfied: numpy<2,>=1.23.2 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from pandas->ipython-ngql) (1.26.4)
Requirement already satisfied: python-dateutil>=2.8.2 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from pandas->ipython-ngql) (2.8.2)
Requirement already satisfied: tzdata>=2022.7 in [./.venv/lib/python3.11/site-packages](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages) (from pandas->ipython-ngql) (2024.1)
Note: you may need to restart the kernel to use updated packages.
---------------------------------------------------------------------------
ModuleNotFoundError                       Traceback (most recent call last)
File [~/Desktop/knowledge](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge) graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:21, in _try_loading_included_file_formats()
     [20](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:20) try:
---> [21](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:21)     from llama_index.readers.file import (
     [22](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:22)         DocxReader,
     [23](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:23)         EpubReader,
     [24](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:24)         HWPReader,
     [25](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:25)         ImageReader,
     [26](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:26)         IPYNBReader,
     [27](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:27)         MarkdownReader,
     [28](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:28)         MboxReader,
     [29](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:29)         PandasCSVReader,
     [30](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:30)         PDFReader,
     [31](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:31)         PptxReader,
     [32](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:32)         VideoAudioReader,
     [33](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:33)     )  # pants: no-infer-dep
     [34](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:34) except ImportError:

ModuleNotFoundError: No module named 'llama_index.readers'

During handling of the above exception, another exception occurred:

ImportError                               Traceback (most recent call last)
Cell In[6], [line 3](vscode-notebook-cell:?execution_count=6&line=3)
      [1](vscode-notebook-cell:?execution_count=6&line=1) from llama_index.core import SimpleDirectoryReader
----> [3](vscode-notebook-cell:?execution_count=6&line=3) documents = SimpleDirectoryReader("[./paul_graham_essay/data](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/paul_graham_essay/data)").load_data()
      [6](vscode-notebook-cell:?execution_count=6&line=6) from llama_index.core import KnowledgeGraphIndex
      [8](vscode-notebook-cell:?execution_count=6&line=8) index = KnowledgeGraphIndex.from_documents(documents, storage_context=storage_context)

File [~/Desktop/knowledge](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge) graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:396, in SimpleDirectoryReader.load_data(self, show_progress, num_workers)
    [391](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:391)         files_to_process = tqdm(
    [392](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:392)             self.input_files, desc="Loading files", unit="file"
    [393](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:393)         )
    [394](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:394)     for input_file in files_to_process:
    [395](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:395)         documents.extend(
--> [396](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:396)             SimpleDirectoryReader.load_file(
    [397](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:397)                 input_file=input_file,
    [398](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:398)                 file_metadata=self.file_metadata,
    [399](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:399)                 file_extractor=self.file_extractor,
    [400](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:400)                 filename_as_id=self.filename_as_id,
    [401](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:401)                 encoding=self.encoding,
    [402](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:402)                 errors=self.errors,
    [403](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:403)             )
    [404](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:404)         )
    [406](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:406) return self._exclude_metadata(documents)

File [~/Desktop/knowledge](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge) graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:303, in SimpleDirectoryReader.load_file(input_file, file_metadata, file_extractor, filename_as_id, encoding, errors)
    [275](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:275) """Static method for loading file.
    [276](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:276) 
    [277](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:277) NOTE: necessarily as a static method for parallel processing.
   (...)
    [300](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:300)     List[Document]: loaded documents
    [301](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:301) """
    [302](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:302) # TODO: make this less redundant
--> [303](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:303) default_file_reader_cls = SimpleDirectoryReader.supported_suffix_fn()
    [304](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:304) default_file_reader_suffix = list(default_file_reader_cls.keys())
    [305](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:305) metadata: Optional[dict] = None

File [~/Desktop/knowledge](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge) graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:35, in _try_loading_included_file_formats()
     [21](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:21)     from llama_index.readers.file import (
     [22](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:22)         DocxReader,
     [23](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:23)         EpubReader,
   (...)
     [32](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:32)         VideoAudioReader,
     [33](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:33)     )  # pants: no-infer-dep
     [34](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:34) except ImportError:
---> [35](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:35)     raise ImportError("`llama-index-readers-file` package not found")
     [37](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:37) default_file_reader_cls: Dict[str, Type[BaseReader]] = {
     [38](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:38)     ".hwp": HWPReader,
     [39](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:39)     ".pdf": PDFReader,
   (...)
     [53](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:53)     ".ipynb": IPYNBReader,
     [54](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:54) }
     [55](https://file+.vscode-resource.vscode-cdn.net/Users/weimiao/Desktop/knowledge%20graph/~/Desktop/knowledge%20graph/.venv/lib/python3.11/site-packages/llama_index/core/readers/file/base.py:55) return default_file_reader_cls

ImportError: `llama-index-readers-file` package not found
logan-markewich commented 7 months ago

Try pip install llama-index-readers-file

logan-markewich commented 7 months ago

(I'm surprised you don't already have it, it's included with pip install llama-index, unless you weren't using the starter bundle there)

mw19930312 commented 7 months ago

Nvm I just realized that the line of pip install llama-index was removed so that there is no llama_index in my venv. Now it works. Thanks for the help!

BarryYin commented 2 months ago

Connect 127.0.0.1:9669 failed: socket error connecting to host 127.0.0.1, port 9669 (('127.0.0.1', 9669)): ConnectionRefusedError(111, 'Connection refused') how to fix it