dosubot[bot]
commented
6 months ago To address the bug you're experiencing when using Bedrock cohere with Pinecone serverless in node mode with the llama-index, here are some steps and potential solutions:
Steps to Reproduce and Relevant Code
-
Initialization of
VectorStoreIndex:index = VectorStoreIndex(nodes, storage_context=storage_context, service_context=service_context) -
Inserting Nodes:
index.insert_nodes(subnodes)
Potential Issues and Solutions
1. Ensure Correct Request and Response Formats
Ensure that the request and response formats are correctly handled for the "cohere.command-text-v14" model. Refer to the test cases provided in the test_bedrock.py file to verify the correct formats.
2. Pinecone Vector Store Implementation
Ensure that your implementation of the Pinecone vector store in the llama-index correctly handles the query and response formats. Here is an example of how the Pinecone vector store is implemented:
class PineconeVectorStore(BasePydanticVectorStore):
# ... other methods ...
def query(self, query: VectorStoreQuery, **kwargs: Any) -> VectorStoreQueryResult:
# Implementation details...3. Check Pinecone Client Version
Ensure you have the correct version of the Pinecone client installed. You can check and install the Pinecone client as follows:
from typing import Any
from packaging import version
def _import_pinecone() -> Any:
try:
import pinecone
except ImportError as e:
raise ImportError(
"Could not import pinecone python package. "
"Please install it with `pip install pinecone-client`."
) from e
return pinecone
def _is_pinecone_v3() -> bool:
pinecone = _import_pinecone()
pinecone_client_version = pinecone.__version__
return version.parse(pinecone_client_version) >= version.parse("3.0.0")By ensuring the correct request and response formats, verifying the Pinecone vector store implementation, and checking the Pinecone client version, you should be able to resolve the bug. If the issue persists, please provide more specific details or logs to further diagnose the problem.
#### Details
**Sources** - [llama-index-integrations/llms/llama-index-llms-bedrock/tests/test_bedrock.py](https://github.com/run-llama/llama_index/blob/main/llama-index-integrations/llms/llama-index-llms-bedrock/tests/test_bedrock.py) - [llama-index-integrations/vector_stores/llama-index-vector-stores-pinecone/llama_index/vector_stores/pinecone/base.py](https://github.com/run-llama/llama_index/blob/main/llama-index-integrations/vector_stores/llama-index-vector-stores-pinecone/llama_index/vector_stores/pinecone/base.py) - [llama-index-integrations/vector_stores/llama-index-vector-stores-pinecone/llama_index/vector_stores/pinecone/utils.py](https://github.com/run-llama/llama_index/blob/main/llama-index-integrations/vector_stores/llama-index-vector-stores-pinecone/llama_index/vector_stores/pinecone/utils.py) - [llama-index-legacy/tests/vector_stores/test_pinecone.py](https://github.com/run-llama/llama_index/blob/main/llama-index-legacy/tests/vector_stores/test_pinecone.py) - [llama-index-legacy/llama_index/legacy/indices/vector_store/base.py](https://github.com/run-llama/llama_index/blob/main/llama-index-legacy/llama_index/legacy/indices/vector_store/base.py) - [llama-index-core/llama_index/core/indices/vector_store/base.py](https://github.com/run-llama/llama_index/blob/main/llama-index-core/llama_index/core/indices/vector_store/base.py) - [llama-index-legacy/llama_index/legacy/vector_stores/pinecone.py](https://github.com/run-llama/llama_index/blob/main/llama-index-legacy/llama_index/legacy/vector_stores/pinecone.py) - [llama-index-integrations/embeddings/llama-index-embeddings-bedrock/llama_index/embeddings/bedrock/base.py](https://github.com/run-llama/llama_index/blob/main/llama-index-integrations/embeddings/llama-index-embeddings-bedrock/llama_index/embeddings/bedrock/base.py) - [llama-index-integrations/vector_stores/llama-index-vector-stores-pinecone/pyproject.toml](https://github.com/run-llama/llama_index/blob/main/llama-index-integrations/vector_stores/llama-index-vector-stores-pinecone/pyproject.toml) - [llama-index-integrations/embeddings/llama-index-embeddings-bedrock/pyproject.toml](https://github.com/run-llama/llama_index/blob/main/llama-index-integrations/embeddings/llama-index-embeddings-bedrock/pyproject.toml)**About Dosu** This response is meant to be useful and save you time. It is **not meant to be a precise solution**, but rather a starting point for your own research. Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.
To continue the conversation, mention @dosu.
Bug Description
I can still reproduce the bug in: https://github.com/run-llama/llama_index/issues/13376
If I use even the newest llama index
I don't have the bug if I just call the embeddings directly like in the first tutorial but: https://docs.llamaindex.ai/en/stable/examples/embeddings/bedrock/?h=bedrock+emb
Doing this tutorial will fail: https://docs.llamaindex.ai/en/stable/examples/vector_stores/PineconeIndexDemo/ (naturally if using bedrock embedding cohere)
This at least occurs if using node mode in combination of serverless AWS pinecone:
index = VectorStoreIndex(nodes, storage_context=storage_context, service_context=service_context)
or in certain examples in this mode too:
index.insert_nodes(subnodes)
Would be thankful if this could be solved.
Version
0.10.38
Steps to Reproduce
Use Bedrock cohere with pinecone serverless.
Like in your demo link. Reproduction should at least work if using node import.
Relevant Logs/Tracbacks