CGH20171006
commented
1 month ago This problem was not solved in my case by changing the version of openai： windows10+python3.11 openai-1.45.0
settings = Settings(
llm="gpt-4o-mini",
summary_llm="gpt-4o-mini",
paper_directory="D:\\Programing\\paper-qa",
verbosity=3
)
query = "What manufacturing challenges are unique to bispecific antibodies?"
try:
response = ask(query, settings)
print(response)
except Exception as e:
print(f"An error occurred: {e}")error message
PaperQA version: 5.0.7
[10:29:07] Beginning agent 'fake' run with question 'What manufacturing challenges are unique to bispecific antibodies?' and full query
{'query': 'What manufacturing challenges are unique to bispecific antibodies?', 'id':
UUID('562dea78-4538-496d-a77b-71a10725892a'), 'settings_template': None, 'settings': {'llm': 'gpt-4o-mini', 'llm_config': None,
'summary_llm': 'gpt-4o-mini', 'summary_llm_config': None, 'embedding': 'text-embedding-3-small', 'embedding_config': None,
'temperature': 0.0, 'batch_size': 1, 'texts_index_mmr_lambda': 1.0, 'index_absolute_directory': False, 'index_directory':
WindowsPath('C:/Users/20171006/.pqa/indexes'), 'index_recursively': True, 'verbosity': 3, 'manifest_file': None,
'paper_directory': 'D:\\Programing\\paper-qa', 'answer': {'evidence_k': 10, 'evidence_detailed_citations': True,
'evidence_retrieval': True, 'evidence_summary_length': 'about 100 words', 'evidence_skip_summary': False, 'answer_max_sources':
5, 'answer_length': 'about 200 words, but can be longer', 'max_concurrent_requests': 4, 'answer_filter_extra_background': False},
'parsing': {'chunk_size': 3000, 'use_doc_details': True, 'overlap': 100, 'citation_prompt': 'Provide the citation for the
following text in MLA Format. Do not write an introductory sentence. If reporting date accessed, the current year is
2024\n\n{text}\n\nCitation:', 'structured_citation_prompt': "Extract the title, authors, and doi as a JSON from this MLA
citation. If any field can not be found, return it as null. Use title, authors, and doi as keys, author's value should be a list
of authors. {citation}\n\nCitation JSON:", 'disable_doc_valid_check': False, 'chunking_algorithm':
<ChunkingOptions.SIMPLE_OVERLAP: 'simple_overlap'>}, 'prompts': {'summary': 'Summarize the excerpt below to help answer a
question.\n\nExcerpt from {citation}\n\n----\n\n{text}\n\n----\n\nQuestion: {question}\n\nDo not directly answer the question,
instead summarize to give evidence to help answer the question. Stay detailed; report specific numbers, equations, or direct
quotes (marked with quotation marks). Reply "Not applicable" if the excerpt is irrelevant. At the end of your response, provide
an integer score from 1-10 on a newline indicating relevance to question. Do not explain your score.\n\nRelevant Information
Summary ({summary_length}):', 'qa': 'Answer the question below with the context.\n\nContext (with relevance
scores):\n\n{context}\n\n----\n\nQuestion: {question}\n\nWrite an answer based on the context. If the context provides
insufficient information reply "I cannot answer."For each part of your answer, indicate which sources most support it via
citation keys at the end of sentences, like {example_citation}. Only cite from the context below and only use the valid keys.
Write in the style of a Wikipedia article, with concise sentences and coherent paragraphs. The context comes from a variety of
sources and is only a summary, so there may inaccuracies or ambiguities. If quotes are present and relevant, use them in the
answer. This answer will go directly onto Wikipedia, so do not add any extraneous information.\n\nAnswer ({answer_length}):',
'select': 'Select papers that may help answer the question below. Papers are listed as $KEY: $PAPER_INFO. Return a list of keys,
separated by commas. Return "None", if no papers are applicable. Choose papers that are relevant, from reputable sources, and
timely (if the question requires timely information).\n\nQuestion: {question}\n\nPapers: {papers}\n\nSelected keys:', 'pre':
None, 'post': None, 'system': 'Answer in a direct and concise tone. Your audience is an expert, so be highly specific. If there
are ambiguous terms or acronyms, first define them.', 'use_json': False, 'summary_json': 'Excerpt from
{citation}\n\n----\n\n{text}\n\n----\n\nQuestion: {question}\n\n', 'summary_json_system': 'Provide a summary of the relevant
information that could help answer the question based on the excerpt. Respond with the following JSON format:\n\n{{\n "summary":
"...",\n "relevance_score": "..."\n}}\n\nwhere `summary` is relevant information from text - {summary_length} words and
`relevance_score` is the relevance of `summary` to answer question (out of 10).\n'}, 'agent': {'agent_llm': 'gpt-4o-2024-08-06',
'agent_llm_config': None, 'agent_type': 'fake', 'agent_config': None, 'agent_system_prompt': 'You are a helpful AI assistant.',
'agent_prompt': 'Use the tools to answer the question: {question}\n\nThe {gen_answer_tool_name} tool output is visible to the
user, so you do not need to restate the answer and can simply terminate if the answer looks sufficient. The current status of
evidence/papers/cost is {status}', 'return_paper_metadata': False, 'search_count': 8, 'wipe_context_on_answer_failure': True,
'timeout': 500.0, 'should_pre_search': False, 'tool_names': None, 'index_concurrency': 30}, 'md5':
'd9b11506128c475035509ae3cfc1addb'}, 'docs_name': None}.
[1;31mGive Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new[0m
LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.
[1;31mGive Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new[0m
LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.
[1;31mGive Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new[0m
LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.
[1;31mGive Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new[0m
LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.
An error occurred: litellm.APIError: APIError: OpenAIException - Connection error.
Received Model Group=gpt-4o-mini
Available Model Group Fallbacks=None LiteLLM Retried: 2 times, LiteLLM Max Retries: 3
(paperqa) PS D:\Programing\paper-qa>
ishaan-jaff
jamesbraza
JamesHutchison
whitead
krrishdholakia
Kakadus
What happened?
Something about
openai==1.47.0and1.47.1breakspaper-qa's CI. Our CI (run) starts blowing up with the below error.Relevant log output
Twitter / LinkedIn details
No response