search

microsoft / graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system
https://microsoft.github.io/graphrag/
MIT License
19.21k stars 1.9k forks source link

datashaper.workflow.workflow ERROR Error executing verb "text_embed" in create_final_entities: [WinError 10061] [Bug]: <title> #650

Closed o0hailang0o closed 3 months ago

o0hailang0o commented 4 months ago

Describe the bug

No response

Steps to reproduce

No response

Expected Behavior

No response

GraphRAG Config Used

No response

Logs and screenshots

❌ create_final_entities None ⠧ GraphRAG Indexer ├── Loading Input (InputFileType.text) - 1 files loaded (0 filtered) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:00 0:00:00 ├── create_base_text_units ├── create_base_extracted_entities ├── create_summarized_entities ├── create_base_entity_graph └── create_final_entities ❌ Errors occurred during the pipeline run, see logs for more details.

Additional Information

minxiansheng commented 4 months ago

I have the same question. I read the log，and it said this question. I used local embedding model.

openai.BadRequestError: Error code: 400 - {'object': 'error', 'message': '**NETWORK ERROR DUE TO HIGH TRAFFIC. PLEASE REGENERATE OR REFRESH THIS PAGE.**\n\n(The expanded size of the tensor (513) must match the existing size (512) at non-singleton dimension 1.  Target sizes: [4, 513].  Tensor sizes: [1, 512])', 'code': 50001}
19:43:08,508 graphrag.index.reporting.file_workflow_callbacks INFO Error running pipeline! details=None
AlonsoGuevara commented 3 months ago

Hi, please provide more information about your issue. If you can provide your settings.yaml that would help to diagnose

o0hailang0o commented 3 months ago

encoding_model: cl100k_base skip_workflows: [] llm: api_key: ollama type: openai_chat model: mistral model_supports_json: true api_base: http://localhost:11434/v1

parallelization: stagger: 0.3

async_mode: threaded # or asyncio

embeddings: async_mode: threaded # or asyncio llm: api_key: lm-studio type: openai_embedding # or azure_openai_embedding model: nomic-embed-text api_base: http:/localhost:11434/api

chunks: size: 600 overlap: 100 group_by_columns: [id] # by default, we don't allow chunks to cross documents

input: type: file # or blob file_type: text # or csv base_dir: "input" file_encoding: utf-8 file_pattern: ".*\.txt$"

cache: type: file # or blob base_dir: "cache"

storage: type: file # or blob base_dir: "output/${timestamp}/artifacts"

reporting: type: file # or console, blob base_dir: "output/${timestamp}/reports"

entity_extraction: prompt: "prompts/entity_extraction.txt" entity_types: [organization,person,geo,event] max_gleanings: 0

summarize_descriptions: prompt: "prompts/summarize_descriptions.txt" max_length: 500

claim_extraction: prompt: "prompts/claim_extraction.txt" description: "Any claims or facts that could be relevant to information discovery." max_gleanings: 0

community_report: prompt: "prompts/community_report.txt" max_length: 2000 max_input_length: 8000

cluster_graph: max_cluster_size: 10

embed_graph: enabled: false # if true, will generate node2vec embeddings for nodes

umap: enabled: false # if true, will generate UMAP embeddings for nodes

snapshots: graphml: false raw_entities: false top_level_nodes: false

local_search:

global_search:

dustelf commented 3 months ago

I also have this problem sometimes

o0hailang0o commented 3 months ago

14:29:39,603 graphrag.index.verbs.text.embed.strategies.openai INFO embedding 207 inputs via 207 snippets using 13 batches. max_batch_size=16, max_tokens=8191 14:29:41,781 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"MARLEY": Marley, who was both Scrooge\'s partner, executor, administrator, assign, residuary legatee, friend, and mourner, is deceased. Although his ghost is mentioned earlier in the text, he himself is not present in this section.', '"SCROOGE": Scrooge is the main character in this text, initially portrayed as a tight-fisted, self-contained, and solitary individual who expresses disdain for Christmas and lacks concern for the poor and destitute. He works alone on Christmas Eve and interacts with his nephew and two gentlemen. Scrooge experiences various emotions throughout the text, including fear and agony in a dark, empty house, as he undergoes a series of strange events and encounters ghosts.\n\nHe is visited by a ghost at midnight, which shows him Marley\'s face in the knocker, and later encounters three spirits: the Ghost of Christmas Past, the Ghost of Christmas Present, and the Ghost of Christmas Yet to Come. These spirits take Scrooge on a journey through his past, present, and future, showing him scenes and places that help him understand the consequences of his actions and the importance of kindness and generosity.\n\nThroughout this journey, Scrooge\'s behavior towards Bob Cratchit changes, becoming kinder, and he raises Bob\'s salary. He extends kindness and generosity to an old gentleman and has a conversation with the Ghost about his former self and his clerk. Scrooge also questions the Spirit about its actions on Christmas Day and recognizes familiar places as he walks with the Ghost.\n\nAfter this transformative experience, Scrooge wakes up in the middle of the night and carries out new-born resolutions, becoming a kinder and more compassionate person. He is shown to be the main character who undergoes a transformation during Christmas, interacting with spirits and learning about the future, and ultimately emerging as a changed individual who values Christmas and the wellbeing of others.', '"OLD MARLEY":"Old Marley is mentioned as a deceased partner of Scrooge\'s business."', '"SCROOGE AND MARLEY":"Scrooge and Marley is the name of the business partnership between Scrooge and Old Marley."', '"ST. PAUL\'S CHURCHYARD":', '"THE STORY OF HAMLET":', '"SCROOGE\'S CLERK":"Scrooge\'s Clerk is a subordinate character who works for Scrooge."', '"LORD MAYOR":"The Lord Mayor gives orders for his household to celebrate Christmas."', '"ST. DUNSTAN":"If St. Dunstan had used the cold weather instead of his weapons, he would have roared to lusty purpose."', '"THE SINGER":', '"EVIL SPIRIT":', '"HIS FIFTY COOKS AND BUTLERS":', '"THE KEYHOLE":', '"THE OWNER OF ONE SCANT YOUNG NOSE":', '"SCROOGE\'S KEYHOLE":', '"MARLEY\'S FACE":"Marley\'s face is a memory that haunts Scrooge, despite being seven years dead."']} 14:29:43,815 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"OLD DUTCH MERCHANT":"The Old Dutch Merchant is the person who built the house with the quaint Dutch tiles."', '"DUTCH TILES":"The Dutch Tiles are decorative tiles in Scrooge\'s fireplace, depicting various scenes from the Scriptures."', '"HUMBUG!":"Humbug! is a phrase exclaimed by Scrooge after seeing the bell begin to swing."', '"DISUSED BELL":"The Disused Bell is an object in Scrooge\'s room that begins to swing mysteriously."', '"MARLEY\'S GHOST": "Marley\'s Ghost, a supernatural entity, is known for appearing to Ebenezer Scrooge. This apparition, which has been causing some disturbance in Scrooge\'s life, is the ghost of Jacob Marley, a former business partner of Scrooge."', '"EBENEZER SCROOGE": Ebenezer Scrooge, the central figure in Charles Dickens\' classic novel "A Christmas Carol," is a prominent character known for his role in this timeless story.', '"SCROOGE\'S ROOM": In "Scrooge\'s Room," a significant encounter occurs as Ebenezer Scrooge is visited by Marley\'s Ghost, marking a pivotal moment in the event that unfolds within this space.', '"JACOB MARLEY":"Jacob Marley is a deceased partner of Scrooge."', '"GHOST": The Ghost, a supernatural entity, serves as an unearthly visitor and guide for Ebenezer Scrooge in Charles Dickens\' classic tale, A Christmas Carol. This spectral being appears to Scrooge with the purpose of delivering a message about the importance of compassion and helping others. Throughout the narrative, the Ghost teaches Scrooge lessons by leading him on a walk through his past, allowing Scrooge to reflect upon his life choices and their consequences. Ultimately, the Ghost\'s role is instrumental in transforming Scrooge into a more empathetic and generous individual.', '"COUNTING-HOUSE":"The Counting-house is the place where Scrooge works."', '"PHANTOMS":"Phantoms are the spirits of deceased people who wander aimlessly and moan."', '"INVISIBLE WORLD":"The Invisible World is a supernatural realm that Scrooge glimpses."', '"CHURCH": The Church, a significant locale, serves as a place where individuals gather and in this case, it is notable as the location where Bob hopes to be seen by others. Additionally, it is also the source of the chimes that awaken Scrooge, suggesting a historical or symbolic significance associated with these sounds.', '"FOG":"The fog is a geographical condition outside Scrooge\'s window."', '"ICICLE":"An icicle that may have gotten into the works of Scrooge\'s clock."', '"FIRST OF EXCHANGE PAY":"A financial event that would be affected if there were no days to count by."']} 14:29:45,859 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"THE BOY FROM OVER THE WAY": The Boy From Over The Way is a person who, during the celebration, is believed to be in hiding due to suspicions that he may lack sufficient boarding from his master. This suggests that he might have run away or be avoiding his responsibilities, but it\'s important to note that these are only speculations.', '"ZZIWIG":"zziwig is an organization where a celebration is taking place."', '"MISS FEZZIWIGS":"Miss Fezziwigs are beaming and lovable individuals who are part of the celebration."', '"THE SIX YOUNG FOLLOWERS":"The six young followers are individuals whose hearts were broken during the celebration."', '"THE HOUSEMAID":"The housemaid is an individual who is part of the business at zziwig."', '"THE BAKER":"The baker is a relative of the housemaid who is also present at the celebration."', '"THE COOK":"The cook is an individual who works in the business and is part of the celebration."', '"HER BROTHER\'S PARTICULAR FRIEND THE MILKMAN":"The milkman is a friend of the cook\'s brother and is also present at the celebration."', '"THE GIRL FROM NEXT DOOR BUT ONE":"The girl from next door but one is an individual who was proved to have had her ears pulled by her mistress and is present at the celebration."', '"ALL THE YOUNG MEN AND WOMEN EMPLOYED IN THE BUSINESS":"All the young men and women employed in the business are individuals who work for zziwig and are part of the celebration."', '"THE EVENT":"The event is a celebration taking place at zziwig."', '"GIRL":"The beautiful young girl in the first scene is later seen as a comely matron with her daughter."', '"DAUGHTER":"The daughter of the comely matron is involved in sports with other children."', '"THE MOTHER AND DAUGHTER":"The mother and daughter are involved in the sports and laughter, indicating their participation."', '"THE FATHER":"The father comes home with Christmas toys and presents, showing his role as a provider."', '"CHRISTMAS": Christmas, as depicted in the given data, is a significant occasion that is traditionally associated with the giving of toys and presents. This festive event serves as a backdrop for various narratives, including the one mentioned in the provided passage.']} 14:29:47,914 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"HOME":"Home" is the location where Master Scrooge is being taken by his sister.', '"SCHOOLMASTER":"The schoolmaster is the person who teaches the children."', '"POSTBOY":"The postboy is a messenger who delivers something to Master Scrooge."', '"CHRISTMAS-TIME":"Christmas-time refers to the holiday season."', '"WAREHOUSE":"The warehouse is a building where goods are stored."', '"SCROOGE (FORMER SELF)":', '"FEZZIWIG": Fezziwig is a charismatic and skilled individual, renowned for his dancing abilities and leadership qualities. He possesses the unique ability to effectively manage large groups, making him an ideal host or organizer. Notably, he owns the warehouse where the event in question is being held.', '"DICK WILKINS": Dick Wilkins is an individual who accompanied Ebenezer, suggesting that he may have been associated with or related to the character in some capacity.', '"EBENEZER":"Ebenezer is a person who is being addressed by Fezziwig."', '"CHRISTMAS EVE":"Christmas Eve is the specific day on which the event is happening."', '"SCROOGE\'S FORMER SELF":', '"THE WAREHOUSE":', '"THE YOUNG MEN AND WOMEN EMPLOYED IN THE BUSINESS":', '"MRS. FEZZIWIG":', '"THE THREE MISS FEZZIWIGS":', '"THE HOUSEMAID, WITH HER COUSIN THE BAKER":']} 14:29:49,959 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"BOB": Bob, a dedicated employee of Scrooge, is a person of affectionate nature, particularly towards Tiny Tim. He vigorously defends Scrooge, acknowledging him as the founder of a grand feast. His physical condition may be a factor influencing his desire to be seen in church. Additionally, he receives an increase in his salary from Scrooge.', '"TINY TIM": Tiny Tim, a child in the Cratchit family, is known for his disability but is also deeply cherished by Bob and the others. Despite initially being a cause for concern, he is growing strong and hearty. Contrary to some beliefs, Tiny Tim does not show any particular interest in the toast made in his honor.', '"MRS. CRATCHIT": Mrs. Cratchit, being a member of the Cratchit family, is primarily known for her role as Bob\'s wife and the one responsible for preparing the pudding during their festive gatherings. She shares a positive perspective towards an enigmatic individual, aligning with Bob\'s sentiments. However, she also harbors a strong dislike towards Ebenezer Scrooge, expressing a desire to confront him. This complex portrayal suggests a multifaceted character within the narrative.', '"CRATCHIT FAMILY":"The Cratchit Family is the group consisting of Mrs. Cratchit, Bob Cratchit, and their children."', '"DINNER":"Dinner is the meal being prepared and consumed by the Cratchit family."', '"FUTURE": The term "Future" denotes a concept that encompasses the events or time period that transpires subsequent to the present moment, regardless of whether it is being discussed within the context of real-life scenarios or a narrative. This temporal construct signifies a progression beyond the current state of affairs, implying change and development.', '"HEAVEN":"Heaven is a spiritual or divine realm."', '"INSECT":"An insect is a small invertebrate animal."', '"DUST":"Dust refers to the earth or ground."', '"SURPLUS POPULATION":"Surplus population refers to an excess number of people."', '"PETER CRATCHIT":"Peter Cratchit is mentioned as potentially becoming a man of business."', '"MINERS":"Miners are a group of people who work in the bowels of the earth, living in a desolate place."', '"OLD MAN":"The old man is singing a Christmas song to the group."', '"SCROOGE\'S NEPHEW": Scrooge\'s Nephew, though not explicitly named in the text, can be inferred as the owner of the house where Scrooge visits. He is a member of the family and was having a conversation with Scrooge\'s niece. During the festivities of Christmas, he proposed a toast to Uncle Scrooge, indicating a familial bond. Despite not being directly quoted, his laughter suggests a hearty participation in the celebrations. He is also described as a comical old fellow who expresses his views about Scrooge.', '"SCROOGE\'S NIECE": At the gathering, Scrooge\'s Niece actively engages in games with the other guests, demonstrating her social inclination. Simultaneously, she maintains a familial connection, engaging in a conversation with Scrooge\'s nephew. This interaction is not one-sided, as she also laughs along with him and defends his position when necessary, indicating a supportive and empathetic demeanor towards her family member.', '"FRIENDS":"Friends are the people who roar out lustily when they hear Scrooge\'s nephew laughing."']} 14:29:52,17 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"MISERY\'S EVERY REFUGE":"This refers to all the places where misery can be found, such as almshouses, hospitals, and gaols."', '"IGNORANCE":9', '"WANT":10', '"PHANTOM":"The Phantom is a mysterious entity that stands beside Scrooge."', '"BUSY SCENE":"Busy Scene refers to the bustling area left by Scrooge and the Phantom."', '"OBSCURE PART OF TOWN":"Obscure Part of Town is a secluded, crime-ridden area where Scrooge has never been before."', '"LOW-BROWED SHOP":"Low-Browed Shop is the den of infamous resort where Scrooge and the Phantom go."', '"GREY-HAIRED RASCAL":"Grey-Haired Rascal is the old man who runs the low-browed shop."', '"WOMAN WITH A HEAVY BUNDLE":"Woman with a Heavy Bundle is one of the people who enter the low-browed shop."', '"LAUNDRESS": The Laundress, as depicted in the given context, is an individual who visits a low-browed establishment and is among the characters featured in the text.', '"UNDERTAKER\'S MAN": The Undertaker\'s Man is a character mentioned in the given context, who makes an appearance in a specific location - a low-browed shop. This individual plays a role within the narrative, contributing to its development.', '"ALL THREE":"All three refers to the group of characters in the text, which includes a charwoman, a laundress, and an undertaker\'s man."', '"CHARWOMAN":"The charwoman is one of the characters in the text."', '"MRS. DILBER": Mrs. Dilber is a character in the text, who is also identified as a person who receives sheets, towels, and other items as her share of the plunder, suggesting that she may have been involved in the acquisition or distribution of these goods. However, it remains unclear whether she specifically holds the role of the charwoman within this context.', '"JOE": Joe, a person, is significantly engaged in two distinct contexts. Firstly, he is actively participating in discussions regarding a deceased individual. This involvement suggests a role that could be emotional, informational, or perhaps even investigative, given the nature of the topic. Secondly, he is also involved in the distribution of plunder among a group. This role implies that he holds a position of authority or influence within this collective, and is entrusted with the responsibility to allocate resources or rewards. The contradiction between these roles does not appear to be resolvable within the provided data, as they seem unrelated and do not inherently conflict with one another.', '"FIRST WOMAN": The First Woman is a significant individual who actively participates in the given discourse. Notably, she is also identified as the person who petitions Joe to unveil her collection of loot or plunder.']} 14:29:54,46 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"THE CHILDREN":', '"MR. SCROOGE":"Mr. Scrooge is a character who is visited by the Ghost of Christmas Past."', '"BELLE":"Belle is the daughter of the person Mr. Scrooge visited."', '"SCROOGE\'S PARTNER":"Scrooge\'s Partner is ill and may be dying."', '"SECOND VISIT OF THE THREE SPIRITS":', '"GHOSTLY LIGHT":"The ghostly light is a strange and alarming event for Scrooge."', '"ADJOINING ROOM":"The adjoining room is the location from where the ghostly light seems to originate."', '"STRANGE VOICE":"The strange voice calls Scrooge by his name and bids him enter."', '"JOLLY GIANT":"The jolly Giant is a new character who sits on a heap of food in Scrooge\'s room."', '"GHOST OF CHRISTMAS PRESENT": The Ghost of Christmas Present is a supernatural entity, specifically appearing to Ebenezer Scrooge in Charles Dickens\' classic novel, A Christmas Carol. This ethereal figure serves as one of the three spirits guiding Scrooge through his past, present, and future experiences on Christmas Eve.', '"CHRISTMAS MORNING":"Christmas Morning is the setting for this text, where people are shoveling snow from their houses."', '"PEOPLE": People, as described, are a group of individuals who can be found shoveling snow from rooftops, suggesting their resilience and resourcefulness in the face of harsh weather conditions.', '"BAKERS":"Bakers are mentioned as the providers of dinners for the people."', '"SPIRIT": The Spirit, referred to as an unseen entity, plays a significant role in the narrative by communicating with Ebenezer Scrooge. This interaction serves a crucial purpose within the storyline.', '"BOB CRATCHIT": Bob Cratchit, a central character in Charles Dickens\' "A Christmas Carol," is primarily recognized as Scrooge\'s employee. However, he also holds a more complex relationship with Scrooge, as he is a member of a family whose debt was owed to Ebenezer Scrooge. Despite this financial connection, Bob Cratchit plays an important role in the story, being mentioned as part of the dinner gathering and serving as a father figure within his own family, the Cratchits. Additionally, during the narrative, Bob Cratchit is visited by the Ghost of Christmas Present. This multi-faceted portrayal highlights Bob Cratchit\'s significant role in the story, demonstrating both his professional and personal connections to Scrooge.', '"MARTHA": Martha, a person with a focus on her work, openly discusses her projects and future plans. However, she exhibits a peculiar behavior of hiding when her father arrives home. This suggests that she may have a complex relationship with her father, possibly feeling the need to conceal herself from him for reasons not explicitly stated in the provided data.']} 14:29:56,65 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"VISITATION": The "VISITATION" in question is a significant event expected by Scrooge, which is to occur at the stroke of one o\'clock as indicated by the tolling of a bell.', '"MIDNIGHT":', '"GHOST OF CHRISTMAS PAST": The Ghost of Christmas Past is a supernatural entity that manifests in the narrative and appears to Ebenezer Scrooge. Despite some ambiguity, it is not an organization.', '"CHRISTMAS PAST":"Christmas Past is the time period that the Ghost of Christmas Past represents."', '"SCROOGE\'S WELFARE":', '"SCROOGE\'S RECLAMATION":"Scrooge\'s Reclamation is the potential change in Scrooge\'s behavior or attitude."', '"CITY":"The City is the place where Scrooge lived and worked, but it disappears during his journey with the Ghost."', '"OPEN COUNTRY ROAD":"An open country road is the location where Scrooge and the Ghost walk together."', '"FIELDS":"Fields are the areas of land on either side of the open country road that Scrooge and the Ghost pass by."', '"LITTLE MARKET-TOWN":"A little market-town appears in the distance during Scrooge\'s walk with the Ghost."', '"SCHOOL":"A solitary child is left at a school that Scrooge recognizes."', '"MANSION OF DULL RED BRICK":"A large, dilapidated mansion that Scrooge and the Ghost approach."', '"DREARY HALL":"The dreary hall is poorly furnished, cold, and vast."', '"MASTER SCROOGE": Master Scrooge, the central figure, is both being escorted home by his sister and serves as the primary character who encounters a ghost in the narrative.', '"LITTLE FAN":"Little Fan is the younger sister of Master Scrooge, bringing him home."', '"FATHER":"Father" is the person who has become kinder and allowed Master Scrooge to return home.']} 14:29:58,115 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"SCROOGE\'S NIECE\'S SISTERS":"Scrooge\'s niece\'s sisters refers to the group that includes Scrooge\'s niece and her other sisters."', '"GEO":"Geo is not explicitly mentioned in the text, but it could refer to a geographical location or setting."', '"TOPPER":None', '"PLUMP SISTER":None', '"YES AND NO GAME":"The Yes and No game is a game where Scrooge\'s nephew thinks of something and the others try to guess it based on yes or no answers."', '"ANIMAL":"The animal that Scrooge\'s nephew is thinking of is a live, disagreeable, savage, growling and grunting, London-dwelling, unshown, not killed in a market, and not a horse, ass, cow, bull, tiger, dog, pig, cat, or bear."', '"LONDON":"London is the city where the animal lives."', '"UNCLE SCROOGE":"Uncle Scrooge is the subject of admiration and merriment in this passage."', '"FRED": Fred, a relative to Scrooge, serves as both Scrooge\'s nephew-in-law and the nephew of Uncle Scrooge. He frequently voices his admiration for his uncle.', '"NEW YEAR":"The passage also mentions the New Year."', '"ADMIRATION":', '"CHILDREN":"The children are shown to Scrooge by the Ghost."', '"TWELFTH-NIGHT PARTY":"A Twelfth-Night party is a festive event held on the evening of the Twelfth Night, which is the last night of the Christmas season."', '"ALMSHOUSE":"An almshouse is a charitable institution that provides shelter, food, and sometimes other forms of assistance to the poor."', '"HOSPITAL":"A hospital is an institution providing medical care and treatment for the ill or injured."', '"GAOL":"A gaol, also spelled jail, is a place where people are confined as punishment for crimes they have committed."']} 14:30:00,160 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"BED-CURTAINS":"Bed-curtains are an object that the first woman takes out of her bundle of plunder."', '"PLUNDER":', '"OLD JOE\'S LAMP":"Old Joe\'s Lamp" refers to the location where the conversation takes place.', '"DISCUSSION ABOUT A DECEASED INDIVIDUAL":', '"DECEASED INDIVIDUAL":', '"DEATH":"Death is personified as an entity that has dominion over the deceased man."', '"THE DECEASED MAN":"The Deceased Man is the individual whose body is lying on a bed in the text."', '"MOTHER":"The Mother is a person who is anxiously waiting for her husband."', '"HUSBAND":"The Husband is a person who has come home with bad news."', '"CAROLINE":"Caroline is the wife of Ebenezer Scrooge."', '"DEBT":"The debt owed by Bob Cratchit to Ebenezer Scrooge."', '"PETER": Peter, a person, exhibits a sense of skepticism towards his future prospects, yet he also ventures to a dwelling where he encounters the mother and children.', '"CRATCHIT\'S WIFE":"Cratchit\'s wife is a person who lays her work upon the table."', '"LITTLE BOB":"little Bob is a person who comes in with his comforter."', '"FIRST PARTING":"First Parting refers to the separation of the characters."', '"SCROOGE\'S PLACE OF OCCUPATION":"Scrooge\'s Place of Occupation is where Scrooge works."']} 14:30:02,203 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"BOB\'S":"Bob\'s is a location to which something is being sent, but it is not clear what."', '"CAMDEN TOWN":"Camden Town is a geographical location mentioned in the text."', '"THE POULTERER\'S MAN":"The poulterer\'s man is a person who delivers something to Scrooge."', '"THE TURKEY":"The turkey is an event in which Scrooge receives a turkey."', '"CAB":"Cab is a mode of transportation mentioned in the text."', '"THE BOY":"The boy is a person who receives payment from Scrooge."', '"THE STREETS":"The streets are the location where Scrooge walks."', '"THE PORTLY GENTLEMAN":"The portly gentleman is a person whom Scrooge meets on the street."', '"OLD GENTLEMAN":"The Old Gentleman is the recipient of Scrooge\'s kindness and generosity."', '"SCROOGE\'S NEPHEW\'S HOUSE":"Scrooge\'s Nephew\'s House is the location where Scrooge visits his nephew."', '"CHARLES DICKENS"|>, "PERSON")("ENTITY":"Project Gutenberg"|>, "organization")("relationship"', '"PROJECT GUTENBERG": "Project Gutenberg is an organization primarily known for its association with electronic works, specifically those that are freely accessible and distributed."', '"THE FOUNDATION":"The Foundation (PGLAF)"', '"PROJECT GUTENBERG LITERARY ARCHIVE FOUNDATION": The Project Gutenberg Literary Archive Foundation (PGLAF), serves as the proprietor of the Project Gutenberg trademark. It is identified as the entity owning this intellectual property.', '"FOUNDATION":"The Foundation (PGLAF)"', '"PROJECT GUTENBERG�": The "Project Gutenberg Literary Archive Foundation" is the entity behind "Project Gutenberg�," a registered trademark. This organization, known as "Project Gutenberg�," specializes in producing and distributing eBooks. Specifically, it provides electronic works under certain conditions, making them accessible to readers worldwide.']} 14:30:04,224 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"UNITED STATES": The United States, a distinct geographical entity, serves as the jurisdiction where copyright laws are enforced and applied. It is simply referred to as "The United States."', '"PUBLIC DOMAIN":"A work being in the public domain in the United States."', '"INDIVIDUAL WORK":', '"UNITED STATES COPYRIGHT LAW":"United States copyright law."', '"YOU":"The reader or user of a Project Gutenberg� electronic work."', '"AGREE":"Agreeing to comply with the terms of this agreement."', '"TERMS OF THIS LICENSE AND INTELLECTUAL PROPERTY (TRADEMARK/COPYRIGHT) AGREEMENT":"Terms of this license and intellectual property (trademark/copyright) agreement."', '"CEASE USING AND RETURN OR DESTROY ALL COPIES":"Ceasing to use and returning or destroying all copies of Project Gutenberg� electronic works in your possession."', '"REFUND":"Obtaining a refund from the person or entity to whom you paid the fee as set forth in paragraph 1.E.8."', '"PROJECT GUTENBERG� ELECTRONIC WORKS":"Project Gutenberg� electronic works."', '"AGREEING TO COMPLY WITH THE TERMS SET BY PROJECT GUTENBERG":"Agreeing to comply with the terms set by Project Gutenberg."', '"COMPLY":"Compliance with the terms of this agreement."', '"READER OR USER":"The reader or user of a Project Gutenberg� electronic work."', '"USE":"Using a Project Gutenberg� electronic work.""Use of a Project Gutenberg� electronic work by the reader or user."', '"WORK":"A Project Gutenberg� electronic work.""A work being provided by Project Gutenberg."', '"PROVIDE":"Providing access to knowledge for all through a Project Gutenberg� electronic work by Project Gutenberg.""Providing a Project Gutenberg� electronic work."']} 14:30:06,253 graphrag.index.reporting.file_workflow_callbacks INFO Error Invoking LLM details={'input': ['"INTENDED":"Intended use of a Project Gutenberg� electronic work by the reader or user."', '"BENEFIT":"Benefiting from a Project Gutenberg� electronic work by the reader or user.""Benefiting from a Project Gutenberg� electronic work by the reader or user."<', '"AIMS":"Aiming to benefit the reader or user of a Project Gutenberg� electronic work by Project Gutenberg."', '"STRIVE":"Striving to benefit the reader or user of a Project Gutenberg� electronic work by Project Gutenberg."', '"ENDEAVOR":"Endeavoring to benefit the reader or user of a Project Gutenberg� electronic work by Project Gutenberg."', '"SEEK":"Seeking to benefit the reader or user of a Project Gutenberg� electronic work by Project Gutenberg."', '"ASPIRE":"Aspiring to benefit the reader or user of a Project Gutenberg� electronic work by Project Gutenberg."', '"INTEND":"Intending to benefit the reader or user of a Project Gutenberg� electronic work by Project Gutenberg."', '"ENRICH":"Enriching the lives of readers and users of a Project Gutenberg� electronic work by Project Gutenberg."', '"MAKE":"Making literature accessible for all through a Project Gutenberg� electronic work by Project Gutenberg."', '"PROMOTE":"Promoting literacy and education through a Project Gutenberg� electronic work by Project Gutenberg."', '"PROJECT GUTENBERG LICENSE":"Project Gutenberg License is a term associated with the use of Project Gutenberg works."', '"COPYRIGHT HOLDER":"Copyright holder is an individual who owns the rights to a creative work."', '"U.S. COPYRIGHT LAW":"U.S. copyright law governs the use of Project Gutenberg works within the United States."', '"PROJECT GUTENBERG� TRADEMARK":"Project Gutenberg� trademark is associated with the organization and its works."']} 14:30:06,254 datashaper.workflow.workflow ERROR Error executing verb "text_embed" in create_final_entities: [WinError 10061]

natoverse commented 3 months ago

Consolidating alternate model issues to #657

yc446833448 commented 3 months ago

关于本地Ollama的支持第一个休要修改 settings.yaml image 第二需要修改graphrag/llm/openai/openai_embeddings_llm.py文件； image

yc446833448 commented 3 months ago

中国人不骗中国人，哈哈 image

yc446833448 commented 3 months ago

@luoyai 你是使用 pip install graphrag 了吧，你如果是git clone的项目源码，就不需要再去安装 pip 包，也就是我说的修改第二需要修改graphrag/llm/openai/openai_embeddings_llm.py文件；这里，你报错的是你pip 包里面这块的代码不支持本地ollama的接口

jwc19890114 commented 3 months ago

关于本地Ollama的支持第一个休要修改 settings.yaml image 第二需要修改graphrag/llm/openai/openai_embeddings_llm.py文件； image

我修改之后还是报错

我尝试了以下几种embed链接 http://localhost:11434/api http://localhost:11434/v1 http://localhost:11434/ 好像都不行都会报[WinError 10049] 在其上下文中，该请求的地址无效。

又进入_client.py查看那个完整的url，这个url在浏览器里面是404

   return self._request(
      'POST',
      '/api/embeddings',
      json={
        'model': model,
        'prompt': prompt,
        'options': options or {},
        'keep_alive': keep_alive,
      },
    ).json()
yc446833448 commented 3 months ago

@jwc19890114 graphrag/llm/openai/openai_embeddings_llm.py 需要修改这里 embedding模型请求的地方，如果是ollama的按我说的改，如果你用的openai的不需要改。本质上就是 支持 ollama的embedding模型调用方法和openapi的embedding是不一样的。纠结url地址干嘛，openapi那个包的嵌入模型本身就不兼容ollama的嵌入模型的api不是通用的