search

kshitijagrwl / chat-with-docs

A prototype for chat with your docs
MIT License
1 stars 2 forks source link

Cannot use web scraper more than once in a session #5

Open Kranium2002 opened 10 months ago

Kranium2002 commented 10 months ago

Issue Title: Cannot use web scraper more than once in a session

Description:

Error:

ERROR: Exception in ASGI application
Traceback (most recent call last):
  File "/mnt/d/Projects/chat-with-docs/venv/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 426, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  ... (rest of the traceback)
  File "/mnt/d/Projects/chat-with-docs/venv/lib/python3.10/site-packages/twisted/internet/base.py", line 843, in startRunning
    raise error.ReactorNotRestartable()
twisted.internet.error.ReactorNotRestartable

Environment:

Expected Behavior: Web scraper should run again on the specified url and give the json file for links of the documentation.

Actual Behavior: Scrapy web scraper gives error and to get to work again I have to restart the server. The error has been mentioned above.

Steps to Reproduce:

  1. Start the server by running server.py file.
  2. Make 2 consecutive requests on /getLinks with any url.
kshitijagrwl commented 10 months ago

Can use this to bypass errors caused by twisted https://github.com/itamarst/crochet

kotAPI commented 6 months ago

Instagram, Facebook, YouTube, now we got spammers on GitHub too?

ckanthony commented 6 months ago

Unfortunately it seems to be like so now. Some of my repo got this too, and they randomly tagging some others. Even if we don’t know each other, I would take this chance to wish everybody a happy new year. Don’t click on that scam link btw

Get Outlook for iOShttps://aka.ms/o0ukef

From: Pranay Kothapalli @.> Sent: Tuesday, January 2, 2024 4:39:09 PM To: kshitijagrwl/chat-with-docs @.> Cc: Anthony Chan @.>; Mention @.> Subject: Re: [kshitijagrwl/chat-with-docs] Cannot use web scraper more than once in a session (Issue #5)

Instagram, Facebook, YouTube, now we got spammers on GitHub too?

— Reply to this email directly, view it on GitHubhttps://github.com/kshitijagrwl/chat-with-docs/issues/5#issuecomment-1873738142, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAZ55RWE3MU3TQA3LJI4Y6DYMPBS3AVCNFSM6AAAAAA3ZOBTDOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNZTG4ZTQMJUGI. You are receiving this because you were mentioned.Message ID: @.***>