search

iamrony777 / javinfo-api

An API to scrape Japanese adult video data from various sites
59 stars 16 forks source link

Error on javdb #28

Closed iamrony777 closed 11 months ago

iamrony777 commented 11 months ago

error

INFO:     10.220.130.11:0 - "GET /jav/search?code=KSXA-001&provider=all&includeActressUrl=true HTTP/1.1" 500 Internal Server Error
Nov 23 09:22:32 AMERRORERROR:    Exception in ASGI application
Nov 23 09:22:32 AMINFOTraceback (most recent call last):
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/uvicorn/protocols/http/h11_impl.py", line 408, in run_asgi
Nov 23 09:22:32 AMINFO    result = await app(  # type: ignore[func-returns-value]
Nov 23 09:22:32 AMINFO             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
Nov 23 09:22:32 AMINFO    return await self.app(scope, receive, send)
Nov 23 09:22:32 AMINFO           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/fastapi/applications.py", line 1106, in __call__
Nov 23 09:22:32 AMINFO    await super().__call__(scope, receive, send)
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/starlette/applications.py", line 122, in __call__
Nov 23 09:22:32 AMINFO    await self.middleware_stack(scope, receive, send)
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/starlette/middleware/errors.py", line 184, in __call__
Nov 23 09:22:32 AMINFO    raise exc
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/starlette/middleware/errors.py", line 162, in __call__
Nov 23 09:22:32 AMINFO    await self.app(scope, receive, _send)
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
Nov 23 09:22:32 AMINFO    raise exc
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
Nov 23 09:22:32 AMINFO    await self.app(scope, receive, sender)
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in __call__
Nov 23 09:22:32 AMINFO    raise e
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in __call__
Nov 23 09:22:32 AMINFO    await self.app(scope, receive, send)
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 718, in __call__
Nov 23 09:22:32 AMINFO    await route.handle(scope, receive, send)
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 276, in handle
Nov 23 09:22:32 AMINFO    await self.app(scope, receive, send)
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 66, in app
Nov 23 09:22:32 AMINFO    response = await func(request)
Nov 23 09:22:32 AMINFO               ^^^^^^^^^^^^^^^^^^^
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/fastapi/routing.py", line 274, in app
Nov 23 09:22:32 AMINFO    raw_response = await run_endpoint_function(
Nov 23 09:22:32 AMINFO                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/site-packages/fastapi/routing.py", line 191, in run_endpoint_function
Nov 23 09:22:32 AMINFO    return await dependant.call(**values)
Nov 23 09:22:32 AMINFO           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 23 09:22:32 AMINFO  File "/app/src/routes/jav.py", line 68, in search
Nov 23 09:22:32 AMINFO    response = search_all_providers(code, provider, includeActressUrl)
Nov 23 09:22:32 AMINFO               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 23 09:22:32 AMINFO  File "/app/src/__init__.py", line 43, in search_all_providers
Nov 23 09:22:32 AMINFO    result = task.result()
Nov 23 09:22:32 AMINFO             ^^^^^^^^^^^^^
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/concurrent/futures/_base.py", line 449, in result
Nov 23 09:22:32 AMINFO    return self.__get_result()
Nov 23 09:22:32 AMINFO           ^^^^^^^^^^^^^^^^^^^
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
Nov 23 09:22:32 AMINFO    raise self._exception
Nov 23 09:22:32 AMINFO  File "/usr/local/lib/python3.12/concurrent/futures/thread.py", line 58, in run
Nov 23 09:22:32 AMINFO    result = self.fn(*self.args, **self.kwargs)
Nov 23 09:22:32 AMINFO             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 23 09:22:32 AMINFO  File "/app/src/providers/javdb.py", line 140, in search
Nov 23 09:22:32 AMINFO    return self.__getJsonResult(
Nov 23 09:22:32 AMINFO           ^^^^^^^^^^^^^^^^^^^^^
Nov 23 09:22:32 AMINFO  File "/app/src/providers/javdb.py", line 57, in __getJsonResult
Nov 23 09:22:32 AMINFO    _id = page.xpath('//a[@title="Copy ID"]')[0].get('data-clipboard-text')
Nov 23 09:22:32 AMINFO          ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^
Nov 23 09:22:32 AMINFO  IndexError: list index out of range
lucius100 commented 11 months ago

I never get javdb working, the series are inside javdb site, but the return results always 404

iamrony777 commented 11 months ago

Damn

There's something wrong in logic, I'll fix in upcoming days

lucius100 commented 11 months ago

do you have any source to scrape fc2 ppv details ? I have seen many sites got the movie details for it.

iamrony777 commented 11 months ago

https://jpmag.net/