API not updated

[lucius100]

I think there's some structure changed on the website that cause some functions of the scraper fails, for now I only use /search to do the api request, the other not tested yet.

javlibrary working fine but no screenshots scraped.

javdb all function is working

javdatabase and r18 not working at all, even though the jav code is valid on the site, it said not found on the logs contain a lot of none type error. I also provided login on the environment , javdatabase still failed.

[iamrony777]

Could you please provide logs/screenshots of the errors? I'll look into this. Additionally, could you confirm if you are on branch 'v3'? If not, please switch to branch 'v3' only, as the previous scrapers are returning errors and are not efficient.

[lucius100]

Could you please provide logs/screenshots of the errors? I'll look into this. Additionally, could you confirm if you are on branch 'v3'? If not, please switch to branch 'v3' only, as the previous scrapers are returning errors and are not efficient.

I already try redownload multiple times, I clone the repo directly git clone https://github.com/iamrony777/javinfo-api.git

so I am sure it's the latest v3 , below is the error log, don't know why it still request data from dead r18.com, although I can see that in providers/r18.py already used r18.dev

_javinfo-api_logs.txt

r18 response code

https://i.postimg.cc/0yCr7QFb/image.png

javlibrary response code

{
  "id": "EBOD-391",
  "title": "Breast Milk Real Gal Married Emma NozomiSaki",
  "poster": "https:https://pics.dmm.co.jp/mono/movie/adult/ebod391/ebod391pl.jpg",
  "page": "https://www.javlibrary.com/en/?v=javlijzd7i",
  "details": {
    "director": "Minami★Haou",
    "release_date": "2014-08-13",
    "runtime": "120",
    "studio": "E-BODY",
    "user_rating": "8.00"
  },
  "actress": [
    {
      "name": "Ema Kisaki",
      "image": "https://www.boobpedia.com/wiki/images/6/64/Ema_Kisaki.jpg",
      "also_known_as": "Haruki Kato, HARUKI",
      "born": "1989-08-30",
      "measurements": "95-62-89cm",
      "cup_size": "G",
      "boob_type": "Enhanced"
    }
  ],
  "screenshots": [],
  "tags": [
    "Solowork",
    "Gal",
    "Big Tits",
    "Breast Milk",
    "Nasty, Hardcore",
    "Slender"
  ]
}

[iamrony777]

From the logs I can confirm you aren't using v3 branch. And also this response structure is from previous versions

check the output of git branch --show, it should return v3

Expected Logs with installation process:

Expected output of /search?code=EBOD-391

{
  "id": "EBOD-391",
  "title": "Real Breast Milk Married Woman - Ema Kisaki",
  "title_ja": null,
  "page": "https://javdatabase.com/movies/ebod-391/",
  "poster": "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391pl.jpg",
  "preview": null,
  "details": {
    "director": "Hao * Minami",
    "release_date": "2014-08-09",
    "runtime": "119",
    "studio": "E-BODY"
  },
  "actress": [
    {
      "name": "Ema Kisaki (HARUKI",
      "image": "https://www.javdatabase.com/idolimages/thumb/ema-kisaki-haruki.webp"
    },
    {
      "name": "Haruki Kato",
      "image": "https://www.javdatabase.com/idolimages/thumb/haruki-kato.webp"
    }
  ],
  "screenshots": [
    "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391jp-1.jpg",
    "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391jp-2.jpg",
    "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391jp-3.jpg",
    "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391jp-4.jpg",
    "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391jp-5.jpg",
    "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391jp-6.jpg"
  ],
  "tags": [
    "Big Tits",
    "Breast Milk",
    "Featured Actress",
    "Gal",
    "Hi-Def",
    "Nymphomaniac",
    "Slender"
  ]
}

[lucius100]

From the logs I can confirm you aren't using v3 branch. And also this response structure is from previous versions

check the output of git branch --show, it should return v3

Expected Logs with installation process:

Expected output of /search?code=EBOD-391

{
  "id": "EBOD-391",
  "title": "Real Breast Milk Married Woman - Ema Kisaki",
  "title_ja": null,
  "page": "https://javdatabase.com/movies/ebod-391/",
  "poster": "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391pl.jpg",
  "preview": null,
  "details": {
    "director": "Hao * Minami",
    "release_date": "2014-08-09",
    "runtime": "119",
    "studio": "E-BODY"
  },
  "actress": [
    {
      "name": "Ema Kisaki (HARUKI",
      "image": "https://www.javdatabase.com/idolimages/thumb/ema-kisaki-haruki.webp"
    },
    {
      "name": "Haruki Kato",
      "image": "https://www.javdatabase.com/idolimages/thumb/haruki-kato.webp"
    }
  ],
  "screenshots": [
    "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391jp-1.jpg",
    "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391jp-2.jpg",
    "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391jp-3.jpg",
    "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391jp-4.jpg",
    "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391jp-5.jpg",
    "https://pics.dmm.co.jp/digital/video/ebod00391/ebod00391jp-6.jpg"
  ],
  "tags": [
    "Big Tits",
    "Breast Milk",
    "Featured Actress",
    "Gal",
    "Hi-Def",
    "Nymphomaniac",
    "Slender"
  ]
}

[iamrony777]

Now that's strange what's the output of ls -l from top dir

Expected:

[lucius100]

Now that's strange what's the output of ls -l from top dir

Expected:

I know what's wrong now, the latest doesn't work for me. All setup and no error in the logs, but after navigate to the site at port 3000, nothing happen, got 503 error gateway

only the old one working for me by using docker compose

wget https://raw.githubusercontent.com/iamrony777/javinfo-api/main/docker-compose.yml wget https://raw.githubusercontent.com/iamrony777/javinfo-api/main/.env.sample -O ".env"

no wonder I keep having old version. I will just wait until the latest got pushed into the docker hub image, the old one still using this version

image: iamrony777/javinfo-api:server

Edit: I tried cyclic and managed to get it up, guess I am too dumb to setup my own in my vps, Now I can see only javdatabase supported in v3.

[iamrony777]

No issues, and v3 supports all 3 provider, but returns the fastest response. In future I'll add a provider parameter like previous version.

I'll stick to serverless (fast and free)

Closing this issue now