search

DoctorD1501 / JAVMovieScraper

Scrape XBMC and Kodi movie metadeta and automatically rename files for Japanese Adult Videos (JAV), American Adult DVDs, and American Adult Webcontent
GNU General Public License v2.0
748 stars 162 forks source link

Next version update? #264

Closed maddog2000 closed 5 years ago

maddog2000 commented 5 years ago

Hi Wizell. Thanks for continuing to work on this project. I noticed that you made a lot of commits 9 days ago. Do you have a date in mind of when you will release the next version of JAVMovieScraper?

Wizell commented 5 years ago

I should be able to release a new version this week. I just want to fix few more things before.

marcelhehle commented 5 years ago

Please, please, please include this enhancement: https://github.com/DoctorD1501/JAVMovieScraper/pull/231

I have a fairly big library that I can't scrape manually any more. Therefore I wrote my own scripts to do the scapring but whenever JAVMovieScarper doesn't identify the movie correctly I currently can't correct this via the cmd-line.

Wizell commented 5 years ago

A new version v0.3.6 have been published. Please feel free to test it

marcelhehle commented 5 years ago

Doesn't work on my end:

[plex@pms JAVMovieScraper]$ java -version
java version "9.0.4"
Java(TM) SE Runtime Environment (build 9.0.4+11)
Java HotSpot(TM) 64-Bit Server VM (build 9.0.4+11, mixed mode)
[plex@pms JAVMovieScraper]$ /usr/bin/java -jar /home/plex/JAVMovieScraper/JAVMovieScraper.jar  -scrape data18 Pirates.mkv
Java(TM) SE Runtime Environment 9.0.4+11(Oracle Corporation) -- 9(Oracle Corporation)
Heap: 3 GB
Free mem: 246 MB
Scraping with scraper = data18
Filename =  Pirates.mkv
Parsing with parsing profile = class moviescraper.doctord.controller.siteparsingprofile.specific.Data18MovieParsingProfile
Scraping this webpage for movie: http://www.data18.com/movies/1125779
Number of Thumbs: 35
Movie scraped asMovie [title=Title [title="Porno Pirates On the Pacific" source="Data18Movie"], originalTitle=OriginalTitle [originalTitle="" source="Data18Movie"], sortTitle=SortTitle [sortTitle="" source="Data18Movie"], set=Set [set="" source="Data18Movie"], rating=Rating [maxRating="0.0", rating=""  source="Data18Movie"], year=Year [year="2014" source="Data18Movie"], top250=Top250 [top250="" source="Data18Movie"], trailer = Trailer [trailer="" source="Data18Movie"], votes=Votes [votes="" source="Data18Movie"], outline=Outline [outline="" source="Data18Movie"], plot=Plot [plot="Yo ho ho and a mouthful of cum!" source="Data18Movie"], tagline=Tagline [tagline="" source="Data18Movie"], studio=Studio [studio="Hustler Video" source="Data18Movie"]releaseDate=ReleaseDate [releasedate="2014-03-28" source="Data18Movie"], runtime=Runtime [runtime="" source="Data18Movie"], posters=[Thumb [thumbURL=https://i.datavimg.com/covers/hustler-video/porno-pirates-on-pacific.jpg" source="Data18Movie"]], fanart=[Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/01.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/02.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/03.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/04.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/05.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/06.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/07.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/20.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/21.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/22.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/23.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/24.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/25.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/26.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/40.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/41.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/42.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/43.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/44.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/45.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/46.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/60.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/61.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/62.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/63.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/64.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/65.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/66.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/80.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/81.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/82.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/83.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/84.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/85.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/86.jpg" source="Data18Movie"]], extrafanart = [Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/01.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/02.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/03.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/04.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/05.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/06.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/07.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/20.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/21.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/22.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/23.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/24.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/25.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/26.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/40.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/41.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/42.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/43.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/44.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/45.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/46.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/60.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/61.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/62.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/63.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/64.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/65.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/66.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/80.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/81.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/82.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/83.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/84.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/85.jpg" source="Data18Movie"], Thumb [thumbURL=https://i5.datavimg.com/pics/7/125779/86.jpg" source="Data18Movie"]], mpaa=MPAARating [MPAARating="XXX" source="Data18Movie"], id=ID [id="" source="Data18Movie"], genres=[Genre [genre="5 Scenes" source="Data18Movie"], Genre [genre="Cosplay" source="Data18Movie"]], tags=[], actors=[Actor [role="null", Person [name="Bailey Blue", thumb=Thumb [thumbURL=https://i.datavimg.com/images/stars/120/20570.jpg" source="Default Data Item Source"]] source="Data18Movie"], Actor [role="null", Person [name="Chloe Chaos", thumb=Thumb [thumbURL=https://i.datavimg.com/images/stars/120/24727.jpg" source="Default Data Item Source"]] source="Data18Movie"], Actor [role="null", Person [name="Derrick Pierce", thumb=Thumb [thumbURL=https://i.datavimg.com/images/stars/120/9227.jpg" source="Default Data Item Source"]] source="Data18Movie"], Actor [role="null", Person [name="Jessica Ryan", thumb=Thumb [thumbURL=https://i.datavimg.com/images/stars/120/24510.jpg" source="Default Data Item Source"]] source="Data18Movie"], Actor [role="null", Person [name="Karmen Karma", thumb=Thumb [thumbURL=https://i.datavimg.com/images/stars/120/24437.jpg" source="Default Data Item Source"]] source="Data18Movie"], Actor [role="null", Person [name="Kurt Lockwood", thumb=Thumb [thumbURL=https://i.datavimg.com/images/stars/120/5942.jpg" source="Default Data Item Source"]] source="Data18Movie"], Actor [role="null", Person [name="Marco Banderas", thumb=Thumb [thumbURL=https://i.datavimg.com/images/stars/120/9909.jpg" source="Default Data Item Source"]] source="Data18Movie"], Actor [role="null", Person [name="Mia Lelani", thumb=Thumb [thumbURL=https://i.datavimg.com/images/stars/120/1131.jpg" source="Default Data Item Source"]] source="Data18Movie"], Actor [role="null", Person [name="Nick Manning", thumb=Thumb [thumbURL=https://i.datavimg.com/images/stars/120/6469.jpg" source="Default Data Item Source"]] source="Data18Movie"], Actor [role="null", Person [name="Tyler Nixon", thumb=Thumb [thumbURL=https://i.datavimg.com/images/stars/120/23774.jpg" source="Default Data Item Source"]] source="Data18Movie"]], directors=[]]
Exception in thread "main" java.lang.NullPointerException
    at java.base/java.io.File.<init>(File.java:276)
    at moviescraper.doctord.Main.writeMovieToFile(Main.java:249)
    at moviescraper.doctord.Main.runScrape(Main.java:220)
    at moviescraper.doctord.Main.main(Main.java:114)
[plex@pms JAVMovieScraper]$ /usr/bin/java -jar /home/plex/JAVMovieScraper/JAVMovieScraper.jar  -scrapeurl http://www.data18.com/movies/123748
Java(TM) SE Runtime Environment 9.0.4+11(Oracle Corporation) -- 9(Oracle Corporation)
Heap: 3 GB
Free mem: 246 MB
[plex@pms JAVMovieScraper]$

I can neither use -scrape nor -scrapeurl. Tried with OpenJDK 1.8.0, JDK 9.0.4 and JRE 1.8.0.. I suspect that it's a problem with my setup, but I can't narow it down ...

marcelhehle commented 5 years ago

Did a fresh install of JRE 1.8.0. Now I can scrape successfully, but -scrapeurl returns like above without any feedback or action

[plex@pms JAVMovieScraper]$ java -jar ./JAVMovieScraper.jar -scrapeurl www.data18.com/movies/123748 
Java(TM) SE Runtime Environment 1.8.0_191-b12(Oracle Corporation) -- 1.8(Oracle Corporation)
Heap: 3 GB
Free mem: 236 MB
[plex@pms JAVMovieScraper]$