nZEDb / nZEDb

nZEDb - a fork of nnplus(2011) | NNTP / Usenet / Newsgroup indexer.
https://nzedb.github.io/
630 stars 182 forks source link

Error with update_binaries.php #2336

Closed DrSeussFreak closed 7 years ago

DrSeussFreak commented 7 years ago

Expected behaviour

Script updates binaries as expected

Actual behaviour

D:\www\nZEDb\misc\update>php update_binaries.php
Updating: 53 group(s) - Using compression? No [nzedb\Binaries::updateAllGroups]

Starting group 1 of 53 [nzedb\Binaries::updateAllGroups]

Processing alt.binaries.anime

New group alt.binaries.anime starting with 100,000 messages worth. Leaving 20,000 for next pass.
Server oldest: 94,859 Server newest: 360,193,060 Local newest: 0

Getting 20,000 articles (360,073,061 to 360,093,060) from alt.binaries.anime - (80,000 articles in queue).
PHP Warning:  PDOStatement::execute(): MySQL server has gone away in D:\www\nZEDb\nzedb\db\DB.php on line 591

Warning: PDOStatement::execute(): MySQL server has gone away in D:\www\nZEDb\nzedb\db\DB.php on line 591
PHP Warning:  PDOStatement::execute(): Error reading result set's header in D:\www\nZEDb\nzedb\db\DB.php on line 591

The error then repeats a lot, and finally fails with

Warning: PDOStatement::execute(): Error reading result set's header in D:\www\nZEDb\nzedb\db\DB.php on line 591
Starting release update process (2016-12-15 20:56:59)

Process Releases -> Attempting to find complete collections.
0 collections were found to be complete. Time: 0 second(s)

Process Releases -> Calculating collection sizes (in bytes).
0 collections set to filecheck = 3(size calculated)
0 second(s)

Process Releases -> Delete collections smaller/larger than minimum size/file count from group/site setting.
Deleted 0 collections:
0 smaller than, 0 bigger than, 0 with less files than site/group settings in: 0 second(s)

Process Releases -> Create releases from complete collections.
0 Collections ready to be converted to releases.

0 Releases added and 0 duplicate collections deleted in 0 second(s)

Process Releases -> Create the NZB, delete collections/binaries/parts.
0 NZBs created/Collections deleted in 0 seconds.
Total time: 0 second(s)

Process Releases -> Request ID local lookup -- limit 5000
No RequestID's to process.
0 releases updated in 0 second(s)

Process Releases -> Request ID web lookup -- limit 1000
No RequestID's to process.
0 releases updated in 0 second(s)

Process Releases -> Categorize releases.
0 second(s)

No music releases to process.
No console releases to process.
No games releases to process.
Unable to read TMDbAPI configuration, verify that the API key is validNo book releases to process for category id 3030
No book releases to process for category id 7020
Process Releases -> Delete finished collections.

Deleting collections/binaries/parts older than 72 hours.
Finished deleting 0 old collections/binaries/parts in 0 seconds.

Deleting collections that were missed after NZB creation.
Finished deleting 0 collections missed after NZB creation in 0 seconds.
Removed 0 parts/binaries/collection rows in 0 second(s)

Process Releases -> Delete releases smaller/larger than minimum size/file count from group/site setting.
Deleted 0 releases:
0 smaller than, 0 bigger than, 0 with less files than site/groups setting in: 0 second(s)

Process Releases -> Delete old releases and passworded releases.
Removed releases: 0 past retention, 0 passworded, 0 crossposted, 0 from disabled categories, 0 smaller than category settings, 0 from disabled music genres, 0 from misc->other0 from misc->hashed, 0 under 95% completion.
Completed adding 0 releases in 13.70 second(s). 1 collections waiting to be created (still incomplete or in queue for creation)

Updating movie schedule using rotten tomatoes.

Error: Unable to fetch from Rotten Tomatoes, verify your API Key.

PHP Fatal error:  Class 'nzedb\TvRage' not found in D:\www\nZEDb\misc\update\update_tvschedule.php on line 7

Fatal error: Class 'nzedb\TvRage' not found in D:\www\nZEDb\misc\update\update_tvschedule.php on line 7
Optimizing MySQL tables, should be quick...

OPTIMIZE (allgroups,anidb_episodes,anidb_info,anidb_titles,audio_data,binaries,binaryblacklist,bookinfo,categories,category_regexes,collection_regexes,collections,consoleinfo,countries,dnzb_failures,forum_posts,gamesinfo,genres,groups,invitations,logging,menu_items,missed_parts,movieinfo,musicinfo,page_contents,parts,predb,predb_hashes,predb_imports,release_comments,release_files,release_naming_regexes,release_nfos,release_search_data,release_subtitles,release_unique,releaseextrafull,releases,role_excluded_categories,settings,sharing,sharing_sites,short_groups,tmux,tv_episodes,tv_info,upcoming_releases,user_downloads,user_excluded_categories,user_movies,user_requests,user_roles,user_series,users,users_releases,video_data,videos,videos_aliases,xxxinfo)
REPAIR (allgroups,anidb_episodes,anidb_info,anidb_titles,audio_data,binaries,binaryblacklist,bookinfo,categories,category_regexes,collection_regexes,collections,consoleinfo,countries,dnzb_failures,forum_posts,gamesinfo,genres,groups,invitations,logging,menu_items,missed_parts,movieinfo,musicinfo,page_contents,parts,predb,predb_hashes,predb_imports,release_comments,release_files,release_naming_regexes,release_nfos,release_search_data,release_subtitles,release_unique,releaseextrafull,releases,role_excluded_categories,settings,sharing,sharing_sites,short_groups,tmux,tv_episodes,tv_info,upcoming_releases,user_downloads,user_excluded_categories,user_movies,user_requests,user_roles,user_series,users,users_releases,video_data,videos,videos_aliases,xxxinfo)
Optimized 60 MySQL tables successfully.

Steps to reproduce the behaviour

run php update_binaries.php

niel commented 7 years ago

This isn't a bug. It is your configuration. Which guide did you follow?

DrSeussFreak commented 7 years ago

I followed https://github.com/nZEDb/nZEDb/wiki/Install-Guide:-Windows-using-XAMPP, which I have been updating

niel commented 7 years ago

From a brief look at that guide, it has a number of problems. However I haven't used Windows in a few years and XAMPP never, so I wouldn't want to edit it myself.

DrSeussFreak commented 7 years ago

Can you let me know what the issues are, and I can update it as I get it working? That is what I've been doing thus far.

niel commented 7 years ago

1) It only deals with 32 bit versions. Nature of usenet indexing requires 64 bit integers, and files can go over 2GB (limit of 32 bit). 2) The vhost is way out of date, see the Ubuntu guide for one more upto date. 3) 'Create a file here: "d:\www\nZEDb\nzedb-update.bat"' This is a bad Idea as we have a command built in to do this (./zed update nzedb). Also, in a previous step it checked for git being in path, so hard-coding it isn't needed. 4) Adding the alias to apache vhost would not be needed if it was in the initial file at the top like in the Ubuntu guide

DrSeussFreak commented 7 years ago

Ok, doing what I was trying to avoid, creating a new Windows Install without XAMPP or WAMP and just installing all of the components manually.

niel commented 7 years ago

Setting it up manually is always the best option. If you are on Windows 10, you can use the BASH shell integration (from the anniversary update) to do it almost identically to Ubuntu. I haven't tried this as I do not have a machine with Windows installed as primary OS, but as I understand the BASH integration for Win10, it provides you with apt-get so you can follow the Ubuntu 16.04 guide. Alternatively create an Ubuntu VM. Honestly, the Linux setup is by far the best solution, (as that is how it is designed to work) so use it where/how ever you can.

DrSeussFreak commented 7 years ago

I tried 1 last time with WAMP (which unlike XAMPP, does have a 64-bit flavor), and was able to get it working without issue (thus far). I created yet another new page to document it, it is https://github.com/nZEDb/nZEDb/wiki/Install-Guide:-Windows-using-WAMP. Fingers crossed it remains functional.