search

ShokoAnime / ShokoServer

Repository for Shoko Server.
https://shokoanime.com/
MIT License
412 stars 74 forks source link

deleting a "multiple" #544

Closed bond4u closed 1 year ago

bond4u commented 7 years ago
  1. please add keyboard shortcuts to confirm dialog. Y/N worked well in previous version (pre-3.7)
  2. even if there are problems deleting a physical file, i would expect that database entry will still be deleted.
  3. after delete, view still shows 2 files with green ticks, but there is grey text "1 file".

image image image image

ElementalCrisis commented 7 years ago

Run Remove Missing Files, should fix the incorrect entries.

da3dsoul commented 7 years ago

Well he isn't wrong that it should be removed in this case as well.

da3dsoul commented 7 years ago

I'll do it when I get home

da3dsoul commented 7 years ago

All except for the keyboard. I don't know how to do that

da3dsoul commented 7 years ago

Mk. This is mostly done.

da3dsoul commented 7 years ago

We just need proper tab stops and enter confirmation, then this is closed

xsystematic commented 7 years ago

Using 3.7.0.3 I am unable to remove any multiple entries where the file no longer exists. Running Remove Missing Files does remove them but they return after restarting Shoko Server.

I tried the daily builds (Assuming overwriting the 3.7.0.3 files with the daily files is the right way to do it) but the issue remains.

Deleting a single entry displays the "File not found, removing record" notice and removes it but it reappears after restarting Shoko Server

3.7.0.3 Server log 2017-01-11.txt

da3dsoul commented 7 years ago

Okay, I see another issue you will want to take care of. Start the server as admin once as it should set permissions on ProgramData/ShokoServer. As it is, it's throwing an error and will be unable to save changed settings.

I don't see any error, but it sounds like it can't update in the DB, but it updates the cache fine (to be destroyed upon restart). @RickDB or @Cazzar any idea?

xsystematic commented 7 years ago

Somthing on my end was preventing permissions on ProgramData/ShokoServer so I formatted and rebuilt the database. Thats fixed the permission issue, thanks.

After more testing trying to remove multiple files I find that even if the file exists and is deleted the record returns after a restart. You can remove the multiple permantly if you delete the entire series then import it back.

I have also noticed the same behaviour happens with unrecognized files. For now I just list them as ignored

da3dsoul commented 7 years ago

Have you tried wth latest daily. I think I fixed it.

xsystematic commented 7 years ago

Just tried the latest daily and can confirm it is now fixed. Have tested "remove missing files" and deleting a single file. All working fine now

Thanks

da3dsoul commented 7 years ago

Cool. Now just the tab stops. I'll let someone else do that, though.

bond4u commented 7 years ago

3.7.0.4 Some files disappear after 1st, some 2nd and some after 3rd delete. And files counter can go negative. image

da3dsoul commented 7 years ago

@maxpiva help please

bond4u commented 7 years ago

Quite possibly something has gone wrong with the database. Anidb login fails fequently (because of my lousy router I suspect). 3.7.0.3 and 3.7.04 installer was not able to stop ShokoServer, I had to kill it.

da3dsoul commented 7 years ago

Maybe, but there are some other issues with the filesystem handler

bond4u commented 7 years ago

I was deleting a multiple... image .. and after the delete the entry remained but file name changed... image .. I deleted it again and it was removed.

bond4u commented 7 years ago

Just discovered with 3.7.0.4 that two entries link to same file. image

da3dsoul commented 7 years ago

Okay I'll try and look into situations where a duplicate record is created. @cazzar it'd be nice if you beat me to it, I've been not sleeping more than three hours per day

bond4u commented 7 years ago

Did some queries in db.

select count( ) from (select hash, count( ) as cnt from jmm.filenamehash group by hash having cnt>1) as c;

16911 rows

There should be no more than one entry per hash, right?

da3dsoul commented 7 years ago

That is correct

bond4u commented 7 years ago

Hash is based on content, not file name? so there can be several files (and in different locations) with different names, but same content meaning same hash? If there was unique index on hash column, this would not be possible?

da3dsoul commented 7 years ago

VideoLocal_Place is the individual places (file name should be here). VideoLocal is a reference to each file with the same hash (only one per file). FileNameHash seems like it should be deprecated if it isn't already

da3dsoul commented 7 years ago

I see what it's used for. We still might be able to deprecate it. I would keep it, though. It simplifies syncing hashes with the webcache for cloud

da3dsoul commented 7 years ago

Nonetheless, there should only be one of each. I'll add a cleanup to the startup maintenance, as a fresh DB shouldn't get that problem anymore.

bond4u commented 7 years ago

More queries:

select * from jmm.videolocal where hash in (select hash from jmm.filenamehash where filename like 'Chara%');

image

select * from jmm.videolocal_place where videolocalid in ( select videolocalid from jmm.videolocal where hash in ( select hash from jmm.filenamehash where filename like 'Chara%'));

image

select * from jmm.anidb_file where hash in (select hash from jmm.filenamehash where filename like 'Chara%');

image

select * from jmm.filenamehash where filename like 'Chara%';

image

Filenamehash seems to be correct - there are 6 files with same name in 6 different folders. Videolocal although shows two rows per hash.

da3dsoul commented 7 years ago

That's good to know. The clean up does not take into account which have hashes or not. I'll need to think of a method to quickly sort and keep the most complete VideoLocal

da3dsoul commented 7 years ago

see https://github.com/japanesemediamanager/ShokoServer/commit/5e0f32f8d2f0c4e490f092d0945ea374e2a158a5

da3dsoul commented 7 years ago

See https://github.com/japanesemediamanager/ShokoServer/commit/168d5fea4067b6fcf21b8b204c6bed482c73c848

bond4u commented 7 years ago

Okay, trying daily build.

bond4u commented 7 years ago

Duplicate files tab looks weird, delete db entry does nothing. image

bond4u commented 7 years ago

And there are files that have two hashes. File name, location, crc, sha, md5 are same, only hash is different. image

da3dsoul commented 7 years ago

Duplicate files is broken in latest. I'm aware. The hash thing is not something I can reliably automate. Rehash all of those and then run remove missing files. Should clean up itself after the hashes are correct.

bond4u commented 7 years ago

the number of duplicates has certanly come down now.

select count( ) from ( select hash as h2,count( ) as cnt from jmm.videolocal group by hash having cnt>1) as c;

12 rows

select count( ) from jmm.videolocal_place where videolocalid in ( select distinct videolocalid from jmm.videolocal as v, ( select hash as h2,count( ) as cnt from jmm.videolocal group by hash having cnt>1) as c where c.h2=v.hash);

24 rows

da3dsoul commented 7 years ago

Cool do you notice any pattern between those?

bond4u commented 7 years ago

After server restart there are none. I'm guessing that drop source scanner is creating new ones.

da3dsoul commented 7 years ago

Grrr thought I fixed that.

bond4u commented 7 years ago

Picked up some files that appeared in duplicates page. Moved them to non-watchable folder. Then moved them to drop source folder. Server picked them, scanned and now there are duplicates in videolocal. And files remain in drop source folder, they are not being moved to drop target.

bond4u commented 7 years ago

I guess picked up files are waiting in "General" queue? and will be moved once anidb is queried?

da3dsoul commented 7 years ago

That's possible. Check it after

bond4u commented 7 years ago

Okay, all 3 queues are empty. So, I moved 12 files and 12 duplicates, 24 files in total from importfolder 9 to importfolder 6 (drop source). then server created duplicate entries in videolocal. then anidb was contacted and files were moved from importfolder 6 to importfolder 5 (drop target), but duplicate entries in videolocal remained. according to videolocal_place table there are 12+12 files in importfolder 9 which is wrong and there are 12+12 files in importfolder 5 which is correct.

now, i wonder, when should renamer have kicked in? I would expected that 12 files should have been renamed and 12 duplicates should have been renamed as well and renamer should have overwritten (or discard) duplicates?

da3dsoul commented 7 years ago

Okay. I have an idea of where to look.

da3dsoul commented 7 years ago

Rename happens before move. @maxpiva can you look at this if you get a chance, you only need to read the last 10 or so messages. Clean import process is important.

bond4u commented 7 years ago

image There's red "!", but these files do exist - they just have super long folder name and file names. When I moved them away and wanted to move back, I got error that file name is too long. I mean, cut and paste gave me error, but I was able to move files using total commander (keep name option). Moving these two files one level up and back down, created entries in duplicatefile table and duplicates in videolocal tables. Moving these files was slow, total commander progress bar told 10mb/s. So the old file did still exist while new file was being created (and hasher was already hashing?). Perhaps file system monitoring should wait (until file size doesnt change) before starting hashing a file. And does file system monitoring pick up file deletions?

bond4u commented 7 years ago

Some odd errors in server log:

[2017-03-26 00:00:44:766] Info|SVR_AniDB_File.CreateCrossEpisodes => SVR_AniDB_Anime.UpdateStatsByAnimeID => SVR_AnimeSeries.UpdateStats Starting Updating STATS for SERIES Series: Ao no Exorcist: Kyoto Fujouou Hen (2797) (True - True - False)
[2017-03-26 00:00:45:532] Info|<>c.<ProcessFile_AniDB>b__16_0 => SVR_VideoLocal_Place.RenameIfRequired => SVR_VideoLocal_Place.RenameFile Renaming file From (G:\_torrentz\_removed\_2017\01\Ao no Exorcist - Kyoto Fujouou-hen - 11 (1280x720 HEVC2 AAC).mkv) to (G:\_torrentz\_removed\_2017\01\[?(´?')?] Ao no Exorcist- Kyoto Fujouou Hen - 11 [720p] [24FAC039].mkv)....
[2017-03-26 00:00:45:538] Info|BackgroundWorker.WorkerThreadStart => BackgroundWorker.OnDoWork => MainWindow.workerFileEvents_DoWork New file detected: G:\_torrentz\_sorted\Urara Meirochou\[DeadFish] Urara Meirochou - 11 [720p] [77BB62F5].mp4: Created
[2017-03-26 00:00:45:538] Info|BackgroundWorker.WorkerThreadStart => BackgroundWorker.OnDoWork => MainWindow.workerFileEvents_DoWork Found file G:\_torrentz\_sorted\Urara Meirochou\[DeadFish] Urara Meirochou - 11 [720p] [77BB62F5].mp4
[2017-03-26 00:00:45:538] Info|<>c.<ProcessFile_AniDB>b__16_0 => SVR_VideoLocal_Place.RenameIfRequired => SVR_VideoLocal_Place.RenameFile Renaming file SUCCESS! From (G:\_torrentz\_removed\_2017\01\Ao no Exorcist - Kyoto Fujouou-hen - 11 (1280x720 HEVC2 AAC).mkv) to (G:\_torrentz\_removed\_2017\01\[?(´?')?] Ao no Exorcist- Kyoto Fujouou Hen - 11 [720p] [24FAC039].mkv)
[2017-03-26 00:00:45:555] Info|List`1.ForEach => <>c.<ProcessFile_AniDB>b__16_0 => SVR_VideoLocal_Place.MoveFileIfRequired Moving file from G:\_torrentz\_removed\_2017\01\[?(´?')?] Ao no Exorcist- Kyoto Fujouou Hen - 11 [720p] [24FAC039].mkv to G:\_torrentz\_sorted\Ao no Exorcist Kyoto Fujouou Hen\[?(´?')?] Ao no Exorcist- Kyoto Fujouou Hen - 11 [720p] [24FAC039].mkv
[2017-03-26 00:00:45:555] Error|BackgroundWorker.WorkerThreadStart => BackgroundWorker.OnDoWork => MainWindow.workerFileEvents_DoWork System.IO.FileNotFoundException: Could not find file 'G:\_torrentz\_removed\_2017\01\[?(´?')?] Ao no Exorcist- Kyoto Fujouou Hen - 11 [720p] [24FAC039].mkv'.
File name: 'G:\_torrentz\_removed\_2017\01\[?(´?')?] Ao no Exorcist- Kyoto Fujouou Hen - 11 [720p] [24FAC039].mkv'
   at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
   at System.IO.File.GetAttributes(String path)
   at Shoko.Server.MainWindow.workerFileEvents_DoWork(Object sender, DoWorkEventArgs e) in C:\projects\jmmserver\Shoko.Server\MainWindow.xaml.cs:line 561
[2017-03-26 00:00:48:390] Info|AniDBHelper.GetFileInfo => AniDBCommand_GetFileInfo.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_COMMAND: FILE size=638232044&ed2k=05CBC40D9D3E6FF6DB6329662A2A7F39&fmask=7FF8FFF9FE&amask=0000FCC0&s=6cvPL
[2017-03-26 00:00:48:583] Info|AniDBHelper.GetFileInfo => AniDBCommand_GetFileInfo.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_RESPONSE in 193.0111 ms - 320 NO SUCH FILE
  1. file is renamed
  2. file is moved
  3. file is not found - it looks for file in the old location and of course file is not there anymore
  4. some odd characters in file name - do question marks indicate unicode?
bond4u commented 7 years ago

another error from log:

[2017-03-26 00:01:55:903] Info|CommandRequest_ProcessFile.ProcessCommand => CommandRequest_ProcessFile.ProcessFile_AniDB => AzureWebAPI.Get_CrossRefFileEpisode Cache HTTP - Getting File/Episode Cross Ref From Cache: 520DA431E87BB9023BBC92B216A77483
[2017-03-26 00:01:56:100] Info|CommandRequest_ProcessFile.ProcessCommand => CommandRequest_ProcessFile.ProcessFile_AniDB => AzureWebAPI.Get_CrossRefFileEpisode Cache HTTP - Got File/Episode Cross Ref From Cache: 520DA431E87BB9023BBC92B216A77483 - 196.0112
[2017-03-26 00:01:56:892] Error|BackgroundWorker.WorkerThreadStart => BackgroundWorker.OnDoWork => MainWindow.workerRemoveMissing_DoWork System.AggregateException: One or more errors occurred. ---> System.IO.FileNotFoundException: The system cannot find the file specified.

   at Pri.LongPath.Directory.EnumerateNormalizedFileSystemEntries(Boolean includeDirectories, Boolean includeFiles, SearchOption option, String normalizedPath, String normalizedSearchPattern) in C:\projects\jmmserver\Shoko.Server\Mappings\CrossRef_AniDB_TvDB_EpisodeMap.cs:line 0
   at Pri.LongPath.Directory.GetDirectories(String path) in C:\projects\jmmserver\Shoko.Server\Mappings\CrossRef_AniDB_TvDB_EpisodeMap.cs:line 0
   at Pri.LongPath.DirectoryInfo.GetDirectories() in C:\projects\jmmserver\Shoko.Server\Mappings\CrossRef_AniDB_TvDB_EpisodeMap.cs:line 0
   at NutzCode.CloudFileSystem.Plugins.LocalFileSystem.DirectoryImplementation.<PopulateAsync>d__26.MoveNext() in C:\projects\jmmserver\CloudFileSystem\NutzCode.CloudFileSystem.Plugins.LocalFileSystem\DirectoryImplementation.cs:line 72
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at NutzCode.CloudFileSystem.DirectoryCache.DirectoryCache.<GetFromPath>d__2.MoveNext() in C:\projects\jmmserver\CloudFileSystem\NutzCode.CloudFileSystem\DirectoryCache\DirectoryCache.cs:line 31
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at NutzCode.CloudFileSystem.DirectoryCache.DirectoryCache.<ObjectFromPath>d__3.MoveNext() in C:\projects\jmmserver\CloudFileSystem\NutzCode.CloudFileSystem\DirectoryCache\DirectoryCache.cs:line 119
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at NutzCode.CloudFileSystem.Plugins.LocalFileSystem.LocalFileSystem.<ResolveAsync>d__7.MoveNext() in C:\projects\jmmserver\CloudFileSystem\NutzCode.CloudFileSystem.Plugins.LocalFileSystem\LocalFileSystem.cs:line 93
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at NutzCode.CloudFileSystem.SyncExtensions.<>c__DisplayClass2_0.<<Resolve>b__0>d.MoveNext() in C:\projects\jmmserver\CloudFileSystem\NutzCode.CloudFileSystem\SyncExtensions.cs:line 24
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at NutzCode.CloudFileSystem.SyncExtensions.Resolve(IFileSystem filesys, String path) in C:\projects\jmmserver\CloudFileSystem\NutzCode.CloudFileSystem\SyncExtensions.cs:line 0
   at Shoko.Server.Importer.RemoveRecordsWithoutPhysicalFiles() in C:\projects\jmmserver\Shoko.Server\Importer.cs:line 843
   at Shoko.Server.MainWindow.workerRemoveMissing_DoWork(Object sender, DoWorkEventArgs e) in C:\projects\jmmserver\Shoko.Server\MainWindow.xaml.cs:line 2314
---> (Inner Exception #0) System.IO.FileNotFoundException: The system cannot find the file specified.

   at Pri.LongPath.Directory.EnumerateNormalizedFileSystemEntries(Boolean includeDirectories, Boolean includeFiles, SearchOption option, String normalizedPath, String normalizedSearchPattern) in C:\projects\jmmserver\Shoko.Server\Mappings\CrossRef_AniDB_TvDB_EpisodeMap.cs:line 0
   at Pri.LongPath.Directory.GetDirectories(String path) in C:\projects\jmmserver\Shoko.Server\Mappings\CrossRef_AniDB_TvDB_EpisodeMap.cs:line 0
   at Pri.LongPath.DirectoryInfo.GetDirectories() in C:\projects\jmmserver\Shoko.Server\Mappings\CrossRef_AniDB_TvDB_EpisodeMap.cs:line 0
   at NutzCode.CloudFileSystem.Plugins.LocalFileSystem.DirectoryImplementation.<PopulateAsync>d__26.MoveNext() in C:\projects\jmmserver\CloudFileSystem\NutzCode.CloudFileSystem.Plugins.LocalFileSystem\DirectoryImplementation.cs:line 72
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at NutzCode.CloudFileSystem.DirectoryCache.DirectoryCache.<GetFromPath>d__2.MoveNext() in C:\projects\jmmserver\CloudFileSystem\NutzCode.CloudFileSystem\DirectoryCache\DirectoryCache.cs:line 31
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at NutzCode.CloudFileSystem.DirectoryCache.DirectoryCache.<ObjectFromPath>d__3.MoveNext() in C:\projects\jmmserver\CloudFileSystem\NutzCode.CloudFileSystem\DirectoryCache\DirectoryCache.cs:line 119
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at NutzCode.CloudFileSystem.Plugins.LocalFileSystem.LocalFileSystem.<ResolveAsync>d__7.MoveNext() in C:\projects\jmmserver\CloudFileSystem\NutzCode.CloudFileSystem.Plugins.LocalFileSystem\LocalFileSystem.cs:line 93
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at NutzCode.CloudFileSystem.SyncExtensions.<>c__DisplayClass2_0.<<Resolve>b__0>d.MoveNext() in C:\projects\jmmserver\CloudFileSystem\NutzCode.CloudFileSystem\SyncExtensions.cs:line 24<---

[2017-03-26 00:01:58:616] Info|AniDBHelper.GetFileInfo => AniDBCommand_GetFileInfo.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_COMMAND: FILE size=99008342&ed2k=F2BB221E793E2E5C240784D94CC802A0&fmask=7FF8FFF9FE&amask=0000FCC0&s=6cvPL
[2017-03-26 00:01:58:766] Info|AniDBHelper.GetFileInfo => AniDBCommand_GetFileInfo.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_RESPONSE in 150.0086 ms - 320 NO SUCH FILE
bond4u commented 7 years ago

duplicate hashes kept coming to videolocal table, there was 21 of them when I did server restart. now duplicates are gone. I dropped non-unique index on hash column and created unique index. I was expecting sql errors, but I see xml errors in log.

[2017-03-26 01:12:54:998] Info|AniDBHelper.GetFileInfo => AniDBCommand_GetFileInfo.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_COMMAND: FILE size=95063119&ed2k=7430FE01E4CBBD008D373B784BEF0FFB&fmask=7FF8FFF9FE&amask=0000FCC0&s=tL8wb
[2017-03-26 01:12:55:155] Info|AniDBHelper.GetFileInfo => AniDBCommand_GetFileInfo.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_RESPONSE in 157.009 ms - 320 NO SUCH FILE

[2017-03-26 01:12:55:155] Info|AniDBHelper.GetAnimeInfoHTTP => AniDBHTTPCommand_GetFullAnime.Process => AniDBHTTPHelper.GetAnimeXMLFromAPI AniDB HTTP - Getting anime XML data from AniDB: 0
[2017-03-26 01:12:58:131] Info|AniDBHelper.GetAnimeInfoHTTP => AniDBHTTPCommand_GetFullAnime.Process => AniDBHTTPHelper.GetAnimeXMLFromAPI AniDB HTTP - Got anime XML Data From AniDB: 0 - 2975.1702 - <error>aid Missing or Invalid</error>
[2017-03-26 01:12:58:131] Error|AniDBHelper.GetAnimeInfoHTTP => AniDBHTTPCommand_GetFullAnime.Process => AniDBHTTPHelper.ProcessTitles Error in AniDBHTTPHelper.ProcessTitles: 0 - System.NullReferenceException: Object reference not set to an instance of an object.
   at AniDBAPI.AniDBHTTPHelper.ProcessTitles(XmlDocument docAnime, Int32 animeID) in C:\projects\jmmserver\Shoko.Server\AniDB_API\AniDBHTTPHelper.cs:line 430
[2017-03-26 01:12:58:131] Error|AniDBHelper.GetAnimeInfoHTTP => AniDBHTTPCommand_GetFullAnime.Process => AniDBHTTPHelper.ProcessTags Error in AniDBHTTPHelper.ProcessTags: {0}
[2017-03-26 01:12:58:131] Error|AniDBHelper.GetAnimeInfoHTTP => AniDBHTTPCommand_GetFullAnime.Process => AniDBHTTPHelper.ProcessCharacters Error in AniDBHTTPHelper.ProcessCharacters: {0}
[2017-03-26 01:12:58:131] Error|AniDBHelper.GetAnimeInfoHTTP => AniDBHTTPCommand_GetFullAnime.Process => AniDBHTTPHelper.ProcessRelations Error in AniDBHTTPHelper.ProcessRelations: {0}
[2017-03-26 01:12:58:131] Error|AniDBHelper.GetAnimeInfoHTTP => AniDBHTTPCommand_GetFullAnime.Process => AniDBHTTPHelper.ProcessSimilarAnime Error in AniDBHTTPHelper.ProcessSimilarAnime: {0}
[2017-03-26 01:12:58:131] Error|AniDBHelper.GetAnimeInfoHTTP => AniDBHTTPCommand_GetFullAnime.Process => AniDBHTTPHelper.ProcessRecommendations Error in AniDBHTTPHelper.ProcessRecommendations: {0}
[2017-03-26 01:13:00:663] Info|AniDBHelper.GetFileInfo => AniDBCommand_GetFileInfo.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_COMMAND: FILE size=139833967&ed2k=5C4CD3DA50355107B271DA9F56BD1B7B&fmask=7FF8FFF9FE&amask=0000FCC0&s=tL8wb
[2017-03-26 01:13:00:891] Info|AniDBHelper.GetFileInfo => AniDBCommand_GetFileInfo.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_RESPONSE in 228.0131 ms - 320 NO SUCH FILE
bond4u commented 7 years ago

more errors:

[2017-03-26 02:20:56:064] Info|CommandRequest_ProcessFile.ProcessCommand => CommandRequest_ProcessFile.ProcessFile_AniDB => AzureWebAPI.Get_CrossRefFileEpisode Cache HTTP - Getting File/Episode Cross Ref From Cache: 40B03398ECA4DDE0C6590C0B5B8CC7D7
[2017-03-26 02:20:56:256] Info|CommandRequest_ProcessFile.ProcessCommand => CommandRequest_ProcessFile.ProcessFile_AniDB => AzureWebAPI.Get_CrossRefFileEpisode Cache HTTP - Got File/Episode Cross Ref From Cache: 40B03398ECA4DDE0C6590C0B5B8CC7D7 - 188.0107
[2017-03-26 02:20:56:256] Info|CommandRequest_HashFile.FillMissingHashes => CommandRequest_HashFile.FillHashesAgainstWebCache => AzureWebAPI.Get_FileHash Cache HTTP - Got File Hash From Cache: 4D6C0EE81A8098941F910C04911FEC39 - 192.0109
[2017-03-26 02:20:56:421] Info|CommandProcessorHasher.workerCommands_DoWork => CommandRequest_HashFile.ProcessCommand => CommandRequest_HashFile.ProcessFile_LocalInfo Hashing File: G:\_torrentz\_removed\[AnimeRG] My Wife is the Student Council President! (Complete Season 01) Okusama ga Seitokaichou! [Uncensored] [720p] [BD] [Batch] [x265] [pseudo]\[AnimeRG] My Wife is the Student Council President! - 01 [Uncensored] [720p] [x265] [pseudo].mkv
[2017-03-26 02:20:56:421] Error|CommandRequest_HashFile.ProcessCommand => CommandRequest_HashFile.ProcessFile_LocalInfo => Hasher.CalculateHashes Error using DLL to get hash (Functon returned FALSE), trying C# code instead: G:\_torrentz\_removed\[AnimeRG] My Wife is the Student Council President! (Complete Season 01) Okusama ga Seitokaichou! [Uncensored] [720p] [BD] [Batch] [x265] [pseudo]\[AnimeRG] My Wife is the Student Council President! - 01 [Uncensored] [720p] [x265] [pseudo].mkv
[2017-03-26 02:20:56:431] Error|BackgroundWorker.OnDoWork => CommandProcessorHasher.workerCommands_DoWork => CommandRequest_HashFile.ProcessCommand Error processing CommandRequest_ProcessFile: G:\_torrentz\_removed\[AnimeRG] My Wife is the Student Council President! (Complete Season 01) Okusama ga Seitokaichou! [Uncensored] [720p] [BD] [Batch] [x265] [pseudo]\[AnimeRG] My Wife is the Student Council President! - 01 [Uncensored] [720p] [x265] [pseudo].mkv - System.IO.DirectoryNotFoundException: Could not find a part of the path 'G:\_torrentz\_removed\[AnimeRG] My Wife is the Student Council President! (Complete Season 01) Okusama ga Seitokaichou! [Uncensored] [720p] [BD] [Batch] [x265] [pseudo]\[AnimeRG] My Wife is the Student Council President! - 01 [Uncensored] [720p] [x265] [pseudo].mkv'.
   at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
   at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost)
   at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options, String msgPath, Boolean bFromProxy)
   at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, Boolean useAsync)
   at System.IO.FileInfo.OpenRead()
   at Shoko.Server.FileHelper.Hasher.CalculateHashes_here(String strPath, OnHashProgress onHashProgress, Boolean getCRC32, Boolean getMD5, Boolean getSHA1) in C:\projects\jmmserver\Shoko.Server\FileHelper\Hasher.cs:line 159
   at Shoko.Server.FileHelper.Hasher.CalculateHashes(String strPath, OnHashProgress onHashProgress, Boolean getCRC32, Boolean getMD5, Boolean getSHA1) in C:\projects\jmmserver\Shoko.Server\FileHelper\Hasher.cs:line 147
   at Shoko.Server.Commands.CommandRequest_HashFile.ProcessFile_LocalInfo() in C:\projects\jmmserver\Shoko.Server\Commands\CommandRequest_HashFile.cs:line 271
   at Shoko.Server.Commands.CommandRequest_HashFile.ProcessCommand() in C:\projects\jmmserver\Shoko.Server\Commands\CommandRequest_HashFile.cs:line 80
[2017-03-26 02:20:56:544] Info|CommandProcessorHasher.workerCommands_DoWork => CommandRequest_HashFile.ProcessCommand => CommandRequest_HashFile.ProcessFile_LocalInfo Hashing File: G:\_torrentz\_removed\[AnimeRG] My Wife is the Student Council President! (Complete Season 01) Okusama ga Seitokaichou! [Uncensored] [720p] [BD] [Batch] [x265] [pseudo]\[AnimeRG] My Wife is the Student Council President! - 02 [Uncensored] [720p] [x265] [pseudo].mkv
[2017-03-26 02:20:56:544] Error|CommandRequest_HashFile.ProcessCommand => CommandRequest_HashFile.ProcessFile_LocalInfo => Hasher.CalculateHashes Error using DLL to get hash (Functon returned FALSE), trying C# code instead: G:\_torrentz\_removed\[AnimeRG] My Wife is the Student Council President! (Complete Season 01) Okusama ga Seitokaichou! [Uncensored] [720p] [BD] [Batch] [x265] [pseudo]\[AnimeRG] My Wife is the Student Council President! - 02 [Uncensored] [720p] [x265] [pseudo].mkv
[2017-03-26 02:20:56:544] Error|BackgroundWorker.OnDoWork => CommandProcessorHasher.workerCommands_DoWork => CommandRequest_HashFile.ProcessCommand Error processing CommandRequest_ProcessFile: G:\_torrentz\_removed\[AnimeRG] My Wife is the Student Council President! (Complete Season 01) Okusama ga Seitokaichou! [Uncensored] [720p] [BD] [Batch] [x265] [pseudo]\[AnimeRG] My Wife is the Student Council President! - 02 [Uncensored] [720p] [x265] [pseudo].mkv - System.IO.DirectoryNotFoundException: Could not find a part of the path 'G:\_torrentz\_removed\[AnimeRG] My Wife is the Student Council President! (Complete Season 01) Okusama ga Seitokaichou! [Uncensored] [720p] [BD] [Batch] [x265] [pseudo]\[AnimeRG] My Wife is the Student Council President! - 02 [Uncensored] [720p] [x265] [pseudo].mkv'.
   at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
   at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost)
   at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options, String msgPath, Boolean bFromProxy)
   at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, Boolean useAsync)
   at System.IO.FileInfo.OpenRead()
   at Shoko.Server.FileHelper.Hasher.CalculateHashes_here(String strPath, OnHashProgress onHashProgress, Boolean getCRC32, Boolean getMD5, Boolean getSHA1) in C:\projects\jmmserver\Shoko.Server\FileHelper\Hasher.cs:line 159
   at Shoko.Server.FileHelper.Hasher.CalculateHashes(String strPath, OnHashProgress onHashProgress, Boolean getCRC32, Boolean getMD5, Boolean getSHA1) in C:\projects\jmmserver\Shoko.Server\FileHelper\Hasher.cs:line 147
   at Shoko.Server.Commands.CommandRequest_HashFile.ProcessFile_LocalInfo() in C:\projects\jmmserver\Shoko.Server\Commands\CommandRequest_HashFile.cs:line 271
   at Shoko.Server.Commands.CommandRequest_HashFile.ProcessCommand() in C:\projects\jmmserver\Shoko.Server\Commands\CommandRequest_HashFile.cs:line 80
[2017-03-26 02:20:56:657] Info|CommandProcessorHasher.workerCommands_DoWork => CommandRequest_HashFile.ProcessCommand => CommandRequest_HashFile.ProcessFile_LocalInfo Hashing File: G:\_torrentz\_removed\[AnimeRG] My Wife is the Student Council President! (Complete Season 01) Okusama ga Seitokaichou! [Uncensored] [720p] [BD] [Batch] [x265] [pseudo]\[AnimeRG] My Wife is the Student Council President! - 03 [Uncensored] [720p] [x265] [pseudo].mkv
[2017-03-26 02:20:56:657] Error|CommandRequest_HashFile.ProcessCommand => CommandRequest_HashFile.ProcessFile_LocalInfo => Hasher.CalculateHashes Error using DLL to get hash (Functon returned FALSE), trying C# code instead: G:\_torrentz\_removed\[AnimeRG] My Wife is the Student Council President! (Complete Season 01) Okusama ga Seitokaichou! [Uncensored] [720p] [BD] [Batch] [x265] [pseudo]\[AnimeRG] My Wife is the Student Council President! - 03 [Uncensored] [720p] [x265] [pseudo].mkv
bond4u commented 7 years ago 
[2017-03-26 02:59:14:405] Warn|RenameFileHelper.GetNewFileName => SVR_VideoLocal.GetBestVideoLocalPlace => SVR_VideoLocal.ResolveFile File not found: G:\_torrentz\_sorted\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv
[2017-03-26 02:59:14:405] Error|List`1.ForEach => <>c.<ProcessFile_AniDB>b__16_0 => SVR_VideoLocal_Place.RenameIfRequired Error could not find the original file for renaming: G:\_torrentz\_sorted\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv
[2017-03-26 02:59:14:422] Warn|RenameFileHelper.GetNewFileName => SVR_VideoLocal.GetBestVideoLocalPlace => SVR_VideoLocal.ResolveFile File not found: G:\_torrentz\_sorted\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv
[2017-03-26 02:59:14:422] Error|List`1.ForEach => <>c.<ProcessFile_AniDB>b__16_0 => SVR_VideoLocal_Place.RenameIfRequired Error could not find the original file for renaming: G:\_torrentz\_sorted\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv
[2017-03-26 02:59:14:438] Warn|RenameFileHelper.GetNewFileName => SVR_VideoLocal.GetBestVideoLocalPlace => SVR_VideoLocal.ResolveFile File not found: G:\_torrentz\_sorted\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv
[2017-03-26 02:59:14:438] Info|<>c.<ProcessFile_AniDB>b__16_0 => SVR_VideoLocal_Place.RenameIfRequired => SVR_VideoLocal_Place.RenameFile Renaming file From (G:\_torrentz\_removed\_2017\01\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv) to (G:\_torrentz\_removed\_2017\01\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv)....
[2017-03-26 02:59:14:438] Info|<>c.<ProcessFile_AniDB>b__16_0 => SVR_VideoLocal_Place.RenameIfRequired => SVR_VideoLocal_Place.RenameFile Renaming file SKIPPED! no change From (G:\_torrentz\_removed\_2017\01\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv) to (G:\_torrentz\_removed\_2017\01\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv)
[2017-03-26 02:59:14:539] Info|List`1.ForEach => <>c.<ProcessFile_AniDB>b__16_0 => SVR_VideoLocal_Place.MoveFileIfRequired Moving file from G:\_torrentz\_removed\_2017\01\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv to G:\_torrentz\_sorted\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv
[2017-03-26 02:59:14:539] Info|BackgroundWorker.WorkerThreadStart => BackgroundWorker.OnDoWork => MainWindow.workerFileEvents_DoWork New folder detected: G:\_torrentz\_sorted\B Gata H Kei: Created
[2017-03-26 02:59:14:559] Info|BackgroundWorker.WorkerThreadStart => BackgroundWorker.OnDoWork => MainWindow.workerFileEvents_DoWork New file detected: G:\_torrentz\_sorted\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv: Created
[2017-03-26 02:59:14:559] Info|BackgroundWorker.WorkerThreadStart => BackgroundWorker.OnDoWork => MainWindow.workerFileEvents_DoWork Found file G:\_torrentz\_sorted\B Gata H Kei\[Project-gxs] B Gata H Kei - 01 [720p] [B2D392A3].mkv
[2017-03-26 02:59:14:592] Info|CommandRequest_HashFile.FillMissingHashes => CommandRequest_HashFile.FillHashesAgainstWebCache => AzureWebAPI.Get_FileHash Cache HTTP - Getting File Hash From Cache: ED2K - 4FC4AC5FFAC23D21F0AF9B1B47ED36EB
[2017-03-26 02:59:15:179] Info|CommandRequest_HashFile.FillMissingHashes => CommandRequest_HashFile.FillHashesAgainstWebCache => AzureWebAPI.Get_FileHash Cache HTTP - Got File Hash From Cache: 4FC4AC5FFAC23D21F0AF9B1B47ED36EB - 587.0336
bond4u commented 7 years ago 
[2017-03-26 04:28:13:705] Info|BackgroundWorker.OnDoWork => CommandProcessorGeneral.workerCommands_DoWork => CommandRequest_DeleteFileFromMyList.ProcessCommand Deleting file from list: 58DDEFDB375C6923CE933CF23FD19823_-1
[2017-03-26 04:28:13:705] Info|BackgroundWorker.OnDoWork => CommandProcessorGeneral.workerCommands_DoWork => CommandRequest_AddFileToMyList.ProcessCommand Processing CommandRequest_AddFileToMyList: 18B794E3B8CC26956CD2B2FD5093C2B6
[2017-03-26 04:28:18:221] Info|AniDBHelper.AddFileToMyList => AniDBCommand_AddFile.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_COMMAND: MYLISTADD aid=0&generic=1&epno=1&viewed=0&state=2&s=D3INz
[2017-03-26 04:28:18:387] Info|AniDBHelper.AddFileToMyList => AniDBCommand_AddFile.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_RESPONSE in 166.0095 ms - 505 ILLEGAL INPUT OR ACCESS DENIED

[2017-03-26 04:28:18:411] Info|BackgroundWorker.OnDoWork => CommandProcessorGeneral.workerCommands_DoWork => CommandRequest_AddFileToMyList.ProcessCommand Adding file to list: (project-gxs)_Chuunibyou_Demo_Koi_Ga_Shitai!_Ren_-_01_(10bit_BD_720p).mkv --- 18B794E3B8CC26956CD2B2FD5093C2B6 - 
[2017-03-26 04:28:18:437] Info|CommandProcessorGeneral.workerCommands_DoWork => CommandRequest_RefreshAnime.ProcessCommand => SVR_AnimeSeries.UpdateStats Starting Updating STATS for SERIES Series: Chuunibyou demo Koi ga Shitai! Ren (2408) (True - True - True)
[2017-03-26 04:28:18:622] Info|BackgroundWorker.OnDoWork => CommandProcessorGeneral.workerCommands_DoWork => CommandRequest_AddFileToMyList.ProcessCommand Processing CommandRequest_AddFileToMyList: 927F57C40A97565E398CCFE9E7CE1DA0
[2017-03-26 04:28:23:123] Info|AniDBHelper.AddFileToMyList => AniDBCommand_AddFile.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_COMMAND: MYLISTADD aid=0&generic=1&epno=2&viewed=0&state=2&s=D3INz
[2017-03-26 04:28:23:346] Info|AniDBHelper.AddFileToMyList => AniDBCommand_AddFile.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_RESPONSE in 223.0127 ms - 505 ILLEGAL INPUT OR ACCESS DENIED

[2017-03-26 04:28:23:554] Info|BackgroundWorker.OnDoWork => CommandProcessorGeneral.workerCommands_DoWork => CommandRequest_AddFileToMyList.ProcessCommand Adding file to list: (project-gxs)_Chuunibyou_Demo_Koi_Ga_Shitai!_Ren_-_02_(10bit_BD_720p).mkv --- 927F57C40A97565E398CCFE9E7CE1DA0 - 
[2017-03-26 04:28:23:580] Info|CommandProcessorGeneral.workerCommands_DoWork => CommandRequest_RefreshAnime.ProcessCommand => SVR_AnimeSeries.UpdateStats Starting Updating STATS for SERIES Series: Chuunibyou demo Koi ga Shitai! Ren (2408) (True - True - True)
[2017-03-26 04:28:23:772] Info|BackgroundWorker.OnDoWork => CommandProcessorGeneral.workerCommands_DoWork => CommandRequest_AddFileToMyList.ProcessCommand Processing CommandRequest_AddFileToMyList: 82E45DFE3246E5B0FFE670B1C03C236D
[2017-03-26 04:28:28:273] Info|AniDBHelper.AddFileToMyList => AniDBCommand_AddFile.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_COMMAND: MYLISTADD aid=0&generic=1&epno=3&viewed=0&state=2&s=D3INz
[2017-03-26 04:28:28:493] Info|AniDBHelper.AddFileToMyList => AniDBCommand_AddFile.Process => AniDBUDPCommand.ProcessCommand AniDB UDP - UDP_RESPONSE in 220.0126 ms - 505 ILLEGAL INPUT OR ACCESS DENIED