search

smfontes / xbmc-mylibrary

Automatically exported from code.google.com/p/xbmc-mylibrary
0 stars 0 forks source link

non-english characters support #5

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
1. i can send you the hebrew plugin. you will need to change the skin's font to 
ariel to support it.
2.
3.

What is the expected output? What do you see instead?
in the config file i have the plugin setup great and the subfolder i am looking 
for is "סדרות" which means "series"
but it tells me "no folder found"
i tried it with custom_parser="PlayOn" and without

What version of the product are you using? On what operating system?
tried it both on win7 and xp sp3

Please provide any additional information below.
this is my config file:
<wallaYeS path="plugin://plugin.video.wallaYes.video" recursive="true"  >

<!-- All episodes over 20 minutes long in any subdirectory of the following 
shows -->
<!-- Had to list each show separately because the tool doesn't allow you to 
specify the plugin root -->
<subfolder name="סדרות" type="episodes" > 
<filter>
<runtime>GT|1200</runtime>  
</filter>
</subfolder>    

and here is the log
08/17/2012 10:18:28 PM INFO Init... Initializing SQLite database at: 
C:\1\XBMC.MyLibrary-1.3.1\res\ArchivedFiles.db
08/17/2012 10:18:28 PM INFO Init... Initializing SQLite database at: 
C:\1\XBMC.MyLibrary-1.3.1\res\QueuedMetaDataChanges.db
08/17/2012 10:18:28 PM INFO Init... Initializing SQLite database at: 
C:\1\XBMC.MyLibrary-1.3.1\res\scraper.db
08/17/2012 10:18:31 PM ERROR Find:Subfolder No matching subfolder named 
"wallaYES/סדרות" was found. Skipping

here is some pictures:
http://imgur.com/a/prLqt

thank you in advance

Original issue reported on code.google.com by eyalzar...@gmail.com on 18 Aug 2012 at 6:21

GoogleCodeExporter commented 9 years ago 
I've confirmed that Hebrew chars are causing problems here. This will take some 
investigations to determine why multi-lingual support is breaking.

Original comment by bradyvid...@gmail.com on 22 Aug 2012 at 12:54

GoogleCodeExporter commented 9 years ago 
some more information from the level 5 debug of the addon log

this is the log:

08/21/2012 07:56:22 PM INFO Init... Initializing SQLite database at: 
C:\1\XBMC.MyLibrary-1.3.1\res\ArchivedFiles.db
08/21/2012 07:56:23 PM INFO Init... Initializing SQLite database at: 
C:\1\XBMC.MyLibrary-1.3.1\res\QueuedMetaDataChanges.db
08/21/2012 07:56:23 PM INFO Init... Initializing SQLite database at: 
C:\1\XBMC.MyLibrary-1.3.1\res\scraper.db
08/21/2012 07:56:23 PM DEBUG Init... Logging level is set to: 5
08/21/2012 07:56:23 PM DEBUG Init... Logs will be deleted after 30 days.
08/21/2012 07:56:23 PM INFO Init... JSON-RPC config: XBMCName=localhost, 
timeout=90 seconds, method=HTTP, port=8080, username=xbmc, password=123456
08/21/2012 07:56:23 PM INFO Init... XBMC SQLite VideoDBPath = 
C:\Users\eyal\AppData\Roaming\XBMC\userdata\Database\MyVideos60.db
08/21/2012 07:56:23 PM INFO Init... Skipping MySQL config because SQLite is 
already enabled.
08/21/2012 07:56:23 PM DEBUG Init... XBMCRestart enabled = false
08/21/2012 07:56:23 PM DEBUG Init... Library scan wait minutes = 2.0
08/21/2012 07:56:23 PM DEBUG Init... IP Change is disabled
08/21/2012 07:56:23 PM DEBUG Init... Streaming Dropbox = 
\\localhost\1\Movies\dropbox
08/21/2012 07:56:23 PM DEBUG Init... Found TheTVDB Api Key: XXXXXXXXXX7A1FFE
08/21/2012 07:56:23 PM DEBUG Init... Manual Archiving is disabled.
08/21/2012 07:56:23 PM DEBUG Init... VideoCleanUp has an HoursThreshold of 8.0 
hours
08/21/2012 07:56:23 PM DEBUG Init... VideoCleanUp has an ConsecutiveThreshold 
of 5 consecutive missing times.
08/21/2012 07:56:23 PM DEBUG Init... PreScrapeMusicVids enabled = false
08/21/2012 07:56:23 PM INFO Init... Found source hotVOD with path of 
plugin://plugin.video.hotVOD.video/
08/21/2012 07:56:23 PM INFO Init... Setting source's custom_parser to: hotVOD
08/21/2012 07:56:23 PM INFO Init... Next Subfolder: name=hotVOD/ערוץ 8, 
recursive=false, type=generic, max_series=-1, max_videos=-1, movie_set=, 
prefix=, suffix=, multi_part=false, force_series=
08/21/2012 07:56:23 PM INFO Init... Added Global Exclude, type=contains, 
value=/No videos available
08/21/2012 07:56:23 PM INFO Init... Added Global Exclude, type=contains, 
value=making of
08/21/2012 07:56:23 PM INFO Init... Added Global Exclude, type=contains, 
value=behind the scene
08/21/2012 07:56:23 PM INFO Init... Added Global Exclude, type=contains, 
value=anime
08/21/2012 07:56:23 PM INFO Init... Added Global Exclude, type=regexp, 
value=/clip[s]?(/|$)
08/21/2012 07:56:23 PM INFO Init... Added Global Exclude, type=contains, 
value=Dragon Ball Z
08/21/2012 07:56:23 PM INFO Init Testing connectivity to JSON-RPC interface...
08/21/2012 07:56:23 PM DEBUG Init Connecting to JSON-RPC and sending command: 
{"jsonrpc": "2.0", "method": "JSONRPC.Ping", "id": "1"}
08/21/2012 07:56:23 PM DEBUG Init Sending data to: 
http://localhost:8080/jsonrpc (host=localhost, encoding=UTF-8, method=POST, 
Content-Type=application/x-www-form-urlencoded, Content-Length=55, 
Connection=Close):
{"jsonrpc": "2.0", "method": "JSONRPC.Ping", "id": "1"}
08/21/2012 07:56:23 PM DEBUG Init Raw response from POST. Response Code = 200 
(OK):
{"id":"1","jsonrpc":"2.0","result":"pong"}
08/21/2012 07:56:23 PM INFO Init JSON-RPC connected = true
08/21/2012 07:56:23 PM INFO Find:Subfolder Searching for subfolder: 
hotVOD/ערוץ 8
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Now looking in:hotVOD 
(plugin://plugin.video.hotVOD.video/)
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Connecting to JSON-RPC and sending 
command: {"jsonrpc": "2.0", "method": "Files.GetDirectory", "params": 
{"directory":"plugin://plugin.video.hotVOD.video/", 
"properties":["runtime","title","thumbnail","fanart"], "media":"files"}, "id": 
"1"}
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Sending data to: 
http://localhost:8080/jsonrpc (host=localhost, encoding=UTF-8, method=POST, 
Content-Type=application/x-www-form-urlencoded, Content-Length=196, 
Connection=Close):
{"jsonrpc": "2.0", "method": "Files.GetDirectory", "params": 
{"directory":"plugin://plugin.video.hotVOD.video/", 
"properties":["runtime","title","thumbnail","fanart"], "media":"files"}, "id": 
"1"}
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Raw response from POST. Response 
Code = 200 (OK):
{"id":"1","jsonrpc":"2.0","result":{"files":[{"file":"plugin://plugin.video.hotV
OD.video/?url=http%3A%2F%2Fhot.ynet.co.il%2F&mode=5&name=׳×׳•׳›׳ 
׳™׳•׳×","filetype":"directory","label":"׳×׳•׳›׳ 
׳™׳•׳×","runtime":"","thumbnail":"http://ilvideo.googlecode.com/svn/trun
k/hot/genre/shows.png","title":"׳×׳•׳›׳ 
׳™׳•׳×","type":"movie"},{"file":"plugin://plugin.video.hotVOD.video/?url
=0&mode=1&name=׳§׳•׳?׳“׳™","filetype":"directory","label":"׳§׳•
׳?׳“׳™","runtime":"","thumbnail":"http://ilvideo.googlecode.com/svn/trunk
/hot/genre/genre-0.png","title":"׳§׳•׳?׳“׳™","type":"movie"},{"file"
:"plugin://plugin.video.hotVOD.video/?url=1&mode=1&name=׳¢׳¨׳•׳¥ 
8","filetype":"directory","label":"׳¢׳¨׳•׳¥ 
8","runtime":"","thumbnail":"http://ilvideo.googlecode.com/svn/trunk/hot/genre/g
enre-1.png","title":"׳¢׳¨׳•׳¥ 
8","type":"movie"},{"file":"plugin://plugin.video.hotVOD.video/?url=2&mode=1&nam
e=׳¡׳“׳¨׳•׳×","filetype":"directory","label":"׳¡׳“׳¨׳•׳×
","runtime":"","thumbnail":"http://ilvideo.googlecode.com/svn/trunk/hot/genre/ge
nre-2.png","title":"׳¡׳“׳¨׳•׳×","type":"movie"},{"file":"plugin://pl
ugin.video.hotVOD.video/?url=3&mode=1&name=׳‘׳™׳“׳•׳¨ 
׳•׳?׳™׳¨׳•׳—","filetype":"directory","label":"׳‘׳™׳“׳��
�׳¨ 
׳•׳?׳™׳¨׳•׳—","runtime":"","thumbnail":"http://ilvideo.googlecode
.com/svn/trunk/hot/genre/genre-3.png","title":"׳‘׳™׳“׳•׳¨ 
׳•׳?׳™׳¨׳•׳—","type":"movie"},{"file":"plugin://plugin.video.hotV
OD.video/?url=4&mode=1&name=׳¨׳™׳?׳?׳™׳˜׳™","filetype":"directory
","label":"׳¨׳™׳?׳?׳™׳˜׳™","runtime":"","thumbnail":"http://ilvid
eo.googlecode.com/svn/trunk/hot/genre/genre-4.png","title":"׳¨׳™׳?׳?׳™
׳˜׳™","type":"movie"},{"file":"plugin://plugin.video.hotVOD.video/?url=5&mo
de=1&name=׳”׳—׳™׳™׳? 
׳”׳˜׳•׳‘׳™׳?","filetype":"directory","label":"׳”׳—׳™׳��
�׳? 
׳”׳˜׳•׳‘׳™׳?","runtime":"","thumbnail":"http://ilvideo.googlecode
.com/svn/trunk/hot/genre/genre-5.png","title":"׳”׳—׳™׳™׳? 
׳”׳˜׳•׳‘׳™׳?","type":"movie"},{"file":"plugin://plugin.video.hotV
OD.video/?url=6&mode=1&name=Young","filetype":"directory","label":"Young","runti
me":"","thumbnail":"http://ilvideo.googlecode.com/svn/trunk/hot/genre/genre-6.pn
g","title":"Young","type":"movie"}],"limits":{"end":8,"start":0,"total":8}}}
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Found 0 files and 8 directories in 
hotVOD
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches "hotVOD"
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳×׳•׳›׳ ׳™׳•׳×"
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Not storing folder in list because 
the path (hotVOD/׳×׳•׳›׳ ׳™׳•׳×) does not match the subfolder 
(hotVOD/ערוץ 8)
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳×׳•׳›׳ ׳™׳•׳×"
08/21/2012 07:56:23 PM INFO Repeat Previous line repeats 1 time
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Skipping because it does not match 
a Subfolder: hotVOD/׳×׳•׳›׳ ׳™׳•׳×
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳§׳•׳?׳“׳™"
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Not storing folder in list because 
the path (hotVOD/׳§׳•׳?׳“׳™) does not match the subfolder 
(hotVOD/ערוץ 8)
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳§׳•׳?׳“׳™"
08/21/2012 07:56:23 PM INFO Repeat Previous line repeats 1 time
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Skipping because it does not match 
a Subfolder: hotVOD/׳§׳•׳?׳“׳™
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳¢׳¨׳•׳¥ 8"
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Not storing folder in list because 
the path (hotVOD/׳¢׳¨׳•׳¥ 8) does not match the subfolder 
(hotVOD/ערוץ 8)
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳¢׳¨׳•׳¥ 8"
08/21/2012 07:56:23 PM INFO Repeat Previous line repeats 1 time
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Skipping because it does not match 
a Subfolder: hotVOD/׳¢׳¨׳•׳¥ 8
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳¡׳“׳¨׳•׳×"
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Not storing folder in list because 
the path (hotVOD/׳¡׳“׳¨׳•׳×) does not match the subfolder 
(hotVOD/ערוץ 8)
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳¡׳“׳¨׳•׳×"
08/21/2012 07:56:23 PM INFO Repeat Previous line repeats 1 time
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Skipping because it does not match 
a Subfolder: hotVOD/׳¡׳“׳¨׳•׳×
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳‘׳™׳“׳•׳¨ ׳•׳?׳™׳¨׳•׳—"
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Not storing folder in list because 
the path (hotVOD/׳‘׳™׳“׳•׳¨ ׳•׳?׳™׳¨׳•׳—) does not 
match the subfolder (hotVOD/ערוץ 8)
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳‘׳™׳“׳•׳¨ ׳•׳?׳™׳¨׳•׳—"
08/21/2012 07:56:23 PM INFO Repeat Previous line repeats 1 time
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Skipping because it does not match 
a Subfolder: hotVOD/׳‘׳™׳“׳•׳¨ ׳•׳?׳™׳¨׳•׳—
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳¨׳™׳?׳?׳™׳˜׳™"
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Not storing folder in list because 
the path (hotVOD/׳¨׳™׳?׳?׳™׳˜׳™) does not match the subfolder 
(hotVOD/ערוץ 8)
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳¨׳™׳?׳?׳™׳˜׳™"
08/21/2012 07:56:23 PM INFO Repeat Previous line repeats 1 time
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Skipping because it does not match 
a Subfolder: hotVOD/׳¨׳™׳?׳?׳™׳˜׳™
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳”׳—׳™׳™׳? ׳”׳˜׳•׳‘׳™׳?"
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Not storing folder in list because 
the path (hotVOD/׳”׳—׳™׳™׳? ׳”׳˜׳•׳‘׳™׳?) does not 
match the subfolder (hotVOD/ערוץ 8)
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches 
"hotVOD/׳”׳—׳™׳™׳? ׳”׳˜׳•׳‘׳™׳?"
08/21/2012 07:56:23 PM INFO Repeat Previous line repeats 1 time
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Skipping because it does not match 
a Subfolder: hotVOD/׳”׳—׳™׳™׳? ׳”׳˜׳•׳‘׳™׳?
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches "hotVOD/Young"
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Not storing folder in list because 
the path (hotVOD/Young) does not match the subfolder (hotVOD/ערוץ 8)
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Exact match = false for regex 
match. Checked if Subfolder: "hotVOD/ערוץ 8" matches "hotVOD/Young"
08/21/2012 07:56:23 PM INFO Repeat Previous line repeats 1 time
08/21/2012 07:56:23 PM DEBUG Find:Subfolder Skipping because it does not match 
a Subfolder: hotVOD/Young
08/21/2012 07:56:23 PM ERROR Find:Subfolder No matching subfolder named 
"hotVOD/ערוץ 8" was found. Skipping
08/21/2012 07:56:23 PM INFO Clean:hotVOD Found 0 videos that are already 
archived in dropbox from source "hotVOD"
08/21/2012 07:56:23 PM NOTICE Clean:hotVOD Cleaning dropbox of videos no longer 
used from source: "hotVOD". Filecount from dropbox from this source is 
currently: 0
08/21/2012 07:56:23 PM NOTICE Clean:hotVOD After cleaning dropbox, 0 old files 
were deleted for a new size of 0 files
08/21/2012 07:56:23 PM NOTICE Clean:hotVOD No videos were successfully 
archived, skipping XBMC Library scan.
08/21/2012 07:56:23 PM NOTICE Clean Up Cleaning up dropbox...
08/21/2012 07:56:23 PM INFO Clean Up Checking 0 archived strm videos in dropbox 
to make sure the archived video is still valid.
08/21/2012 07:56:23 PM NOTICE Clean Up After removing 0 old videos from 
dropbox, number of videos is now: 0
08/21/2012 07:56:23 PM NOTICE Clean Up Done with dropbox clean-up
08/21/2012 07:56:23 PM DEBUG CacheExpiration Successfully cleared out 0 of 0 
cached XML files.
08/21/2012 07:56:23 PM INFO LogExpiration Deleting logfiles older than 30 days 
(07/22/2012 07:56:23 PM)
08/21/2012 07:56:23 PM DEBUG LogExpiration Not expired, only 0 days old 
(08/21/2012 07:56:22 PM): 
C:\1\XBMC.MyLibrary-1.3.1\logs\XBMC.MyLibrary.2012-08-21.log
08/21/2012 07:56:23 PM INFO LogExpiration Checked 1 log files, deleted 0 
expired log files.
08/21/2012 07:56:23 PM NOTICE Summary:---Overa ----------------------Archiving 
Summary for ---Overall-------------------------
08/21/2012 07:56:23 PM NOTICE Summary:---Overa TV Success: 0, TV Fail: 0
08/21/2012 07:56:23 PM NOTICE Summary:---Overa Movie Success: 0, Movie Fail: 0
08/21/2012 07:56:23 PM NOTICE Summary:---Overa Music Video Success: 0, Music 
Video Fail: 0
08/21/2012 07:56:23 PM NOTICE Summary:---Overa Generic Success: 0, Generic 
Fail: 0
08/21/2012 07:56:23 PM NOTICE Summary:---Overa New videos archived: 0, existing 
videos updated: 0
08/21/2012 07:56:23 PM NOTICE Summary:---Overa Overall: Success: 0, Skip: 0, 
Fail: 0
08/21/2012 07:56:23 PM NOTICE Ending Done... Total processing time: 0 
minute(s), 0 second(s)

here is the config file:

    <SearchFilters>
        <!--
        See here for sample search filter configurations: https://docs.google.com/document/d/1CDbdU1GOJlIblwGH8vaJT5c_99lK5H-gRMe3CFpZpUs/edit?hl=en#bookmark=id.g4i0iqa50b0b
        -->

        <hotVOD path="plugin://plugin.video.hotVOD.video" >

            <!-- All episodes over 20 minutes long in any subdirectory of the following shows -->
            <!-- Had to list each show separately because the tool doesn't allow you to specify the plugin root -->
            <subfolder name="ערוץ 8" type="generic" >  

            </subfolder>        

        </hotVOD>

    </SearchFilters>

Original comment by eyalzar...@gmail.com on 22 Aug 2012 at 10:54

GoogleCodeExporter commented 9 years ago 
hey.
any news about this?
thanks

Original comment by eyalzar...@gmail.com on 16 Sep 2012 at 5:14

GoogleCodeExporter commented 9 years ago 
Polish characters are broken too. 
Looking at the code it seems that in Archiver.getDropboxDestNoExt method the 
finalLocation is set to dropbox location (filename on the disc). This method 
makes "safe" filename by replacing all non-iso characters, replacing some of 
them etc.
There is probably bug in code which uses this finalLocation instead of title.

Original comment by mnaza...@gmail.com on 1 May 2013 at 6:14