mediathekview / plugin.video.mediathekview

Kodi plugin that gives access to most video-platforms from German public service broadcasters using the database of MediathekView.de
https://mediathekview.de/download/#mediathekview-f%C3%BCr-kodi-fr%C3%BCher-xbmc
MIT License
55 stars 25 forks source link

import with lots of errors #181

Closed cheese1 closed 4 years ago

cheese1 commented 4 years ago

my database is mysql and i use the script to update as follows: [plugin.video.mediathekview (master)]$ python3 mvupdate3 mysql --host 192.168.3.3 --user mediathekview --password XYZ --database mediathekview 2020-10-24 17:01:52.524565 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87, ei...' for column .._description at row 1 2020-10-24 17:01:54.103393 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87: "H...' for column .._title at row 1 2020-10-24 17:01:54.179391 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC5\x99\xC3\xAD H...' for column .._title at row 1 2020-10-24 17:01:54.394733 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87 auf...' for column .._title at row 1 2020-10-24 17:01:54.459545 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x8Dar a...' for column .._title at row 1 2020-10-24 17:01:55.879715 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87 f\xC3\xA4...' for column .._description at row 1 2020-10-24 17:01:56.072916 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x86evap...' for column .._description at row 1 2020-10-24 17:02:01.615727 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xCC\x88r Ph...' for column .._description at row 1 2020-10-24 17:02:03.883864 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC2\x96 geh...' for column .._title at row 1 2020-10-24 17:02:04.052826 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC5\x8Dkai ...' for column .._description at row 1 2020-10-24 17:02:06.107963 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x9Flu \xC3...' for column .._title at row 1 2020-10-24 17:02:07.064595 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xEF\xAC\x81e. ...' for column .._description at row 1 2020-10-24 17:02:07.099838 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87' for column .._title at row 1 2020-10-24 17:02:07.265197 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC2\x85.", ...' for column .._description at row 1 2020-10-24 17:02:07.285761 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87 \xC3\xBCb...' for column .._title at row 1 2020-10-24 17:02:07.451626 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x9Flu b...' for column .._description at row 1 2020-10-24 17:02:07.530342 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xE2\x80\xAF-\xE2\x80...' for column .._description at row 1 2020-10-24 17:02:07.547442 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x9Flu, ...' for column .._description at row 1 2020-10-24 17:02:07.959691 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\xB1 Erd...' for column .._title at row 1 2020-10-24 17:02:07.965798 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC7\x92gan ...' for column .._description at row 1 2020-10-24 17:02:09.155144 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87, \xC2\xAB...' for column .._description at row 1 2020-10-24 17:02:11.236855 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC5\x99\xC3\xA1k' for column .._title at row 1 2020-10-24 17:02:24.130095 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xCC\x88lder...' for column .._description at row 1 2020-10-24 17:02:30.229158 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC5\x8D im ...' for column .._title at row 1

Space2Walker commented 4 years ago

I would say you created the schema yourself and chose the wrong char-set. you must either let mvupdate create the schema or create one with "utf8".

i know that because i made the same mistake yesterday

cheese1 commented 4 years ago

agreed.

Space2Walker commented 4 years ago

@cheese1 when the problem is resolved you could close the issue. the close button is to the left of the comment button

cheese1 commented 4 years ago

the original problem seems to be fixed. i droped the complete database and started and get a new error with corrupt dates:

2020-10-24 19:28:01.974491 INFO [mvupdate3-0.6.4]: Startup 2020-10-24 19:28:01.974584 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Database driver: External (mysql) 2020-10-24 19:28:01.974637 INFO [mvupdate3-0.6.4:StoreMySQL]: Using MySQL connector version 8.0.20 2020-10-24 19:28:01.986066 INFO [mvupdate3-0.6.4:StoreMySQL]: Connected to server 192.168.3.3 running 10.3.22-MariaDB 2020-10-24 19:28:01.986453 INFO [mvupdate3-0.6.4:StoreMySQL]: === DATABASE mediathekview DOES NOT EXIST. TRYING TO CREATE IT === 2020-10-24 19:28:03.672523 INFO [mvupdate3-0.6.4:StoreMySQL]: Database creation successfully completed 2020-10-24 19:28:03.672649 INFO [mvupdate3-0.6.4]: Starting up... 2020-10-24 19:28:03.674870 INFO [mvupdate3-0.6.4]: Initiating full update... 2020-10-24 19:28:03.674995 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Cleaning up old downloads... 2020-10-24 19:28:03.675114 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Trying to download Filmliste-akt.xz from https://liste.mediathekview.de/Filmliste-akt.xz... 2020-10-24 19:28:27.260343 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Trying to decompress xz file... 2020-10-24 19:28:31.854611 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Return 0 2020-10-24 19:28:35.565356 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Starting import of 416241 records from ./Filmliste-akt 2020-10-24 19:28:35.565457 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Initializing update... 2020-10-24 19:28:35.641105 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Filmliste dated 24.10.2020, 18:13 2020-10-24 19:28:35.641242 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (0%): channels:0, shows:0, movies:0 ... 2020-10-24 19:28:42.825144 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (0%): channels:1, shows:17, movies:1000 ... 2020-10-24 19:28:48.705839 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (0%): channels:1, shows:48, movies:2000 ... 2020-10-24 19:28:53.660030 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (0%): channels:1, shows:50, movies:3000 ... 2020-10-24 19:28:58.699584 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (0%): channels:1, shows:50, movies:4000 ... 2020-10-24 19:29:04.235381 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (1%): channels:1, shows:61, movies:5000 ... 2020-10-24 19:29:09.402064 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (1%): channels:1, shows:62, movies:6000 ... 2020-10-24 19:29:14.957930 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (1%): channels:1, shows:62, movies:7000 ... 2020-10-24 19:29:19.910053 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (1%): channels:1, shows:63, movies:8000 ... 2020-10-24 19:29:25.450131 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (2%): channels:1, shows:78, movies:9000 ... 2020-10-24 19:29:31.865751 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (2%): channels:1, shows:89, movies:10000 ... 2020-10-24 19:29:38.254355 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (2%): channels:2, shows:119, movies:11000 ... 2020-10-24 19:29:44.595425 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (2%): channels:2, shows:155, movies:12000 ... 2020-10-24 19:29:44.723658 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1292, 1292 (22007): Incorrect datetime value: '1965-12-17 15:48:00' for column .._aired at row 1 2020-10-24 19:29:44.731750 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1292, 1292 (22007): Incorrect datetime value: '1965-12-30 00:00:00' for column .._aired at row 1

Space2Walker commented 4 years ago

The problem is already known. It is the same i have #180 and is properly related to #175 We will have do wait for a fix, but for the time your db will working except content with date 1950-1969

cheese1 commented 4 years ago

a great. thanks for pointing me in that diretion