search

kitodo / kitodo-production

Kitodo.Production is a workflow management tool for mass digitization and is part of the Kitodo Digital Library Suite.
http://www.kitodo.org/software/kitodoproduction/
GNU General Public License v3.0
62 stars 63 forks source link

Warnings during database migration #6132

Open stweil opened 1 month ago

stweil commented 1 month ago

Describe the bug Flyway reports several warnings during the migration of an older database. Six of them (look like wrong or incomplete migration rules ("duplicate entry"):

[INFO] --- flyway:10.15.2:baseline (default) @ kitodo-data-management ---
[INFO] Database: jdbc:mysql://localhost/kitodo (MySQL 11.4)
[WARNING] Flyway upgrade recommended: MariaDB 11.4 is newer than this version of Flyway and support has not been tested. The latest supported version of MariaDB is 11.2.
[INFO] Creating Schema History table `kitodo`.`flyway_schema_history` with baseline ...
[INFO] Successfully baselined schema with version: 1
[INFO] 
[INFO] --- flyway:10.15.2:migrate (default) @ kitodo-data-management ---
[INFO] Database: jdbc:mysql://localhost/kitodo (MySQL 11.4)
[WARNING] Flyway upgrade recommended: MariaDB 11.4 is newer than this version of Flyway and support has not been tested. The latest supported version of MariaDB is 11.2.
[INFO] Successfully validated 133 migrations (execution time 00:00.025s)
[INFO] Current version of schema `kitodo`: 1
[INFO] Migrating schema `kitodo` to version "2.0 - Translate tables names English"
[INFO] Migrating schema `kitodo` to version "2.1 - Translate columns names to English"
[INFO] Migrating schema `kitodo` to version "2.2 - Remove dangling data"
[INFO] Migrating schema `kitodo` to version "2.3 - Add foreign keys"
[INFO] Migrating schema `kitodo` to version "2.4 - Adjust database for datamanagement module"
[INFO] Migrating schema `kitodo` to version "2.5 - Rename docket name"
[INFO] Migrating schema `kitodo` to version "2.6 - Store properties only in one table"
[INFO] Migrating schema `kitodo` to version "2.7 - Add column indexAction for ElasticSearch"
[INFO] Migrating schema `kitodo` to version "2.8 - Add uri field to process"
[INFO] Migrating schema `kitodo` to version "2.9 - Move user property to filter table"
[INFO] Migrating schema `kitodo` to version "2.10 - Change visible from varchar to tinyint"
[INFO] Migrating schema `kitodo` to version "2.11 - Remove script columns from task table"
[INFO] Migrating schema `kitodo` to version "2.12 - Convert encoding of tables to utf8"
[INFO] Migrating schema `kitodo` to version "2.13 - Set css values of users to null"
[INFO] Migrating schema `kitodo` to version "2.14 - Remove module from task"
[INFO] Migrating schema `kitodo` to version "2.15 - Remove plugins from task"
[INFO] Migrating schema `kitodo` to version "2.16 - Rename and remove columns in task"
[INFO] Migrating schema `kitodo` to version "2.17 - Add authorization table"
[INFO] Migrating schema `kitodo` to version "2.18 - Change process id to not null for template"
[INFO] Migrating schema `kitodo` to version "2.19 - Set properies to unique not null"
[INFO] Migrating schema `kitodo` to version "2.20 - Simplify properties"
[INFO] Migrating schema `kitodo` to version "2.21 - Remove container column from property table"
[INFO] Migrating schema `kitodo` to version "2.22 - Add ldapServer table"
[INFO] Migrating schema `kitodo` to version "2.23 - Rename authorization add client project relation"
[INFO] Migrating schema `kitodo` to version "2.24 - Add assignable columns to authority table"
[INFO] Migrating schema `kitodo` to version "2.25 - Remove history table"
[INFO] Migrating schema `kitodo` to version "2.26 - Add first authorities"
[WARNING] DB: Duplicate entry '1-1' for key 'PRIMARY' (SQL State: 23000 - Error Code: 1062)
[INFO] Migrating schema `kitodo` to version "2.27 - Replace project archived with active"
[INFO] Migrating schema `kitodo` to version "2.28 - Remove permission column from userGroup add authorities"
[INFO] Migrating schema `kitodo` to version "2.29 - Split processes and templates"
[INFO] Migrating schema `kitodo` to version "2.30 - Remove template column from process"
[INFO] Migrating schema `kitodo` to version "2.31 - Remove session timeout in user table"
[INFO] Migrating schema `kitodo` to version "2.32 - Add workflow table"
[INFO] Migrating schema `kitodo` to version "2.33 - Add workflowId column to task table"
[INFO] Migrating schema `kitodo` to version "2.34 - Add authorities"
[INFO] Migrating schema `kitodo` to version "2.35 - Add flags for workflow"
[INFO] Migrating schema `kitodo` to version "2.36 - Add active flags to docket ruleset workflow"
[INFO] Migrating schema `kitodo` to version "2.37 - Add indexAction to workflow table"
[INFO] Migrating schema `kitodo` to version "2.38 - Add client column to docket and ruleset"
[INFO] Migrating schema `kitodo` to version "2.39 - Add language column to user table"
[INFO] Migrating schema `kitodo` to version "2.40 - Change projectfilegroup to folder"
[INFO] Migrating schema `kitodo` to version "2.41 - Add active flag to template"
[INFO] Migrating schema `kitodo` to version "2.42 - Change project template to many"
[INFO] Migrating schema `kitodo` to version "2.43 - Add dummy client"
[INFO] Migrating schema `kitodo` to version "2.44 - Change authority concept"
[INFO] Migrating schema `kitodo` to version "2.45 - Add selectable folders to project"
[INFO] Migrating schema `kitodo` to version "2.46 - Increase length of scriptPath"
[INFO] Migrating schema `kitodo` to version "2.47 - Remove column outputName"
[INFO] Migrating schema `kitodo` to version "2.48 - Add first example workflow"
[INFO] Migrating schema `kitodo` to version "2.49 - Remove css column"
[INFO] Migrating schema `kitodo` to version "2.50 - Add missing rights for workflow"
[INFO] Migrating schema `kitodo` to version "2.51 - Create table contentFolders task x folder"
[INFO] Migrating schema `kitodo` to version "2.52 - Remove importfilebyupload and exportrussian"
[INFO] Migrating schema `kitodo` to version "2.53 - Add missing authorities"
[INFO] Migrating schema `kitodo` to version "2.54 - update LDAP Group table"
[INFO] Migrating schema `kitodo` to version "2.55 - Create table validationFolders task x folder"
[INFO] Migrating schema `kitodo` to version "2.56 - Add client user group remove user task"
[INFO] Migrating schema `kitodo` to version "2.57 - Remove project authorities"
[INFO] Migrating schema `kitodo` to version "2.58 - Change relationship usegroup client and add dumy client to docket ruleset and usergroup"
[INFO] Migrating schema `kitodo` to version "2.59 - Change usergroup to role"
[INFO] Migrating schema `kitodo` to version "2.60 - Add client to workflow"
[INFO] Migrating schema `kitodo` to version "2.61 - Add initial authorties"
[WARNING] DB: Duplicate entry 'Administration' for key 'title' (SQL State: 23000 - Error Code: 1062)
[WARNING] DB: Duplicate entry 'ProjectManagement' for key 'title' (SQL State: 23000 - Error Code: 1062)
[WARNING] DB: Duplicate entry 'Metadata' for key 'title' (SQL State: 23000 - Error Code: 1062)
[WARNING] DB: Duplicate entry 'Scanning' for key 'title' (SQL State: 23000 - Error Code: 1062)
[INFO] Migrating schema `kitodo` to version "2.62 - Convert encoding of project x template table to utf8"
[INFO] Migrating schema `kitodo` to version "2.63 - Add columns for parallel tasks"
[INFO] Migrating schema `kitodo` to version "2.64 - Fill values for last and concurrent"
[INFO] Migrating schema `kitodo` to version "2.65 - Remove wikifield from template"
[INFO] Migrating schema `kitodo` to version "2.66 - Remove index column from client user and role"
[INFO] Migrating schema `kitodo` to version "2.67 - Add workflowcondition table"
[INFO] Migrating schema `kitodo` to version "2.68 - Add table for list columns"
[INFO] Migrating schema `kitodo` to version "2.69 - Remove filename column in workflow and index column in authority"
[INFO] Migrating schema `kitodo` to version "2.70 - Change active and ready to status in workflow"
[INFO] Migrating schema `kitodo` to version "2.71 - Update initial roles"
[INFO] Migrating schema `kitodo` to version "2.72 - Add client to template"
[INFO] Migrating schema `kitodo` to version "2.73 - Add autohrities for authorities management"
[WARNING] DB: Duplicate entry 'viewAllAuthorities_globalAssignable' for key 'title' (SQL State: 23000 - Error Code: 1062)
[INFO] Migrating schema `kitodo` to version "2.74 - Add repeatOnCorrection to task table"
[INFO] Migrating schema `kitodo` to version "2.75 - Add comment table"
[INFO] Migrating schema `kitodo` to version "2.76 - Add exportprocess authority"
[INFO] Migrating schema `kitodo` to version "2.77 - Add task list columns"
[INFO] Migrating schema `kitodo` to version "2.78 - Add hierarchy columns to process"
[INFO] Migrating schema `kitodo` to version "2.79 - Increase comment message size"
[INFO] Migrating schema `kitodo` to version "2.80 - Replace priority with correction"
[INFO] Migrating schema `kitodo` to version "2.81 - Remove unique from role title"
[INFO] Migrating schema `kitodo` to version "2.82 - Remove obsolete project fields"
[INFO] Migrating schema `kitodo` to version "2.83 - Remove unique from project title"
[INFO] Migrating schema `kitodo` to version "2.84 - Add separateStructure to task table"
[INFO] Migrating schema `kitodo` to version "2.85 - Add images properties to task table"
[INFO] Migrating schema `kitodo` to version "2.86 - Add validateFolder to folder table"
[INFO] Migrating schema `kitodo` to version "2.87 - Delete contentFolders and validationFolders"
[INFO] Migrating schema `kitodo` to version "2.88 - Add Database statistics authority and role"
[INFO] Migrating schema `kitodo` to version "2.89 - Remove dms import timeout"
[INFO] Migrating schema `kitodo` to version "2.90 - Delete templates"
[INFO] Migrating schema `kitodo` to version "2.91 - Add exported flag"
[INFO] Migrating schema `kitodo` to version "2.92 - Remove unused columns from project"
[INFO] Migrating schema `kitodo` to version "2.93 - Change URI to String"
[INFO] Migrating schema `kitodo` to version "2.94 - Add correctionMessage list columns"
[INFO] Migrating schema `kitodo` to version "2.95 - Add list column for process id"
[INFO] Migrating schema `kitodo` to version "2.96 - Remove format columns from project"
[INFO] Migrating schema `kitodo` to version "2.97 - Add columns for last processed task"
[INFO] Migrating schema `kitodo` to version "2.98 - Add user shortcuts"
[INFO] Migrating schema `kitodo` to version "2.99 - Set booleans not null"
[INFO] Migrating schema `kitodo` to version "2.100 - Add authorities for system page tabs"
[INFO] Migrating schema `kitodo` to version "2.101 - Add table for metadataeditor settings"
[INFO] Migrating schema `kitodo` to version "2.102 - Add Authorities for unassign tasks"
[INFO] Migrating schema `kitodo` to version "2.103 - Rename list column user active to logged in"
[INFO] Migrating schema `kitodo` to version "2.104 - Move separateStructure to workflow"
[INFO] Migrating schema `kitodo` to version "2.105 - Fixes #3998"
[INFO] Migrating schema `kitodo` to version "2.106 - Remove inChoiceListShown column from templates"
[INFO] Migrating schema `kitodo` to version "2.107 - Add authorities for upload and delete media"
[INFO] Migrating schema `kitodo` to version "2.108 - Add authority to run Kitodo Scripts"
[INFO] Migrating schema `kitodo` to version "2.109 - Add opac config table"
[INFO] Migrating schema `kitodo` to version "2.110 - Add sorting column to importconfiguration mappingfile cross table"
[INFO] Migrating schema `kitodo` to version "2.111 - Add identifier metadata column to import configuration"
[INFO] Migrating schema `kitodo` to version "2.112 - Add prestructred flag to mapping file table"
[INFO] Migrating schema `kitodo` to version "2.113 - Remove parent element xpath from import configuration"
[INFO] Migrating schema `kitodo` to version "2.114 - Add metadata record id and namespace to importconfiguration"
[INFO] Migrating schema `kitodo` to version "2.115 - Make identifier metadata nullable"
[INFO] Migrating schema `kitodo` to version "2.116 - Add url parameter table"
[INFO] Migrating schema `kitodo` to version "2.117 - Remove identifier metadata column"
[INFO] Migrating schema `kitodo` to version "2.118 - Remove unused parent element type column"
[INFO] Migrating schema `kitodo` to version "2.119 - Rename correctionMessage list column"
[INFO] Migrating schema `kitodo` to version "2.120 - Add metadata editor default settings to user"
[INFO] Migrating schema `kitodo` to version "2.121 - Add selectable audio video preview and mediaview folders to project"
[INFO] Migrating schema `kitodo` to version "2.122 - Add second default configuration for child processes to project"
[INFO] Migrating schema `kitodo` to version "2.123 - Replace old sorthelperstatus value"
[INFO] Migrating schema `kitodo` to version "2.124 - Add permission to rename media"
[INFO] Migrating schema `kitodo` to version "2.125 - Add audio media view waveform to project"
[INFO] Migrating schema `kitodo` to version "2.126 - Add authority and fields for ocrd workflows"
[INFO] Migrating schema `kitodo` to version "2.127 - Add preview tooltip to project"
[INFO] Migrating schema `kitodo` to version "2.128 - Add default pagination scope"
[INFO] Migrating schema `kitodo` to version "2.129 - Delete column imageScale"
[INFO] Migrating schema `kitodo` to version "2.130 - Add relation between importconfiguration and client"
[INFO] Successfully applied 131 migrations to schema `kitodo`, now at version v2.130 (execution time 00:22.077s)
[WARNING] Flyway upgrade recommended: MariaDB 11.4 is newer than this version of Flyway and support has not been tested. The latest supported version of MariaDB is 11.2.

To Reproduce Steps to reproduce the behavior:

  1. Run CI
  2. See warnings

Expected behavior No warnings.

Release git master

henning-gerhardt commented 1 month ago

This warnings are well known - at least for me and can be ignored. Fixing them would break all running installations which updating / maintaining their Kitodo.Production database with FlyWay. Even FlyWay recommend that fixing this should be avoided.