The sanity check script has spotted a number of duplicated issue IDs (n = 127) and of duplicated content item IDs (n= 8042) in the BNF data in s3://original-canonical-testing (see below for full lists).
To be checked if these issues are already contained in the input data (it is possible, and it happened already with other datasets), or it's a bug of the importer.
Interestingly there are some issue IDs occurring 3 and 4 times (!), which is very weird indeed.
The sanity check script has spotted a number of duplicated issue IDs (n = 127) and of duplicated content item IDs (n= 8042) in the BNF data in
s3://original-canonical-testing(see below for full lists).To be checked if these issues are already contained in the input data (it is possible, and it happened already with other datasets), or it's a bug of the importer.
Interestingly there are some issue IDs occurring 3 and 4 times (!), which is very weird indeed.
List of duplicated issue IDs: [{'issue_id': 'oeuvre-1919-11-16-a', 'freq': 2}, {'issue_id': 'oeuvre-1928-08-08-a', 'freq': 2}, {'issue_id': 'oeuvre-1928-06-06-a', 'freq': 2}, {'issue_id': 'oeuvre-1928-05-05-a', 'freq': 2}, {'issue_id': 'oeuvre-1928-10-10-a', 'freq': 2}, {'issue_id': 'oeuvre-1928-12-12-a', 'freq': 2}, {'issue_id': 'oeuvre-1928-03-03-a', 'freq': 2}, {'issue_id': 'oeuvre-1928-02-02-a', 'freq': 2}, {'issue_id': 'oeuvre-1928-04-04-a', 'freq': 2}, {'issue_id': 'oeuvre-1928-07-07-a', 'freq': 2}, {'issue_id': 'oeuvre-1928-11-11-a', 'freq': 2}, {'issue_id': 'oeuvre-1928-09-09-a', 'freq': 2}, {'issue_id': 'oeuvre-1928-01-03-a', 'freq': 2}, {'issue_id': 'oeuvre-1929-05-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1929-01-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1929-02-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1929-03-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1929-11-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1929-10-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1929-12-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1929-06-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1929-04-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1929-08-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1929-09-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1929-07-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1930-03-06-a', 'freq': 2}, {'issue_id': 'oeuvre-1930-06-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1930-04-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1930-01-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1930-05-10-a', 'freq': 2}, {'issue_id': 'oeuvre-1930-02-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1930-09-12-a', 'freq': 2}, {'issue_id': 'oeuvre-1930-07-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1931-10-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1931-06-11-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-05-06-a', 'freq': 3}, {'issue_id': 'oeuvre-1935-05-13-a', 'freq': 3}, {'issue_id': 'oeuvre-1935-05-25-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-05-27-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-05-31-a', 'freq': 4}, {'issue_id': 'oeuvre-1935-06-05-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-06-06-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-05-26-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-06-02-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-06-07-a', 'freq': 3}, {'issue_id': 'oeuvre-1935-05-02-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-06-19-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-05-09-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-06-29-a', 'freq': 3}, {'issue_id': 'oeuvre-1935-05-16-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-06-08-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-06-16-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-06-30-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-05-20-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-05-22-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-05-19-a', 'freq': 2}, {'issue_id': 'oeuvre-1935-06-01-a', 'freq': 2}, {'issue_id': 'oeuvre-1941-05-05-a', 'freq': 2}, {'issue_id': 'lafronde-1898-03-03-a', 'freq': 2}, {'issue_id': 'lafronde-1898-12-20-a', 'freq': 2}, {'issue_id': 'lafronde-1898-03-26-a', 'freq': 2}, {'issue_id': 'lafronde-1899-12-04-a', 'freq': 2}, {'issue_id': 'lafronde-1899-04-06-a', 'freq': 2}, {'issue_id': 'lafronde-1899-04-23-a', 'freq': 2}, {'issue_id': 'lafronde-1899-08-25-a', 'freq': 2}, {'issue_id': 'lafronde-1900-05-30-a', 'freq': 2}, {'issue_id': 'lafronde-1900-07-11-a', 'freq': 2}, {'issue_id': 'lafronde-1900-06-25-a', 'freq': 2}, {'issue_id': 'lafronde-1900-08-10-a', 'freq': 2}, {'issue_id': 'lafronde-1900-08-13-a', 'freq': 2}, {'issue_id': 'lafronde-1900-08-16-a', 'freq': 2}, {'issue_id': 'lafronde-1900-08-28-a', 'freq': 2}, {'issue_id': 'lafronde-1901-07-19-a', 'freq': 2}, {'issue_id': 'lafronde-1901-05-28-a', 'freq': 2}, {'issue_id': 'lafronde-1901-07-14-a', 'freq': 2}, {'issue_id': 'lafronde-1901-03-03-a', 'freq': 2}, {'issue_id': 'lafronde-1901-05-08-a', 'freq': 2}, {'issue_id': 'lafronde-1901-05-11-a', 'freq': 2}, {'issue_id': 'lafronde-1901-05-12-a', 'freq': 2}, {'issue_id': 'lafronde-1902-03-10-a', 'freq': 2}, {'issue_id': 'lafronde-1902-03-14-a', 'freq': 2}, {'issue_id': 'lafronde-1902-10-03-a', 'freq': 2}, {'issue_id': 'lafronde-1903-01-16-a', 'freq': 2}, {'issue_id': 'lafronde-1903-01-25-a', 'freq': 2}, {'issue_id': 'lafronde-1903-05-15-a', 'freq': 2}, {'issue_id': 'lafronde-1903-07-05-a', 'freq': 2}, {'issue_id': 'lafronde-1903-07-08-a', 'freq': 2}, {'issue_id': 'lafronde-1903-08-05-a', 'freq': 2}, {'issue_id': 'lafronde-1926-11-05-a', 'freq': 2}, {'issue_id': 'excelsior-1913-10-03-a', 'freq': 2}, {'issue_id': 'excelsior-1914-03-17-a', 'freq': 2}, {'issue_id': 'excelsior-1914-03-24-a', 'freq': 2}, {'issue_id': 'excelsior-1914-03-31-a', 'freq': 2}, {'issue_id': 'excelsior-1914-04-07-a', 'freq': 2}, {'issue_id': 'excelsior-1914-04-14-a', 'freq': 2}, {'issue_id': 'excelsior-1914-04-21-a', 'freq': 2}, {'issue_id': 'excelsior-1914-04-28-a', 'freq': 2}, {'issue_id': 'excelsior-1914-05-05-a', 'freq': 2}, {'issue_id': 'excelsior-1914-05-12-a', 'freq': 2}, {'issue_id': 'excelsior-1914-05-19-a', 'freq': 2}, {'issue_id': 'excelsior-1914-05-26-a', 'freq': 2}, {'issue_id': 'excelsior-1914-06-02-a', 'freq': 2}, {'issue_id': 'excelsior-1914-06-09-a', 'freq': 2}, {'issue_id': 'excelsior-1914-06-16-a', 'freq': 2}, {'issue_id': 'excelsior-1914-06-23-a', 'freq': 2}, {'issue_id': 'excelsior-1914-06-30-a', 'freq': 2}, {'issue_id': 'excelsior-1914-07-07-a', 'freq': 2}, {'issue_id': 'excelsior-1914-07-14-a', 'freq': 2}, {'issue_id': 'excelsior-1914-07-21-a', 'freq': 2}, {'issue_id': 'excelsior-1914-07-30-a', 'freq': 2}, {'issue_id': 'excelsior-1915-07-31-a', 'freq': 2}, {'issue_id': 'excelsior-1915-08-07-a', 'freq': 2}, {'issue_id': 'excelsior-1915-08-14-a', 'freq': 2}, {'issue_id': 'excelsior-1915-08-21-a', 'freq': 2}, {'issue_id': 'excelsior-1915-08-28-a', 'freq': 2}, {'issue_id': 'excelsior-1915-09-04-a', 'freq': 2}, {'issue_id': 'excelsior-1915-09-11-a', 'freq': 2}, {'issue_id': 'excelsior-1915-10-10-a', 'freq': 2}, {'issue_id': 'excelsior-1915-10-17-a', 'freq': 2}, {'issue_id': 'excelsior-1915-10-24-a', 'freq': 2}, {'issue_id': 'excelsior-1915-11-07-a', 'freq': 2}, {'issue_id': 'excelsior-1915-11-14-a', 'freq': 2}, {'issue_id': 'excelsior-1915-11-21-a', 'freq': 2}, {'issue_id': 'excelsior-1915-11-28-a', 'freq': 2}, {'issue_id': 'excelsior-1915-12-05-a', 'freq': 2}, {'issue_id': 'excelsior-1915-12-12-a', 'freq': 2}, {'issue_id': 'excelsior-1915-12-19-a', 'freq': 2}]
List of duplicated content item IDs: