search

paradisec-archive / nabu

nabu is a digital media item management system that provides a catalog of audio and video items, metadata for these items, and information about the workflow status of the items.
GNU General Public License v3.0
19 stars 8 forks source link

essence files uploading but not listed in catalogue #295

Closed jangari closed 9 years ago

jangari commented 11 years ago

I've noticed there are some files that have been harvested from Azoulay by the Nabu server and stored in the archive, but have not been included in the catalogue as yet.

In particular, see RN1: http://catalog.paradisec.org.au/collections/RN1/items/005004

The item page say there are no essence files, yet four exist in the archive (not including the hidden xml file):

aidan@catalog:/srv/catalog/RN1/005004$ ls -l
total 993600
-rwxrw-rw- 1 deploy deploy  18167936 Dec  4 15:27 RN1-005004-A.mp3
-rw-rw-rw- 1 deploy deploy 666845638 Dec  4 15:24 RN1-005004-A.wav
-rwxrw-rw- 1 deploy deploy   8200320 Dec  4 15:29 RN1-005004-B.mp3
-rw-rw-rw- 1 deploy deploy 324127204 Dec  4 15:31 RN1-005004-B.wav
-rw-rw-r-- 1 deploy deploy      2207 Oct 31 13:54 RN1-005004-CAT-PDSC_ADMIN.xml

This appears to be the case for all of collection RN1 since around the beginning of November (judging by the record modified date of the last item to have essence files listed).

silviapfeiffer commented 11 years ago

Are you part of the emails that get sent by the importing service? I believe these files were unable to be parsed by Nabu und that was mentioned in those emails. They may need to be re-done.

jangari commented 11 years ago

Oh, alright, I'll have a look at the correspondence/at the files.

jangari commented 11 years ago

I think this must be a Dobbin issue. Having checked two of the collections being processed both before and after the changeover, RN1 and JW1, both are showing the same behaviour; being sealed and uploaded to the archive but failing the NABU parse. Should bring @LindaBarwick and Nick FG into this discussion.

LindaBarwick commented 11 years ago

If this is due to changing over to Dobbin, then we may need to revisit the BWF headers situation. @AmandaPDSC and I can review with NickFG on Thursday or Friday (10 or 11/1). I seem to recall we had to use the Dobbin meta file format rather than the old BWF header format so as to be able to include unicode. As a first step we should see what has passed the NABU import since early November.

silviapfeiffer commented 11 years ago

We've had some other files fail earlier and NickFG was able to fix them and re-upload. He should be able to analyse the problems.

We should likely also extend the capabilities of Nabu to accept those special files. So, if NickFG could keep track of the problems that are happening and what kind of files we should eventually also import into Nabu, that would be helpful for future work.

nthieberger commented 11 years ago

Still on this issue, we have video files that were sent up to Sydney via our nightly transfer from Melbourne, but which had no catalog entry. I created a catalog entry (e.g., CI1-20050820) and thought it would then link up with the essence file. It has not, but it should.

jangari commented 11 years ago

Have the video files been archived yet? I can't seem them on the server. What do you mean 'link up'? On Nabu?

jangari commented 11 years ago

Nick FG has to take them from the fromMelb folder and drop them in Send to Archive. If NABU has entries, they'll go overnight (unless I'm mistaken). I'll look at them and move them now (or get Nick to).

silviapfeiffer commented 11 years ago

How are the files from Melbourne handled? I thought they ended up in Sydney on Azoulay to be processed through Dobbin and only then provided to Nabu just like all other files. If Nick FG hasn't processed them, they won't go to Nabu.

jangari commented 11 years ago

Video files don't need any processing, but they still need to go through Azoulay to be properly backed up by the Sydney Uni system. So the process is:

Melbourne (pdsc.rnld.unimelb.edu.au) --> Sydney (azoulay) if audio -> Dobbin -> 'send to archive' else -> 'send to archive'

--> NABU

Does that make sense?

silviapfeiffer commented 11 years ago

Sure. As long as it looks all the same to Nabu. :-)

nthieberger commented 11 years ago

OK, so we need a different transfer that bypasses handling in sydney for files that go straight to archive (video, text, pdf etc). Or else an alert to Nick FG that the files need his attention.

On 25 January 2013 11:35, Silvia Pfeiffer notifications@github.com wrote:

How are the files from Melbourne handled? I thought they ended up in Sydney on Azoulay to be processed through Dobbin and only then provided to Nabu just like all other files. If Nick FG hasn't processed them, they won't go to Nabu.

— Reply to this email directly or view it on GitHubhttps://github.com/nabu-catalog/nabu/issues/295#issuecomment-12682107.

jangari commented 11 years ago

I suppose one thing we could do is set up a dobbin script that moves wavs from the from- folders and puts them in send to seal, and anything else that arrives is sent to 'send to archive'...

silviapfeiffer commented 11 years ago

That's a script on the Azoulay server. It's independent of Nabu.

I have now changed the upload script to not remove the files in Sydney if the metadata can't be imported.

silviapfeiffer commented 11 years ago

I'm writing a script now to check if all the files are in the archive, so we can find the broken ones and fix them.

silviapfeiffer commented 11 years ago

OK, I've written the script and we have a bunch of issues to resolve. /cc: @AmandaPDSC

We have a bunch of files (and directories) that do not belong to an item. But first the good news:

These files got successfully added to the catalog:

SUCCESS: file MFD7-001-A.mp3 metadata imported into Nabu SUCCESS: file MFD7-001-A.wav metadata imported into Nabu SUCCESS: file MFD7-002-A.mp3 metadata imported into Nabu SUCCESS: file MFD7-002-A.wav metadata imported into Nabu SUCCESS: file MFD7-003-A.mp3 metadata imported into Nabu SUCCESS: file MFD7-003-A.wav metadata imported into Nabu SUCCESS: file MFD7-004-A.mp3 metadata imported into Nabu SUCCESS: file MFD7-004-A.wav metadata imported into Nabu SUCCESS: file MFD7-005-A.wav metadata imported into Nabu SUCCESS: file MFD7-005-A.mp3 metadata imported into Nabu SUCCESS: file RN1-003017-A.mp3 metadata imported into Nabu SUCCESS: file RN1-003017-B.mp3 metadata imported into Nabu SUCCESS: file RN1-003017-A.wav metadata imported into Nabu SUCCESS: file RN1-003017-B.wav metadata imported into Nabu SUCCESS: file RN1-005001-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005001-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005001-A.wav metadata imported into Nabu SUCCESS: file RN1-005001-B.wav metadata imported into Nabu SUCCESS: file RN1-005002-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005002-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005002-A.wav metadata imported into Nabu SUCCESS: file RN1-005002-B.wav metadata imported into Nabu SUCCESS: file RN1-005003-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005003-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005003-A.wav metadata imported into Nabu SUCCESS: file RN1-005003-B.wav metadata imported into Nabu SUCCESS: file RN1-005004-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005004-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005004-A.wav metadata imported into Nabu SUCCESS: file RN1-005004-B.wav metadata imported into Nabu SUCCESS: file RN1-005005-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005005-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005005-B.wav metadata imported into Nabu SUCCESS: file RN1-005005-A.wav metadata imported into Nabu SUCCESS: file RN1-007001-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007001-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007001-A.wav metadata imported into Nabu SUCCESS: file RN1-007001-B.wav metadata imported into Nabu SUCCESS: file RN1-007002-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007002-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007002-A.wav metadata imported into Nabu SUCCESS: file RN1-007002-B.wav metadata imported into Nabu SUCCESS: file RN1-007003-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007003-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007003-A.wav metadata imported into Nabu SUCCESS: file RN1-007003-B.wav metadata imported into Nabu SUCCESS: file RN1-007004-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007004-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007004-A.wav metadata imported into Nabu SUCCESS: file RN1-007004-B.wav metadata imported into Nabu SUCCESS: file RN1-007005-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007005-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007005-B.wav metadata imported into Nabu SUCCESS: file RN1-007005-A.wav metadata imported into Nabu SUCCESS: file JW1-009-B.mp3.XXXXXX metadata imported into Nabu SUCCESS: file JW1-012-B.mp3 metadata imported into Nabu SUCCESS: file JW1-012-B.wav metadata imported into Nabu SUCCESS: file JW1-020-B.mp3.XXXXXX metadata imported into Nabu SUCCESS: file JW1-023-A.mp3 metadata imported into Nabu SUCCESS: file JW1-023-A.wav metadata imported into Nabu SUCCESS: file JC1-KA01-Original.mp3 metadata imported into Nabu SUCCESS: file JC1-KA01-Original.wav metadata imported into Nabu

Now to the problem files.

Some of these are just left-over CAT xml files from items that must have got deleted. I have adapted the item deletion script to remove these in future when items get deleted. I assume I can just remove these?:

ERROR: skipping file AA1-2013-CAT-PDSC_ADMIN.xml - does not relate to an item AA1-2013 ERROR: skipping file ABT1-NSM200806201-CAT-PDSC_ADMIN.xml - does not relate to an item ABT1-NSM200806201 ERROR: skipping file CI1-080-CAT-PDSC_ADMIN.xml - does not relate to an item CI1-080 ERROR: skipping file CI1-108-CAT-PDSC_ADMIN.xml - does not relate to an item CI1-108 ERROR: skipping file MT1-test-CAT-PDSC_ADMIN.xml - does not relate to an item MT1-test ERROR: skipping file CH3-09MPWCWEverywell-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09MPWCWEverywell ERROR: skipping file CH3-09MPWCWEverywellW1pronuncia-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09MPWCWEverywellW1pronuncia ERROR: skipping file CH3-09W2SentencesRevisedWErecor-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09W2SentencesRevisedWErecor ERROR: skipping file CH3-09W2wordlistforsentencesand-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09W2wordlistforsentencesand

But what do I do with these other ones that don't have an item in the catalog? (I don't even know where they came from! They shouldn't exist):

ERROR: skipping file AC2-VNEFAT201A-001.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-002.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-003.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-004.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-005.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-006.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-007.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-008.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-009.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AS2-003-A.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-A.wav - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.wav - does not relate to an item AS2-003 ERROR: skipping file LD1-0006-PIC.jpg - does not relate to an item LD1-0006 ERROR: skipping file LG1-10092201-01.eaf - does not relate to an item LG1-10092201 ERROR: skipping file LR1-051506-01.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-02.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-03.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-04.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-05.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-06.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-052506-01.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-02.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-03.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-04.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-05.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052806-01.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-02.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-03.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-04.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-05.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-06.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-07.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-08.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-09.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-10.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-11.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-12.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-061206-01.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-02.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-03.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-04.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-05.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-06.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-07.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-08.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-09.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-10.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-11.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-12.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-A.mpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-062506-01.jpg - does not relate to an item LR1-062506 ERROR: skipping file LR1-062506-02.jpg - does not relate to an item LR1-062506 ERROR: skipping file LR1-062506-03.jpg - does not relate to an item LR1-062506 ERROR: skipping file LR1-070106-A.mpg - does not relate to an item LR1-070106 ERROR: skipping file LR1-070906-01.mpg - does not relate to an item LR1-070906 ERROR: skipping file LR1-070906-02.mpg - does not relate to an item LR1-070906 ERROR: skipping file LR1-070906-03.mpg - does not relate to an item LR1-070906 ERROR: skipping file LR1-071706-A.mpg - does not relate to an item LR1-071706 ERROR: skipping file LR1-080206-01.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-02.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-03.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-04.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-05.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-06.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-07.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-08.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-09.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-10.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-11.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-12.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080306-01.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-02.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-03.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-04.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-05.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-06.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-07.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-08.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-09.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-081306-01.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-02.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-03.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-04.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-05.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081405-01.jpg - does not relate to an item LR1-081405 ERROR: skipping file LR1-081406-02.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081406-03.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081406-04.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081406-05.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081506-01.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081506-02.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081506-03.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081506-04.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081906-01.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-02.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-03.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-04.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-05.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-06.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-07.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-082506-01.jpg - does not relate to an item LR1-082506 ERROR: skipping file LR1-083006-01.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-02.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-03.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-04.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-05.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-06.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-07.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-08.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-09.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-10.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-101606-A.mpg - does not relate to an item LR1-101606

Maybe Amanda knows about these?

And finally three files in LL1-006 that the system doesn't understand:

ERROR: invalid metadata for LL1-006-2B.wav of type wav - skipping Duration: 00:00:00.79, bitrate: -2147483 kb/s Stream #0:0: Audio: pcm_s24le ([1][0][0][0] / 0x0001), 96000 Hz, 2 channels, s32, 4608 kb/s

ERROR: invalid metadata for LL1-006-B.wav of type wav - skipping Duration: 00:00:01.58, bitrate: -2147483 kb/s Stream #0:0: Audio: pcm_s24le ([1][0][0][0] / 0x0001), 96000 Hz, 2 channels, s32, 4608 kb/s

ERROR: invalid metadata for LL1-006-2A.wav of type wav - skipping Duration: 00:00:01.58, bitrate: -2147483 kb/s Stream #0:0: Audio: pcm_s24le ([1][0][0][0] / 0x0001), 96000 Hz, 2 channels, s32, 4608 kb/s

Maybe NickFG could take a look at these?

nthieberger commented 11 years ago

Where are these files? Not in the 'send to archive' folder in Nabu on Azoulay?

On 24 February 2013 13:44, Silvia Pfeiffer notifications@github.com wrote:

OK, I've written the script and we have a bunch of issues to resolve. /cc: @AmandaPDSC https://github.com/AmandaPDSC

We have a bunch of files (and directories) that do not belong to an item. But first the good news:

These files got successfully added to the catalog:

SUCCESS: file MFD7-001-A.mp3 metadata imported into Nabu SUCCESS: file MFD7-001-A.wav metadata imported into Nabu SUCCESS: file MFD7-002-A.mp3 metadata imported into Nabu SUCCESS: file MFD7-002-A.wav metadata imported into Nabu SUCCESS: file MFD7-003-A.mp3 metadata imported into Nabu SUCCESS: file MFD7-003-A.wav metadata imported into Nabu SUCCESS: file MFD7-004-A.mp3 metadata imported into Nabu SUCCESS: file MFD7-004-A.wav metadata imported into Nabu SUCCESS: file MFD7-005-A.wav metadata imported into Nabu SUCCESS: file MFD7-005-A.mp3 metadata imported into Nabu SUCCESS: file RN1-003017-A.mp3 metadata imported into Nabu SUCCESS: file RN1-003017-B.mp3 metadata imported into Nabu SUCCESS: file RN1-003017-A.wav metadata imported into Nabu SUCCESS: file RN1-003017-B.wav metadata imported into Nabu SUCCESS: file RN1-005001-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005001-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005001-A.wav metadata imported into Nabu SUCCESS: file RN1-005001-B.wav metadata imported into Nabu SUCCESS: file RN1-005002-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005002-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005002-A.wav metadata imported into Nabu SUCCESS: file RN1-005002-B.wav metadata imported into Nabu SUCCESS: file RN1-005003-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005003-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005003-A.wav metadata imported into Nabu SUCCESS: file RN1-005003-B.wav metadata imported into Nabu SUCCESS: file RN1-005004-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005004-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005004-A.wav metadata imported into Nabu SUCCESS: file RN1-005004-B.wav metadata imported into Nabu SUCCESS: file RN1-005005-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005005-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005005-B.wav metadata imported into Nabu SUCCESS: file RN1-005005-A.wav metadata imported into Nabu SUCCESS: file RN1-007001-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007001-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007001-A.wav metadata imported into Nabu SUCCESS: file RN1-007001-B.wav metadata imported into Nabu SUCCESS: file RN1-007002-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007002-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007002-A.wav metadata imported into Nabu SUCCESS: file RN1-007002-B.wav metadata imported into Nabu SUCCESS: file RN1-007003-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007003-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007003-A.wav metadata imported into Nabu SUCCESS: file RN1-007003-B.wav metadata imported into Nabu SUCCESS: file RN1-007004-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007004-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007004-A.wav metadata imported into Nabu SUCCESS: file RN1-007004-B.wav metadata imported into Nabu SUCCESS: file RN1-007005-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007005-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007005-B.wav metadata imported into Nabu SUCCESS: file RN1-007005-A.wav metadata imported into Nabu SUCCESS: file JW1-009-B.mp3.XXXXXX metadata imported into Nabu SUCCESS: file JW1-012-B.mp3 metadata imported into Nabu SUCCESS: file JW1-012-B.wav metadata imported into Nabu SUCCESS: file JW1-020-B.mp3.XXXXXX metadata imported into Nabu SUCCESS: file JW1-023-A.mp3 metadata imported into Nabu SUCCESS: file JW1-023-A.wav metadata imported into Nabu SUCCESS: file JC1-KA01-Original.mp3 metadata imported into Nabu SUCCESS: file JC1-KA01-Original.wav metadata imported into Nabu

Now to the problem files.

Some of these are just left-over CAT xml files from items that must have got deleted. I have adapted the item deletion script to remove these in future when items get deleted. I assume I can just remove these?:

ERROR: skipping file AA1-2013-CAT-PDSC_ADMIN.xml - does not relate to an item AA1-2013 ERROR: skipping file ABT1-NSM200806201-CAT-PDSC_ADMIN.xml - does not relate to an item ABT1-NSM200806201 ERROR: skipping file CI1-080-CAT-PDSC_ADMIN.xml - does not relate to an item CI1-080 ERROR: skipping file CI1-108-CAT-PDSC_ADMIN.xml - does not relate to an item CI1-108 ERROR: skipping file MT1-test-CAT-PDSC_ADMIN.xml - does not relate to an item MT1-test ERROR: skipping file CH3-09MPWCWEverywell-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09MPWCWEverywell ERROR: skipping file CH3-09MPWCWEverywellW1pronuncia-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09MPWCWEverywellW1pronuncia ERROR: skipping file CH3-09W2SentencesRevisedWErecor-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09W2SentencesRevisedWErecor ERROR: skipping file CH3-09W2wordlistforsentencesand-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09W2wordlistforsentencesand

But what do I do with these other ones that don't have an item in the catalog? (I don't even know where they came from! They shouldn't exist):

ERROR: skipping file AC2-VNEFAT201A-001.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-002.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-003.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-004.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-005.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-006.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-007.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-008.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-009.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AS2-003-A.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-A.wav - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.wav - does not relate to an item AS2-003 ERROR: skipping file LD1-0006-PIC.jpg - does not relate to an item LD1-0006 ERROR: skipping file LG1-10092201-01.eaf - does not relate to an item LG1-10092201 ERROR: skipping file LR1-051506-01.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-02.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-03.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-04.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-05.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-06.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-052506-01.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-02.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-03.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-04.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-05.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052806-01.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-02.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-03.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-04.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-05.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-06.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-07.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-08.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-09.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-10.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-11.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-12.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-061206-01.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-02.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-03.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-04.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-05.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-06.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-07.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-08.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-09.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-10.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-11.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-12.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-A.mpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-062506-01.jpg - does not relate to an item LR1-062506 ERROR: skipping file LR1-062506-02.jpg - does not relate to an item LR1-062506 ERROR: skipping file LR1-062506-03.jpg - does not relate to an item LR1-062506 ERROR: skipping file LR1-070106-A.mpg - does not relate to an item LR1-070106 ERROR: skipping file LR1-070906-01.mpg - does not relate to an item LR1-070906 ERROR: skipping file LR1-070906-02.mpg - does not relate to an item LR1-070906 ERROR: skipping file LR1-070906-03.mpg - does not relate to an item LR1-070906 ERROR: skipping file LR1-071706-A.mpg - does not relate to an item LR1-071706 ERROR: skipping file LR1-080206-01.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-02.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-03.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-04.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-05.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-06.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-07.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-08.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-09.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-10.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-11.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-12.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080306-01.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-02.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-03.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-04.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-05.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-06.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-07.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-08.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-09.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-081306-01.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-02.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-03.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-04.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-05.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081405-01.jpg - does not relate to an item LR1-081405 ERROR: skipping file LR1-081406-02.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081406-03.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081406-04.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081406-05.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081506-01.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081506-02.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081506-03.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081506-04.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081906-01.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-02.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-03.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-04.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-05.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-06.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-07.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-082506-01.jpg - does not relate to an item LR1-082506 ERROR: skipping file LR1-083006-01.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-02.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-03.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-04.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-05.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-06.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-07.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-08.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-09.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-10.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-101606-A.mpg - does not relate to an item LR1-101606

Maybe Amanda knows about these?

And finally three files in LL1-006 that the system doesn't understand:

ERROR: invalid metadata for LL1-006-2B.wav of type wav - skipping Duration: 00:00:00.79, bitrate: -2147483 kb/s Stream #0:0: Audio: pcm_s24le ([1][0][0][0] / 0x0001), 96000 Hz, 2 channels, s32, 4608 kb/s

ERROR: invalid metadata for LL1-006-B.wav of type wav - skipping Duration: 00:00:01.58, bitrate: -2147483 kb/s Stream #0:0: Audio: pcm_s24le ([1][0][0][0] / 0x0001), 96000 Hz, 2 channels, s32, 4608 kb/s

ERROR: invalid metadata for LL1-006-2A.wav of type wav - skipping Duration: 00:00:01.58, bitrate: -2147483 kb/s Stream #0:0: Audio: pcm_s24le ([1][0][0][0] / 0x0001), 96000 Hz, 2 channels, s32, 4608 kb/s

Maybe NickFG could take a look at these?

— Reply to this email directly or view it on GitHubhttps://github.com/nabu-catalog/nabu/issues/295#issuecomment-14019133.

jangari commented 11 years ago

No, these were the files that were uploaded to NABU some time ago, but which didn't get imported into the catalogue properly, so they existed in the archive, but the files weren't listed in the catalogue.

So presumably Silvia (Thanks!) just ran a catalogue metadata harvesting script over the contents of the archive that weren't already in the system, which seems to have worked for at least a sizeable bunch.

nthieberger commented 11 years ago

So if we wanted to rename some of them where would we look?

On 24 February 2013 15:20, jangari notifications@github.com wrote:

No, these were the files that were uploaded to NABU some time ago, but which didn't get imported into the catalogue properly, so they existed in the archive, but the files weren't listed in the catalogue.

So presumably Silvia (Thanks!) just ran a catalogue metadata harvesting script over the contents of the archive that weren't already in the system, which seems to have worked for at least a sizeable bunch.

— Reply to this email directly or view it on GitHubhttps://github.com/nabu-catalog/nabu/issues/295#issuecomment-14021809.

nthieberger commented 11 years ago

I have worked through these and think most are fixable. I have written to the depositors to get their advice.

As we can't see the admin files I can't say what we should do about the following. Typically they should already exist in the first item within each collection. How can I see the files with PDSC_ADMIN?

Nick

ERROR: skipping file AA1-2013-CAT-PDSC_ADMIN.xml - does not relate to an item AA1-2013 ERROR: skipping file ABT1-NSM200806201-CAT-PDSC_ADMIN.xml - does not relate to an item ABT1-NSM200806201 ERROR: skipping file CI1-080-CAT-PDSC_ADMIN.xml - does not relate to an item CI1-080 ERROR: skipping file CI1-108-CAT-PDSC_ADMIN.xml - does not relate to an item CI1-108 ERROR: skipping file MT1-test-CAT-PDSC_ADMIN.xml - does not relate to an item MT1-test ERROR: skipping file CH3-09MPWCWEverywell-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09MPWCWEverywell ERROR: skipping file CH3-09MPWCWEverywellW1pronuncia-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09MPWCWEverywellW1pronuncia ERROR: skipping file CH3-09W2SentencesRevisedWErecor-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09W2SentencesRevisedWErecor

On 24 February 2013 13:44, Silvia Pfeiffer notifications@github.com wrote:

OK, I've written the script and we have a bunch of issues to resolve. /cc: @AmandaPDSC https://github.com/AmandaPDSC

We have a bunch of files (and directories) that do not belong to an item. But first the good news:

These files got successfully added to the catalog:

SUCCESS: file MFD7-001-A.mp3 metadata imported into Nabu SUCCESS: file MFD7-001-A.wav metadata imported into Nabu SUCCESS: file MFD7-002-A.mp3 metadata imported into Nabu SUCCESS: file MFD7-002-A.wav metadata imported into Nabu SUCCESS: file MFD7-003-A.mp3 metadata imported into Nabu SUCCESS: file MFD7-003-A.wav metadata imported into Nabu SUCCESS: file MFD7-004-A.mp3 metadata imported into Nabu SUCCESS: file MFD7-004-A.wav metadata imported into Nabu SUCCESS: file MFD7-005-A.wav metadata imported into Nabu SUCCESS: file MFD7-005-A.mp3 metadata imported into Nabu SUCCESS: file RN1-003017-A.mp3 metadata imported into Nabu SUCCESS: file RN1-003017-B.mp3 metadata imported into Nabu SUCCESS: file RN1-003017-A.wav metadata imported into Nabu SUCCESS: file RN1-003017-B.wav metadata imported into Nabu SUCCESS: file RN1-005001-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005001-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005001-A.wav metadata imported into Nabu SUCCESS: file RN1-005001-B.wav metadata imported into Nabu SUCCESS: file RN1-005002-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005002-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005002-A.wav metadata imported into Nabu SUCCESS: file RN1-005002-B.wav metadata imported into Nabu SUCCESS: file RN1-005003-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005003-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005003-A.wav metadata imported into Nabu SUCCESS: file RN1-005003-B.wav metadata imported into Nabu SUCCESS: file RN1-005004-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005004-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005004-A.wav metadata imported into Nabu SUCCESS: file RN1-005004-B.wav metadata imported into Nabu SUCCESS: file RN1-005005-B.mp3 metadata imported into Nabu SUCCESS: file RN1-005005-A.mp3 metadata imported into Nabu SUCCESS: file RN1-005005-B.wav metadata imported into Nabu SUCCESS: file RN1-005005-A.wav metadata imported into Nabu SUCCESS: file RN1-007001-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007001-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007001-A.wav metadata imported into Nabu SUCCESS: file RN1-007001-B.wav metadata imported into Nabu SUCCESS: file RN1-007002-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007002-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007002-A.wav metadata imported into Nabu SUCCESS: file RN1-007002-B.wav metadata imported into Nabu SUCCESS: file RN1-007003-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007003-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007003-A.wav metadata imported into Nabu SUCCESS: file RN1-007003-B.wav metadata imported into Nabu SUCCESS: file RN1-007004-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007004-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007004-A.wav metadata imported into Nabu SUCCESS: file RN1-007004-B.wav metadata imported into Nabu SUCCESS: file RN1-007005-A.mp3 metadata imported into Nabu SUCCESS: file RN1-007005-B.mp3 metadata imported into Nabu SUCCESS: file RN1-007005-B.wav metadata imported into Nabu SUCCESS: file RN1-007005-A.wav metadata imported into Nabu SUCCESS: file JW1-009-B.mp3.XXXXXX metadata imported into Nabu SUCCESS: file JW1-012-B.mp3 metadata imported into Nabu SUCCESS: file JW1-012-B.wav metadata imported into Nabu SUCCESS: file JW1-020-B.mp3.XXXXXX metadata imported into Nabu SUCCESS: file JW1-023-A.mp3 metadata imported into Nabu SUCCESS: file JW1-023-A.wav metadata imported into Nabu SUCCESS: file JC1-KA01-Original.mp3 metadata imported into Nabu SUCCESS: file JC1-KA01-Original.wav metadata imported into Nabu

Now to the problem files.

Some of these are just left-over CAT xml files from items that must have got deleted. I have adapted the item deletion script to remove these in future when items get deleted. I assume I can just remove these?:

ERROR: skipping file AA1-2013-CAT-PDSC_ADMIN.xml - does not relate to an item AA1-2013 ERROR: skipping file ABT1-NSM200806201-CAT-PDSC_ADMIN.xml - does not relate to an item ABT1-NSM200806201 ERROR: skipping file CI1-080-CAT-PDSC_ADMIN.xml - does not relate to an item CI1-080 ERROR: skipping file CI1-108-CAT-PDSC_ADMIN.xml - does not relate to an item CI1-108 ERROR: skipping file MT1-test-CAT-PDSC_ADMIN.xml - does not relate to an item MT1-test ERROR: skipping file CH3-09MPWCWEverywell-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09MPWCWEverywell ERROR: skipping file CH3-09MPWCWEverywellW1pronuncia-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09MPWCWEverywellW1pronuncia ERROR: skipping file CH3-09W2SentencesRevisedWErecor-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09W2SentencesRevisedWErecor ERROR: skipping file CH3-09W2wordlistforsentencesand-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09W2wordlistforsentencesand

But what do I do with these other ones that don't have an item in the catalog? (I don't even know where they came from! They shouldn't exist):

ERROR: skipping file AC2-VNEFAT201A-001.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-002.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-003.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-004.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-005.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-006.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-007.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-008.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-009.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AS2-003-A.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-A.wav - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.wav - does not relate to an item AS2-003 ERROR: skipping file LD1-0006-PIC.jpg - does not relate to an item LD1-0006 ERROR: skipping file LG1-10092201-01.eaf - does not relate to an item LG1-10092201 ERROR: skipping file LR1-051506-01.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-02.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-03.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-04.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-05.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-06.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-052506-01.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-02.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-03.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-04.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-05.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052806-01.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-02.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-03.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-04.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-05.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-06.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-07.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-08.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-09.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-10.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-11.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-12.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-061206-01.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-02.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-03.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-04.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-05.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-06.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-07.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-08.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-09.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-10.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-11.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-12.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-A.mpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-062506-01.jpg - does not relate to an item LR1-062506 ERROR: skipping file LR1-062506-02.jpg - does not relate to an item LR1-062506 ERROR: skipping file LR1-062506-03.jpg - does not relate to an item LR1-062506 ERROR: skipping file LR1-070106-A.mpg - does not relate to an item LR1-070106 ERROR: skipping file LR1-070906-01.mpg - does not relate to an item LR1-070906 ERROR: skipping file LR1-070906-02.mpg - does not relate to an item LR1-070906 ERROR: skipping file LR1-070906-03.mpg - does not relate to an item LR1-070906 ERROR: skipping file LR1-071706-A.mpg - does not relate to an item LR1-071706 ERROR: skipping file LR1-080206-01.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-02.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-03.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-04.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-05.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-06.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-07.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-08.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-09.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-10.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-11.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-12.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080306-01.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-02.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-03.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-04.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-05.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-06.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-07.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-08.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-09.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-081306-01.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-02.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-03.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-04.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-05.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081405-01.jpg - does not relate to an item LR1-081405 ERROR: skipping file LR1-081406-02.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081406-03.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081406-04.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081406-05.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081506-01.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081506-02.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081506-03.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081506-04.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081906-01.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-02.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-03.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-04.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-05.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-06.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-07.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-082506-01.jpg - does not relate to an item LR1-082506 ERROR: skipping file LR1-083006-01.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-02.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-03.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-04.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-05.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-06.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-07.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-08.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-09.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-10.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-101606-A.mpg - does not relate to an item LR1-101606

Maybe Amanda knows about these?

And finally three files in LL1-006 that the system doesn't understand:

ERROR: invalid metadata for LL1-006-2B.wav of type wav - skipping Duration: 00:00:00.79, bitrate: -2147483 kb/s Stream #0:0: Audio: pcm_s24le ([1][0][0][0] / 0x0001), 96000 Hz, 2 channels, s32, 4608 kb/s

ERROR: invalid metadata for LL1-006-B.wav of type wav - skipping Duration: 00:00:01.58, bitrate: -2147483 kb/s Stream #0:0: Audio: pcm_s24le ([1][0][0][0] / 0x0001), 96000 Hz, 2 channels, s32, 4608 kb/s

ERROR: invalid metadata for LL1-006-2A.wav of type wav - skipping Duration: 00:00:01.58, bitrate: -2147483 kb/s Stream #0:0: Audio: pcm_s24le ([1][0][0][0] / 0x0001), 96000 Hz, 2 channels, s32, 4608 kb/s

Maybe NickFG could take a look at these?

— Reply to this email directly or view it on GitHubhttps://github.com/nabu-catalog/nabu/issues/295#issuecomment-14019133.

silviapfeiffer commented 11 years ago

I can remove the surplus CAT by hand - that's what I offered. I think they're not relevant any more. Just wanted confirmation.

Most of the others are orphaned files in the Nabu archive. I need to be told what to do with them. Somehow they got into the archive without an item having been created, so I hoped to get advice on what I should do to fix them. If the depositors can create an item for them, we can re-import them with the script. Otherwise I can remove them or rename them. Whatever is most appropriate. I just don't know what to do with them.

silviapfeiffer commented 11 years ago

BTW: you can only see these files if you log into catalog.paradisec.org.au via the command-line.

nthieberger commented 11 years ago

No, I need to check if the actual CAT files are in NABU already before we can delete these ones. So I need to be able to see the ADMIN files to do that.

On 24 February 2013 16:47, Silvia Pfeiffer notifications@github.com wrote:

I can remove the surplus CAT by hand - that's what I offered. I think they're not relevant any more. Just wanted confirmation.

Most of the others are orphaned files in the Nabu archive. I need to be told what to do with them. Somehow they got into the archive without an item having been created, so I hoped to get advice on what I should do to fix them. If the depositors can create an item for them, we can re-import them with the script. Otherwise I can remove them or rename them. Whatever is most appropriate. I just don't know what to do with them.

— Reply to this email directly or view it on GitHubhttps://github.com/nabu-catalog/nabu/issues/295#issuecomment-14023335.

nthieberger commented 11 years ago

OK, I think you can delete them.

I've also added comments about the remaining problem files below. I can't log onto catalog.paradisec.org.au, is there a IP address for it?

Yes, I think these CAT files can be deleted ERROR: skipping file AA1-2013-CAT-PDSC_ADMIN.xml - does not relate to an item AA1-2013 ERROR: skipping file ABT1-NSM200806201-CAT-PDSC_ADMIN.xml - does not relate to an item ABT1-NSM200806201 ERROR: skipping file CI1-080-CAT-PDSC_ADMIN.xml - does not relate to an item CI1-080 ERROR: skipping file CI1-108-CAT-PDSC_ADMIN.xml - does not relate to an item CI1-108 ERROR: skipping file MT1-test-CAT-PDSC_ADMIN.xml - does not relate to an item MT1-test ERROR: skipping file CH3-09MPWCWEverywell-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09MPWCWEverywell ERROR: skipping file CH3-09MPWCWEverywellW1pronuncia-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09MPWCWEverywellW1pronuncia ERROR: skipping file CH3-09W2SentencesRevisedWErecor-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09W2SentencesRevisedWErecor

ERROR: skipping file CH3-09W2wordlistforsentencesand-CAT-PDSC_ADMIN.xml - does not relate to an item CH3-09W2wordlistforsentencesand

But what do I do with these other ones that don't have an item in the catalog? (I don't even know where they came from! They shouldn't exist):

These should be renamed AC2-VNEFAT201 ERROR: skipping file AC2-VNEFAT201A-001.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-002.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-003.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-004.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-005.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-006.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-007.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-008.jpg - does not relate to an item AC2-VNEFAT201A ERROR: skipping file AC2-VNEFAT201A-009.jpg - does not relate to an item AC2-VNEFAT201A

Could be same as AS2-003a. Asked Nick FG to check them against each other. ERROR: skipping file AS2-003-A.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-A.wav - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.wav - does not relate to an item AS2-003

Rename to LG1-100922-01.eaf ERROR: skipping file LG1-10092201-01.eaf - does not relate to an item LG1-10092201

Asked Laura Robinson about these ERROR: skipping file LR1-051506-01.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-02.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-03.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-04.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-05.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-051506-06.jpg - does not relate to an item LR1-051506 ERROR: skipping file LR1-052506-01.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-02.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-03.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-04.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052506-05.jpg - does not relate to an item LR1-052506 ERROR: skipping file LR1-052806-01.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-02.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-03.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-04.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-05.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-06.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-07.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-08.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-09.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-10.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-11.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-052806-12.jpg - does not relate to an item LR1-052806 ERROR: skipping file LR1-061206-01.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-02.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-03.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-04.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-05.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-06.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-07.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-08.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-09.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-10.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-11.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-12.jpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-061206-A.mpg - does not relate to an item LR1-061206 ERROR: skipping file LR1-062506-01.jpg - does not relate to an item LR1-062506 ERROR: skipping file LR1-062506-02.jpg - does not relate to an item LR1-062506 ERROR: skipping file LR1-062506-03.jpg - does not relate to an item LR1-062506 ERROR: skipping file LR1-070106-A.mpg - does not relate to an item LR1-070106 ERROR: skipping file LR1-070906-01.mpg - does not relate to an item LR1-070906 ERROR: skipping file LR1-070906-02.mpg - does not relate to an item LR1-070906 ERROR: skipping file LR1-070906-03.mpg - does not relate to an item LR1-070906 ERROR: skipping file LR1-071706-A.mpg - does not relate to an item LR1-071706 ERROR: skipping file LR1-080206-01.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-02.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-03.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-04.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-05.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-06.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-07.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-08.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-09.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-10.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-11.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080206-12.jpg - does not relate to an item LR1-080206 ERROR: skipping file LR1-080306-01.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-02.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-03.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-04.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-05.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-06.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-07.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-08.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-080306-09.jpg - does not relate to an item LR1-080306 ERROR: skipping file LR1-081306-01.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-02.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-03.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-04.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081306-05.jpg - does not relate to an item LR1-081306 ERROR: skipping file LR1-081405-01.jpg - does not relate to an item LR1-081405 ERROR: skipping file LR1-081406-02.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081406-03.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081406-04.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081406-05.jpg - does not relate to an item LR1-081406 ERROR: skipping file LR1-081506-01.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081506-02.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081506-03.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081506-04.jpg - does not relate to an item LR1-081506 ERROR: skipping file LR1-081906-01.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-02.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-03.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-04.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-05.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-06.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-081906-07.jpg - does not relate to an item LR1-081906 ERROR: skipping file LR1-082506-01.jpg - does not relate to an item LR1-082506 ERROR: skipping file LR1-083006-01.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-02.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-03.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-04.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-05.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-06.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-07.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-08.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-09.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-083006-10.jpg - does not relate to an item LR1-083006 ERROR: skipping file LR1-101606-A.mpg - does not relate to an item LR1-101606

On 24 February 2013 16:47, Silvia Pfeiffer notifications@github.com wrote:

I can remove the surplus CAT by hand - that's what I offered. I think they're not relevant any more. Just wanted confirmation.

Most of the others are orphaned files in the Nabu archive. I need to be told what to do with them. Somehow they got into the archive without an item having been created, so I hoped to get advice on what I should do to fix them. If the depositors can create an item for them, we can re-import them with the script. Otherwise I can remove them or rename them. Whatever is most appropriate. I just don't know what to do with them.

— Reply to this email directly or view it on GitHubhttps://github.com/nabu-catalog/nabu/issues/295#issuecomment-14023335.

jangari commented 11 years ago

By memory, you can't log into catalog.paradisec.org.au from a regular machine in Melbourne. I think it works from pdsc.rnld.unimelb.edu.au or from azoulay.arts.usyd.edu.au.

silviapfeiffer commented 11 years ago

They are basically empty files because there are no filled in the item.

I'll delete them.

Silvia. On 25 Feb 2013 13:55, "nthieberger" notifications@github.com wrote:

No, I need to check if the actual CAT files are in NABU already before we can delete these ones. So I need to be able to see the ADMIN files to do that.

On 24 February 2013 16:47, Silvia Pfeiffer notifications@github.com wrote:

I can remove the surplus CAT by hand - that's what I offered. I think they're not relevant any more. Just wanted confirmation.

Most of the others are orphaned files in the Nabu archive. I need to be told what to do with them. Somehow they got into the archive without an item having been created, so I hoped to get advice on what I should do to fix them. If the depositors can create an item for them, we can re-import them with the script. Otherwise I can remove them or rename them. Whatever is most appropriate. I just don't know what to do with them.

— Reply to this email directly or view it on GitHub< https://github.com/nabu-catalog/nabu/issues/295#issuecomment-14023335>.

— Reply to this email directly or view it on GitHubhttps://github.com/nabu-catalog/nabu/issues/295#issuecomment-14023485.

silviapfeiffer commented 11 years ago

OK, I have removed the surplus CAT files. None of them were listing any files.

I have also moved the files in the collections AC2, AS1, LG1 and am re-running the script, which should add them to the relevant items.

Apart from the LR1 files, we still need to resolve:

ERROR: skipping file LD1-0006-PIC.jpg - does not relate to an item LD1-0006

and the non-importable files (need to ask NickFG for these): ERROR: invalid metadata for LL1-006-2B.wav of type wav - skipping ERROR: invalid metadata for LL1-006-B.wav of type wav - skipping ERROR: invalid metadata for LL1-006-2A.wav of type wav - skipping

/cc @enwardy

silviapfeiffer commented 11 years ago

Oh, and of course these, which NickT thinks should be in AS2-003a ( @enwardy ?): ERROR: skipping file AS2-003-A.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-A.wav - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.wav - does not relate to an item AS2-003

nthieberger commented 11 years ago

LD1-0006-PIC.jpg should be ok now, there is an item for it in the catalog

On 24 February 2013 21:27, Silvia Pfeiffer notifications@github.com wrote:

OK, I have removed the surplus CAT files. None of them were listing any files.

I have also moved the files in the collections AC2, AS1, LG1 and am re-running the script, which should add them to the relevant items.

Apart from the LR1 files, we still need to resolve:

ERROR: skipping file LD1-0006-PIC.jpg - does not relate to an item LD1-0006

and the non-importable files (need to ask NickFG for these): ERROR: invalid metadata for LL1-006-2B.wav of type wav - skipping ERROR: invalid metadata for LL1-006-B.wav of type wav - skipping ERROR: invalid metadata for LL1-006-2A.wav of type wav - skipping

/cc @enwardy https://github.com/enwardy

— Reply to this email directly or view it on GitHubhttps://github.com/nabu-catalog/nabu/issues/295#issuecomment-14028785.

silviapfeiffer commented 11 years ago

Yup, LD1, AC2 and LG1 are now imported too.

AmandaPDSC commented 11 years ago

adding @NickFG to this conversation so he can follow the thread

silviapfeiffer commented 10 years ago

Can you please still resolve these non-importable files: ERROR: invalid metadata for LL1-006-2B.wav of type wav - skipping ERROR: invalid metadata for LL1-006-B.wav of type wav - skipping ERROR: invalid metadata for LL1-006-2A.wav of type wav - skipping

And these files that don't relate to an item (NickT thinks they should be in AS2-003a - let me know what to do?): ERROR: skipping file AS2-003-A.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-A.wav - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.wav - does not relate to an item AS2-003

So we can close this bug.

nthieberger commented 10 years ago

ERROR: invalid metadata for LL1-006-2B.wav of type wav - skipping ERROR: invalid metadata for LL1-006-B.wav of type wav - skipping ERROR: invalid metadata for LL1-006-2A.wav of type wav - skipping

I can't see why the metadata for these isn't valid, it has already successfully imported LL1-006-A.wav which has the same metadata?

And these files that don't relate to an item (NickT thinks they should be in AS2-003a - let me know what to do?):

Where are these files? I can listen to them to see if they are the same as existing 003a files

ERROR: skipping file AS2-003-A.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-A.wav - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.mp3 - does not relate to an item AS2-003 ERROR: skipping file AS2-003-B.wav - does not relate to an item AS2-003

So we can close this bug.

— Reply to this email directly or view it on GitHubhttps://github.com/nabu-catalog/nabu/issues/295#issuecomment-31290177 .

AmandaPDSC commented 9 years ago

I think maybe this issue can be closed - has this been resolved @jangari and @nthieberger ?

stasb commented 9 years ago

Hi, has this issue currently been resolved?

AmandaPDSC commented 9 years ago

I think it's resolved - @nthieberger ?