search

eXtensibleCatalog / Drupal-Toolkit

The eXtensible Catalog Drupal Toolkit
0 stars 0 forks source link

III MARC records need to contain the correct record ID in the 001 #101

Open patrickzurek opened 7 years ago

patrickzurek commented 7 years ago

JIRA issue created by: atkins245@gmail.com Originally opened: 2012-09-25 02:47 PM

Issue body:

Testing NCIPV2 under NCIP2 tab is working for both lookup item and lookup item set but in main menu when I searching the book, it return a list of documents found but for awhile checking available, Call No, Localtion then nothing show up.

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-03 12:10 PM

Comment body:

[~mwesley] and [~pkiraly] Please look into this.

I understand from Bach that when he posts an XML request against his NCIP Server test page, the response comes back with all the needed data. He also says that when he use the DT test page that the response also contains all the needed data. If all that is true and nothing else id found to be wrong, then there might be some disconnect with how DT is interpreting the results. E.g. I think we have hard coded the availability status for Voyager, and maybe the Millenium responses are different. We need to dig into this and find out more.

Bach, Please supply links to all this so we can confirm and test.

patrickzurek commented 7 years ago

JIRA Comment by user: mwesley JIRA Timestamp: 2012-10-03 03:29 PM

Comment body:

Bach, can you provide an example of a XML request and response.

For NCIP 2, we're pretty much sticking to NCIP standard since the NCIP2 Toolkit is pretty much complaint. However, since Voyager doesn't use all available elements in its responses, we're not checking for every possible response in Drupal.

patrickzurek commented 7 years ago

JIRA Comment by user: atkins245@gmail.com JIRA Timestamp: 2012-10-16 04:05 PM

Comment body:

Hi Wesley, I use the Scenario 1 and 2 of XML request in this link: http://code.google.com/p/xcncip2toolkit/wiki/lookupItem. In Scenario 1, if no agency ID, the XML request des not contains: ns1:AgencyIdNRU/ns1:AgencyId Here is the XML request from my test: <?xml version="1.0" encoding="UTF-8" standalone="yes"?>

ns1:LookupItem ns1:ItemId ns1:ItemIdentifierValue3110888/ns1:ItemIdentifierValue /ns1:ItemId Bibliographic Description/ns1:ItemElementType Circulation Status/ns1:ItemElementType Electronic Resource/ns1:ItemElementType Hold Queue Length/ns1:ItemElementType Item Description/ns1:ItemElementType Item Use Restriction Type/ns1:ItemElementType Location/ns1:ItemElementType /ns1:LookupItem /ns1:NCIPMessage and here is the XML response: ns1:LookupItemResponse ns1:ItemId ns1:ItemIdentifierValue3110888/ns1:ItemIdentifierValue /ns1:ItemId ns1:ItemOptionalFields ns1:BibliographicDescription ns1:AuthorWing, Vincent, 1619-1668./ns1:Author ns1:BibliographicRecordId ns1:BibliographicRecordIdentifier3110888/ns1:BibliographicRecordIdentifier ns1:AgencyIdcirc/ns1:AgencyId /ns1:BibliographicRecordId ns1:PublisherLondon : printed by Anne Motte, for the Company of Stationers, 1723./ns1:Publisher ns1:TitleAn almanack for the year of our Lord God, 1723 [electronic resource] : Being the Third Year after Bissextile, or Leap-Year. By Vincent Wing./ns1:Title eng/ns1:Language /ns1:BibliographicDescription ON THE WEB/ns1:CirculationStatus ns1:ItemDescription ns1:CallNumberDA480eb/ns1:CallNumber /ns1:ItemDescription ns1:Location Current Location/ns1:LocationType ns1:LocationName ns1:LocationNameInstance ns1:LocationNameLevel1/ns1:LocationNameLevel ns1:LocationNameValueInternet Resource/ns1:LocationNameValue /ns1:LocationNameInstance /ns1:LocationName /ns1:Location /ns1:ItemOptionalFields /ns1:LookupItemResponse /ns1:NCIPMessage In Scenario 2, the is the agency ID in XML request, and I believe if you enter agency ID in setup NCIP in XC Drupal then it will test and return the response as below: ns1:LookupItem ns1:ItemId ns1:AgencyIdNRU/ns1:AgencyId ns1:ItemIdentifierValue3110888/ns1:ItemIdentifierValue /ns1:ItemId Bibliographic Description/ns1:ItemElementType Circulation Status/ns1:ItemElementType Electronic Resource/ns1:ItemElementType Hold Queue Length/ns1:ItemElementType Item Description/ns1:ItemElementType Item Use Restriction Type/ns1:ItemElementType Location/ns1:ItemElementType /ns1:LookupItem /ns1:NCIPMessage and here the response: ns1:LookupItemResponse ns1:ItemId ns1:AgencyIdNRU/ns1:AgencyId ns1:ItemIdentifierValue3110888/ns1:ItemIdentifierValue /ns1:ItemId ns1:ItemOptionalFields ns1:BibliographicDescription ns1:AuthorWing, Vincent, 1619-1668./ns1:Author ns1:BibliographicRecordId ns1:BibliographicRecordIdentifier3110888/ns1:BibliographicRecordIdentifier ns1:AgencyIdNRU/ns1:AgencyId /ns1:BibliographicRecordId ns1:PublisherLondon : printed by Anne Motte, for the Company of Stationers, 1723./ns1:Publisher ns1:TitleAn almanack for the year of our Lord God, 1723 [electronic resource] : Being the Third Year after Bissextile, or Leap-Year. By Vincent Wing./ns1:Title eng/ns1:Language /ns1:BibliographicDescription ON THE WEB/ns1:CirculationStatus ns1:ItemDescription ns1:CallNumberDA480eb/ns1:CallNumber /ns1:ItemDescription ns1:Location Current Location/ns1:LocationType ns1:LocationName ns1:LocationNameInstance ns1:LocationNameLevel1/ns1:LocationNameLevel ns1:LocationNameValueInternet Resource/ns1:LocationNameValue /ns1:LocationNameInstance /ns1:LocationName /ns1:Location /ns1:ItemOptionalFields /ns1:LookupItemResponse /ns1:NCIPMessage If you test, you can see the lookup item set, the XML request contain the agency Id = NRU already, it need to be reset as lookup item. Thanks
patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-16 04:31 PM

Comment body:

The sample XML is just that, sample, and is designed to work against the "NCIP test bed." The xml you submit to your III instance should be chagned to use the Agency Id you use, and then that needs to be setup in Drupal Toolkit to be the same.

patrickzurek commented 7 years ago

JIRA Comment by user: atkins245@gmail.com JIRA Timestamp: 2012-10-16 04:36 PM

Comment body:

We don't use any agency ID

patrickzurek commented 7 years ago

JIRA Comment by user: atkins245@gmail.com JIRA Timestamp: 2012-10-16 04:42 PM

Comment body:

and agency is the option also

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-17 09:19 AM

Comment body:

Bach, it is very difficult to help you when we do not have access. Can you please make your NCIP URL availalbe to us to test with? It would also help the Drupal guys to have the ability to log in to Drupal as admin. Private email is fine to convey that info.

I would like:

url for NCIP test page sample bib ids for a few items in your ILS access to Drupal Toolikit - url and log in information

patrickzurek commented 7 years ago

JIRA Comment by user: atkins245@gmail.com JIRA Timestamp: 2012-10-17 09:49 AM

Comment body:

Hi, Here are all information. However, let me know what you changed or edit. 1) First you have to access the test web site by using the link, user name and password below to access my intranet site Link: https://librarylink.uncc.edu/login?url=http://library-test.uncc.edu username: xc password: extensible

2) To access NCIP test: http://library-test.uncc.edu:8080/millennium/ a) Using http://code.google.com/p/xcncip2toolkit/wiki/SampleXML for testing b) Here are some bib ids: b1001458 - return 1 record b1002140 - return 2 records b1002148 - return 1 record b1003967 - return 3 records b1004532 - return 24 records

3) To access Drupal XC: http://library-test.uncc.edu user name: xc password: EC4!Test

If you have any question, please let me know. Thanks

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-17 01:24 PM

Comment body:

I don't seem to be able to access the NCIP test page, either on IE or Firefox.

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-17 01:29 PM

Comment body:

[~pkiraly] and [~mwesley]

Given the following copied below, I don't see a record ID being indexed that would be able to be used for the bib inside the NCIP Request. Is this the problem? That the DT can't get the correct bib id because it is not finding it?

manifestation node id 1075829 metadata id 3253891 @type manifestation @id oai:library-test.uncc.edu:MetadataServicesToolkit/marctoxctransformation/6060238 xc:recordID •2011010968 (@type="LCCN") •682895180 (@type="OCoLC") •682895180 (@type="ocn")

patrickzurek commented 7 years ago

JIRA Comment by user: atkins245@gmail.com JIRA Timestamp: 2012-10-17 01:44 PM

Comment body:

can you ping 10.18.150.9?

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-17 01:48 PM

Comment body:

nope, got request timed out.

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-17 02:09 PM

Comment body:

I looked at bib 1001458 via the DT test page using Lookup Item set. a response come back for a result called "Mystery of Being" and when I search for that, there are 3 things at the top of the results list that have that title, but I can't find the bib number in the XC Schema view.

@bach, have you filled in the MST org code spots correctly so that the MST will put your org code into the MST records? I would need to be able to see your mst in order for me to tell.

Note: MT, the test page responses seem to be filling the Agency Id of "NRU". I do not know if that is because we are sending in the request (e.g. its a bug in the DT and it should should be an entry option) or whether Bach is sending that back and therefore its an issue on his side. Either way, don't think that is the biggest problem here.

patrickzurek commented 7 years ago

JIRA Comment by user: atkins245@gmail.com JIRA Timestamp: 2012-10-17 02:15 PM

Comment body:

@Randall, I will check with IT people how outside people can access to my box inside firewall

I don't remember any place in MST setup with org code???

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-17 02:21 PM

Comment body:

http://code.google.com/p/xcmetadataservicestoolkit/wiki/NormConfiguration Here there is a value called "Change Me" that needs to be changed to your org code. But I thought the service would not run. Did you change this? Also, going to ask [~cdelis] if he has any ideas.

Can you make the MST availalbe to us too?

patrickzurek commented 7 years ago

JIRA Comment by user: atkins245@gmail.com JIRA Timestamp: 2012-10-17 02:35 PM

Comment body:

I check MST-instances/MetadataServicesToolkit/services/marcnormalization/META-INF/classes/service.xccfg and i know I did update this line below before I process. OrganizationCode = nccu

Below is information for MST test - it mean you can access my box right?

http://library-test.uncc.edu:8080/MetadataServicesToolkit/st/viewLogin.action user name: admin password: MST4Atkins

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-17 02:46 PM

Comment body:

And I cannot access the MST either.

Probably a permissions by IP address issues.

OK, this record

http://library-test.uncc.edu.librarylink.uncc.edu/node/1395/xc/download

has this in the data

manifestation node id 1395 metadata id 4193 @type manifestation @id oai:library-test.uncc.edu:MetadataServicesToolkit/marctoxctransformation/2810540 xc:recordID •77027179 (@type="LCCN") •07652609 (@type="nccu")

but if I do a search for a bib of 07652609, for nccu record id, it should be the bib number. but it comes back

with a response of

<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>

Anyone, [~mwesley] [~pkiraly] [~cdelis] [~pzurek] have an idea.

Also, [~mwesley] doesn't this

http://library-test.uncc.edu.librarylink.uncc.edu/admin/xc/ncip/application

have to be filled in somehow, with the nccu?

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-18 10:23 AM

Comment body:

[~atkins245@gmail.com] Since I don't have access, in the above example, i am waiting for you to tell me what the 07652609 (@type="nccu") relates to? Does that number mean anything to you? What is it? Is it in the 001 field of the record in the MST? There has to be a disconnect somewhere between what the bib number is that you think is the bib number and the number that is getting set as the ILS identifier.

@Randall, 07652609 is the field 001 - ocm07652609 but the bid record for this one is: b10014585 or 10014585

Hope it can help you.

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-19 09:13 AM

Comment body:

[~atkins245@gmail.com] I was afraid of that.

We are using MARC records from your ILS. These are records that originate in your ILS, therefore the ID we use is that of 001, in accordance with the definition for MARC http://www.loc.gov/marc/bibliographic/concise/bd001.html

Control number assigned by the organization creating, using, or distributing the record. The MARC code for the organization is contained in field 003 (Control Number Identifier).

Examples

001 ###86104385# 001 ocm14919759 001 #####9007496

Drupal needs to initiate a request that uses an identifier that came from your system that is contained in the metadata that is passed along through the MST and into Drupal. Question, is your internal ID, the one that starts with a "b" contained in the exported MARC records anywhere?

A couple of paths foward:

  1. You can change your III NCIP connector to perform data lookup using the 001 that is in the record and that Drupal knows about. If that is not possible, then
  2. You can create/write a program that overwrites the 001 that is in the system with your internal system ID at export time.

I am doing a notify to [~jbowen] and [~dlindahl]

patrickzurek commented 7 years ago

JIRA Comment by user: atkins245@gmail.com JIRA Timestamp: 2012-10-19 09:32 AM

Comment body:

@Randall, 07652609 is the field 001 - ocm07652609 but the bid record for this one is: b10014585 or 10014585 and our NCIP code using reading screen method to access to III system to get circulation information and the only way is using b record: b10014585

Hope it can help you.

patrickzurek commented 7 years ago

JIRA Comment by user: atkins245@gmail.com JIRA Timestamp: 2012-10-19 10:00 AM

Comment body:

@dandall - Just talk to Michael and here is the information - brecord always in field: 907 in marc record but you have to drop the last digit number. Here are the sample: =LDR 00681dam a2200145 a 4500 =008 \\\\\\\\\\ =100 1\$aWinecoff, Michael. =245 10$aTest record for Bookplate. =500 \$a00000001 =595 \$a

Amanda Harmon
Amanda's friends
=907 \$a.b20699281 =902 \$a121012 =998 \$ares$b $cm$dx$en$feng$gxxu$h0$i0 =962 \$a000:001:PDF:b2069928:003909:0:0:0:0:0:0$tNew Media Set$vn =945 \$aCALL NUMBER $cUNITS$g1$j0$lres $mMESSAGE$nNOTE$o-$p{dollar}0.00$q $r-$s-$t10$u0$v0$w0$x0$y.i3909943x$z111223

So the path can be: Drupal read the field 907 instead of 001 I have to fix NCIP using different searching link for 001

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-19 10:25 AM

Comment body:

Bach, It really is not that easy. We have put considerable effort into creating a useful schema called the XC Schema, and this takes data elements from many formats, RDA, Dublin Core, etc. The MARC 9xx fields are discretionary for the most part (e.g. they have local use not universal definitions) that is why we, for MARC records, use the already defined control number that identifies that record.

I suppose another approach could be for you to write a new step to be included in the MARC Normalization Service that is UNCC only that moves the 907 to the 001

I will seek input from [~jbowen].

I am unclear on the final statement you made. Are you going to change the NCIP connector to do a look up based on the 001?

patrickzurek commented 7 years ago

JIRA Comment by user: atkins245@gmail.com JIRA Timestamp: 2012-10-19 11:51 AM

Comment body:

Can it easy to write new step in MST in the MARC Normalization Service that is UNCC only that moves the 907 to the 001?

I think we need to add what field the XC Schema look up in NCIP before they can write the connector.

Because Millennium (non oracle) does not has API, so I need to using screen capture to read info. Therefore, it will take time again to change the link and look over all the codes to update.

I will think over it on weekend to find the best solution.

patrickzurek commented 7 years ago

JIRA Comment by user: atkins245@gmail.com JIRA Timestamp: 2012-10-19 12:47 PM

Comment body:

@Randall - Drupal searching for field: 001 right? Does it contain: ocn infront or during the XC tranformation - it only keep digit number only? - example: ocn341605154

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-19 12:54 PM

Comment body:

Not exactly, Drupal is looking to the XC Schema element field called xc:recordid with a particular type, and the type element is your org code, and you would set up your NCIP Connector in Drupal to look to that same type, so in your case, you have put nccu. So the MST will convert the MARC 001 field, which is one of many possible record ids, others exist such as OCLC id, into an xc:recordid element with a type that is your org code. That is why the setup in the MST is important.

patrickzurek commented 7 years ago

JIRA Comment by user: pkiraly JIRA Timestamp: 2012-10-19 03:48 PM

Comment body:

[~atkins245@gmail.com]: Please, read my comment in the other thread about the same topic: http://extensiblecatalog.lib.rochester.edu:8080/browse/DRUPAL-93?focusedCommentId=13409&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13409

I am waiting your aswer about this. Shortly: in Drupal it is setting what field you take equivalent of the ILS's bibid, in the XC schema it is the xc:recordid, however you have to precisely set it.

patrickzurek commented 7 years ago

JIRA Comment by user: atkins245@gmail.com JIRA Timestamp: 2012-10-19 04:09 PM

Comment body:

@Petter, I believed in conversation with Randall, the DT using field 001 to lookup circulation status, but my NCIP using field 907 to check for circulation. So I think I have to update my NCIP first

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2012-10-24 12:25 PM

Comment body:

Changing the title and recapping options.

TheMARC 001 should contain the local ID. This gets translated in the MST into an xc:recordid data element.

Options:

  1. Export the records with the correct ID. [~bodfishj] going to see if he can find more info about options. Bach to also look into.
  2. Write a new service step in the MARC Norm service (MST) moves the 907 to the 001 field. UNCC would need to write and test this step.
  3. Explore whether the OAI Toolkit modify step can be used to move id data from the 907 to the 001. I think this sounds like it might be problematic, but hoping [~cdelis] can weigh in on this.
patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2013-01-15 03:16 PM

Comment body:

What is status on this?

patrickzurek commented 7 years ago

JIRA Comment by user: rcook JIRA Timestamp: 2013-06-19 11:12 AM

Comment body:

Bach, I don't think this should be in Drupal toolkit issues. Please create issues for any issues that remain for you. On my next review of the issues in this release I will close this issue.