search

eXtensibleCatalog / Metadata-Services-Toolkit

Tools for processing and aggregating metadata
Other
6 stars 3 forks source link

Setup OAI Data Source needed for MARC Aggregation #597

Closed patrickzurek closed 7 years ago

patrickzurek commented 7 years ago

JIRA issue created by: rcook Originally opened: 2011-07-25 05:45 PM

Issue body: (nt)

patrickzurek commented 7 years ago

JIRA Coment by user: rcook JIRA Timestamp: 2011-07-25 05:48 PM

Comment body:

The MARC Aggregation service is of little to no benefit to a single institution as there is little record/manifestation duplication. As a result, we will not be able to test this with Rochester data. Part of the test process will include testing with sample test data. When testing with larger data sets, this will need to be with CARLI institutions data.

Ben to supply the requirements and Chris hopefully can setup up the data in OAI Toolkit or multiple Toolkits.

patrickzurek commented 7 years ago

JIRA Coment by user: banderson JIRA Timestamp: 2011-08-18 08:10 PM

Comment body:

Chris, I think what would probably work best for this test is to have an oai-toolkit with your largest library (uiuc?) and one with your smallest library that has considerable overlap with the large library. In other words, if your smallest library is full of obscure records that aren't going to match the largest, then let's pick a different one. This can be done at any time and should be a one time thing. Once they are configured, then I can do a file harvest and you can destroy the oai-toolkits if needed. Perhaps you already have an oai-toolkit with uiuc data? There is no rush on this - we are not ready to begin these tests yet. Just want to get the ball rolling.

patrickzurek commented 7 years ago

JIRA Comment by user: Chris Delis (cedelis) JIRA Timestamp: 2011-08-24 03:05 PM

Comment body:

Should I set up two distinct OAI servers (with different URLs)? Or should I combine them into a single server (where the schools' records are distinguished based on organization code, i.e., the 003)? We at CARLI will probably go with the latter setup when we go live.

patrickzurek commented 7 years ago

JIRA Coment by user: banderson JIRA Timestamp: 2011-08-24 03:25 PM

Comment body:

Can you differentiate them by set if you put them on the same server? If not, I'd say separate installs.

patrickzurek commented 7 years ago

JIRA Comment by user: Chris Delis (cedelis) JIRA Timestamp: 2011-08-24 03:30 PM

Comment body:

Sure, I can separate them for now. In the future, however, would we be able to use the Aggregation service on a single repo (which includes multiple organizations)? Because I do not think we will be able to separate each of our schools into their own repos (because of the inherit "deep copy" nature of the MST).

patrickzurek commented 7 years ago

JIRA Comment by user: Chris Delis (cedelis) JIRA Timestamp: 2011-08-24 03:38 PM

Comment body:

Here are the two URLs:

Largest school (UIU - University of Illinois at Urbana/Champaign): http://xc.ilcso.uiuc.edu:8080/OAIToolkit/oai-request.do

Smaller community college (JWC - John Wood Community College): http://xc.ilcso.uiuc.edu:8080/OAIToolkit2/oai-request.do

patrickzurek commented 7 years ago

JIRA Coment by user: banderson JIRA Timestamp: 2011-08-24 04:04 PM

Comment body:

great - thanks. I'll kick off our file_harvester. If everything goes well, then you can get rid of these oai-toolkits at will. I'll let you know.

re: your other questions I don't see any issue with having them as a single repo in the future. It just gives us a little more flexibility to keep them separate for now.

I'm not sure what you mean by the "deep-copy" nature of the MST or any limitations to having separate repos. Could you explain what you mean?

patrickzurek commented 7 years ago

JIRA Coment by user: banderson JIRA Timestamp: 2011-09-02 05:37 PM

Comment body:

the file_harvest is complete. Chris, you can delete those oai-toolkits at will. I have what I need for the MST.

patrickzurek commented 7 years ago

JIRA Coment by user: rcook JIRA Timestamp: 2011-12-01 04:44 PM

Comment body:

I reopened this just so you were aware ofit. This was a part of the test process we were going to employ. John, you will probably want to make sure you know where the file harvests ended up.

patrickzurek commented 7 years ago

JIRA Coment by user: rcook JIRA Timestamp: 2011-12-22 04:44 PM

Comment body:

Find the data and then move to testing area as you see fit.

patrickzurek commented 7 years ago

JIRA Coment by user: jbrand JIRA Timestamp: 2011-12-23 01:54 PM

Comment body:

I thought Ben had replicated our file_harvest directory so it is the same on all servers (or did a mount or something to achieve that) but not true. The jwcc_full directory lives on Carli server 128.174.70.240 but not on Carli server 128.174.70.247. uiu_full is on both these servers.

patrickzurek commented 7 years ago

Issue resolved: 2012-02-09 06:50 PM