eXtensibleCatalog / Metadata-Services-Toolkit

Tools for processing and aggregating metadata
Other
6 stars 3 forks source link

get record counts working for MAS #461

Open patrickzurek opened 8 years ago

patrickzurek commented 8 years ago

JIRA issue created by: jbrand Originally opened: 2012-02-17 12:56 PM

Issue body:

As there are working record counts now, as far as I know, am moving this to drop 4. We'll see by then if we need more, or document specific record counting bugs.

patrickzurek commented 8 years ago

JIRA Coment by user: jbrand JIRA Timestamp: 2012-02-17 12:56 PM

Comment body:

Right now, they are null. Figure out how to spin them up.

patrickzurek commented 8 years ago

JIRA Coment by user: jbrand JIRA Timestamp: 2012-04-04 01:16 PM

Comment body:

from the rules log file:

03 Apr 2012 14:46:08,497 ERROR [SERVICE_14346] - *\ can not calculate record counts null recordCounts returned for service: marcaggregation

patrickzurek commented 8 years ago

JIRA Coment by user: jbrand JIRA Timestamp: 2012-04-05 12:47 PM

Comment body:

Fixed record counting for MAS. Now the question is, what are the appropriate rules? Here is what I put in so far, let me know if there are more, or anything is wrong with these:

Rules for MarcAggregation: Marc Aggregation Bibs In Active (MABIA) >= Marc Aggregation Bibs Out Active (MABOA)

Marc Aggregation Holdings In Active (MAHIA) = Marc Aggregation Holdings Out Active (MAHOA)

Marc Aggregation Total In Active (MATIA) >= Marc Aggregation Total Out Active (MATOA)

patrickzurek commented 8 years ago

JIRA Coment by user: jbowen JIRA Timestamp: 2012-04-05 12:51 PM

Comment body:

Not sure what else might be needed. I noticed that all of these are "active" Is there a way to count and identify records that don't get processed through the service, i.e. stuff that isn't considered "active"? This might be a question to run by Jessica at some point - what else do they need to be able to count? Although that might turn up more needs that we can address.

patrickzurek commented 8 years ago

JIRA Coment by user: jbrand JIRA Timestamp: 2012-04-05 02:41 PM

Comment body:

Remember, these are 'rules', so they have to be something I can apply an equation to, and generate a pass/fail.

We can and do count more than this. Lots lots more.

patrickzurek commented 8 years ago

JIRA Coment by user: rcook JIRA Timestamp: 2012-07-23 03:16 PM

Comment body:

Jennifer and/or [~jgibson], if you can write a "rule", something that is "math like" then we can schedule future work for [~cdelis].

patrickzurek commented 8 years ago

JIRA Coment by user: jbowen JIRA Timestamp: 2012-08-24 11:10 AM

Comment body:

I would need to know more about what kinds of records are "inactive" and how we would need to track them to suggest additional rules. The only thing I can think of is perhaps rules that would be to somehow make sure that the number of active+inactive records of each type needs to equal the number of input records. Would that be useful, [~jgibson]?

patrickzurek commented 8 years ago

JIRA Coment by user: rcook JIRA Timestamp: 2013-03-27 01:15 PM

Comment body:

Moving this to Jessica. Jessica, if you have all the info you need for now, then we can close the issue and add a new issue later should something develop.

patrickzurek commented 8 years ago

JIRA Comment by user: Jessica Gibson (gibsonjc) JIRA Timestamp: 2013-03-28 02:19 PM

Comment body:

I am not sure what this issue is referring to... To counts in the log files for the marcaggregation service (that one would find by going to Logs > Services > marcaggregation in the MST task bar)? Or to counts that appear in the MST facet area when you are browsing records? Or, last week [~cdelis] showed me some really exciting error logs I have never seen before that I want to follow up on, could it be those? I can certainly think about it or look at it, I just don't know what it is or where to find it.