materialsCitation: Batch working or not?

[myrmoteras]

how do I know, when I have to kill the batch program when it does materialsCitation

This is a large document >200MB and probably one with the highest number of materialsCitation.

Processing document 'E:\diglib\zootaxa\temp36\zootaxa.4511.1.1.pdf'

• loaded PDF of 205276760 bytes Extracting page content Assessing font char usage Importing page words Sanitizing page words and graphics Removing vertical watermarks on page margins Assessing page graphics Assessing page content Handling flipped page content Storing figures and graphics Analyzing words in relation to figures and graphics Storing custom fonts Assessing number punctuation Splitting page words Generating page images Generating pages Analyzing page structure Analyzing text stream structure
• PDF converted, document ID is 'FFE7FFB9D82ED976ED734302E62F974B' Storing conversion result to temporary folder Storing document data Storing page data Storing word data Storing region data Storing annotation data Storing font data Storing page images Storing page image data Storing supplement data Storing supplements Document stored to temporary folder
• assigned document style 'zootaxa.2013.monograph' Running Image Markup Tool 'Detect Document Structure' Detecting document structure from 193 pages
• gathering data
• scoring page numbers:
• checking page number sequence:
• filling in missing page numbers:
• detecting page headers
• correcting empty tables
• detecting tables
• computing main text font size
• detecting captions
• detecting footnotes
• identifying table notes
• indexing paragraph end words
• indexing document words
• de-hyphenating line breaks
• merging interrupted paragraphs
• identifying caption target areas
• merging tables within pages
• merging tables across pages
• marking caption citations
• marking headings, emphases, and super- and subscripts Storing document data Storing page data Storing word data Storing region data Storing annotation data Storing font data Storing page images Storing page image data Storing supplement data Storing supplements Document stored to temporary folder Running Image Markup Tool 'Add Document Meta Data' Storing document data Storing page data Storing word data Storing region data Storing annotation data Storing font data Storing page images Storing page image data Storing supplement data Storing supplements Document stored to temporary folder Running Image Markup Tool 'Mark Taxonomic Keys' Storing document data Storing page data Storing word data Storing region data Storing annotation data Storing font data Storing page images Storing page image data Storing supplement data Storing supplements Document stored to temporary folder Running Image Markup Tool 'Parse Bibliography' Wrapping document Checking document Loading document processor Identifying candidate paragraphs Building candidate bibliographies Assessing reference style Style-filtering candidate bibliographies Position-filtering candidate bibliographies Merging adjacent candidate bibliographies Marking bibliography Parsing references Extracting basic details Assessing basic details Selecting number detail blocks Filtering number details Classifying part designators Getting author lists Filtering author lists Collecting reference structures Selecting reference structures Filling in author list gaps Determining primary detail separator Extracting volume references Parsing volume references Extracting basic details Assessing basic details Selecting number detail blocks Filtering number details Classifying part designators Getting author lists Filtering author lists Collecting reference structures Selecting reference structures Filling in author list gaps Collecting title and journal/publisher blocks Determining title terminator Selecting titles and journals/publishers Position-filtering number details Cleaning up volume references Classifying references Annotating details Storing document data Storing page data Storing word data Storing region data Storing annotation data Storing font data Storing page images Storing page image data Storing supplement data Storing supplements Document stored to temporary folder Running Image Markup Tool 'Mark Bibliographic Citations' Wrapping document Checking document Loading document processor Processing document Storing document data Storing page data Storing word data Storing region data Storing annotation data Storing font data Storing page images Storing page image data Storing supplement data Storing supplements Document stored to temporary folder Running Image Markup Tool 'Mark Taxon Names' Wrapping document Checking document Loading document processor Collecting seed families and genera Collecting above-genus seeds ==> TreeFAT instance is ICN Eliminating seeds from document head and bibliography Eliminating stop words Eliminating seeds with inappropriate suffixes Eliminating document local stop words Eliminating non-emphasis-start words Eliminating seeds occurring in lower case more often than capitalized Collecting labeled positives Doing catalog lookups for 266 seeds: Assessing catalog lookup results Building primary rank dictionaries Salvaging style eliminated seeds using lookup results Doing catalog lookups for 0 catalog salvaged seeds: Extending primary rank dictionaries Salvaging style eliminated seeds using style of catalog salvaged seeds Doing catalog lookups for 0 style salvaged seeds: Extending primary rank dictionaries Indexing epithet occurrences Indexing labeled epithets and potential epithets below genus Indexing labeled epithets and potential epithets below species Indexing taxonomic status labels Indexing status labeled epithets Indexing potential authorities Indexing name infixes and in-name symbols Assembling taxonomic names Removed single-word taxon name as non-italics: flexipes Removed single-word taxon name as non-italics: peritomae Removed single-word taxon name as non-italics: minor Removed single-word taxon name as non-italics: minor Removed single-word taxon name as non-italics: minor Removed single-word taxon name as non-italics: minor Removed single-word taxon name as non-italics: minor Removed single-word taxon name as non-italics: minor Removed single-word taxon name as non-italics: minor Removed single-word taxon name as non-italics: minor Removed single-word taxon name as non-italics: minor Expanding abbreviated genera and species Linking taxonomic names with non-catalog genera to families Linking taxonomic names to catalog data Getting taxonomic names Adding document authority for original names Adding or resetting verbatim authorities Bucketizing taxonomic names Merging equal buckets Merging compatible buckets Handling new combinations and status changes Transferring attributes already present in document Sorting out done-with buckets Loading authority data for 397 taxon names Storing document data Storing page data Storing word data Storing region data Storing annotation data Storing font data Storing page images Storing page image data Storing supplement data Storing supplements Document stored to temporary folder Running Image Markup Tool 'Clean Table Annotations' Storing document data Storing page data Storing word data Storing region data Storing annotation data Storing font data Storing page images Storing page image data Storing supplement data Storing supplements Document stored to temporary folder Running Image Markup Tool 'Remove Duplicate Annotations' Storing document data Storing page data Storing word data Storing region data Storing annotation data Storing font data Storing page images Storing page image data Storing supplement data Storing supplements Document stored to temporary folder Running Image Markup Tool 'Mark Treatments (Headings Only)' Wrapping document Checking document Loading document processor Extracting countries Emphasis-filtering countries Conflict and ISO-filtering countries Extracting regions Filtering regions Storing document data Storing page data Storing word data Storing region data Storing annotation data Storing font data Storing page images Storing page image data Storing supplement data Storing supplements Document stored to temporary folder Running Image Markup Tool 'Extract Materials Citations' Wrapping document Checking document Loading document processor Extracting countries Emphasis-filtering countries Conflict and ISO-filtering countries Extracting regions Filtering regions Getting document person names Detecting materials citation paragraphs Marking materials citations Setting materials citation attributes Detecting materials citation paragraphs Marking materials citations Setting materials citation attributes Detecting materials citation paragraphs Marking materials citations

  ---

[gsautter]

See #606 ... could you re-run the batch on this one (will do only materials citations, the rest is done and stored in batch cache) and provide the resulting log? That should help me pinpoint what exactly goes and implement respective countermeasures (most likely related to #598 as well).