search

fcrepo-exts / fcrepo-camel-toolbox

A collection of ready-to-use messaging applications with fcrepo-camel
Apache License 2.0
13 stars 26 forks source link

Solr indexing default transform not working for ldp:contains #202

Open wwelling opened 2 months ago

wwelling commented 2 months ago

https://github.com/fcrepo-exts/fcrepo-camel-toolbox/blob/e71b893920b8a75e2f71c94a472f1a07fd8ad6ff/fcrepo-indexing-solr/src/main/resources/org/fcrepo/camel/indexing/solr/default_transform.xsl#L15

<field name="contains"><xsl:value-of select="rdf:RDF/rdf:Description/ldp:contains/@rdf:resource" /></field>
wwelling commented 2 months ago

image

image

image

wwelling commented 2 months ago 
curl -H "Accept: application/rdf+xml" http://localhost:8080/fcrepo/rest/d89dcb24-73a2-42b6-8bd5-9f405d73fff2
<rdf:RDF
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:fedora="http://fedora.info/definitions/v4/repository#"
    xmlns:ldp="http://www.w3.org/ns/ldp#" >
  <rdf:Description rdf:about="http://localhost:8080/fcrepo/rest/d89dcb24-73a2-42b6-8bd5-9f405d73fff2">
    <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Container"/>
    <fedora:lastModified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-04-30T18:43:33.090415Z</fedora:lastModified>
    <rdf:type rdf:resource="http://www.w3.org/ns/ldp#RDFSource"/>
    <fedora:lastModifiedBy>fedoraAdmin</fedora:lastModifiedBy>
    <fedora:createdBy>fedoraAdmin</fedora:createdBy>
    <ldp:contains rdf:resource="http://localhost:8080/fcrepo/rest/d89dcb24-73a2-42b6-8bd5-9f405d73fff2/5711c41b-3cc0-4343-97d3-e1c67cf2e6e3"/>
    <rdf:type rdf:resource="http://www.w3.org/ns/ldp#BasicContainer"/>
    <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Container"/>
    <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Resource"/>
    <fedora:created rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-04-30T18:43:33.090415Z</fedora:created>
    <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Resource"/>
  </rdf:Description>
</rdf:RDF>
curl -H "Accept: application/rdf+xml" http://localhost:8080/fcrepo/rest/d89dcb24-73a2-42b6-8bd5-9f405d73fff2/5711c41b-3cc0-4343-97d3-e1c67cf2e6e3/fcr:metadata
<rdf:RDF
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:ebucore="http://www.ebu.ch/metadata/ontologies/ebucore/ebucore#"
    xmlns:premis="http://www.loc.gov/premis/rdf/v1#"
    xmlns:fedora="http://fedora.info/definitions/v4/repository#"
    xmlns:ldp="http://www.w3.org/ns/ldp#" >
  <rdf:Description rdf:about="http://localhost:8080/fcrepo/rest/d89dcb24-73a2-42b6-8bd5-9f405d73fff2/5711c41b-3cc0-4343-97d3-e1c67cf2e6e3">
    <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Resource"/>
    <premis:hasMessageDigest rdf:resource="urn:sha-512:4af1e5402d96bb88defce21ef42224b7b0fdb5e8e9fcb75335ef9b43097d4c34c900800497ebd5e42561e07169dc0bce4a15df1441695947a803eab5ceb90069"/>
    <rdf:type rdf:resource="http://www.w3.org/ns/ldp#NonRDFSource"/>
    <fedora:hasFixityService rdf:resource="http://localhost:8080/fcrepo/rest/d89dcb24-73a2-42b6-8bd5-9f405d73fff2/5711c41b-3cc0-4343-97d3-e1c67cf2e6e3/fcr:fixity"/>
    <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Resource"/>
    <fedora:createdBy>fedoraAdmin</fedora:createdBy>
    <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Binary"/>
    <fedora:created rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-04-30T18:43:40.128406Z</fedora:created>
    <premis:hasSize rdf:datatype="http://www.w3.org/2001/XMLSchema#long">1437</premis:hasSize>
    <ebucore:hasMimeType>application/octet-stream</ebucore:hasMimeType>
    <fedora:lastModifiedBy>fedoraAdmin</fedora:lastModifiedBy>
    <ebucore:filename>.env</ebucore:filename>
    <fedora:lastModified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-04-30T18:43:40.128406Z</fedora:lastModified>
  </rdf:Description>
</rdf:RDF>
wwelling commented 2 months ago

Here are some additional fields that do work.

        <field name="filename"><xsl:value-of select="rdf:RDF/rdf:Description/ebucore:filename" /></field>
        <field name="hasMimeType"><xsl:value-of select="rdf:RDF/rdf:Description/ebucore:hasMimeType" /></field>

        <field name="hasMessageDigest"><xsl:value-of select="rdf:RDF/rdf:Description/premis:hasMessageDigest/@rdf:resource" /></field>
        <field name="hasSize"><xsl:value-of select="rdf:RDF/rdf:Description/premis:hasSize" /></field>

        <field name="hasFixityService"><xsl:value-of select="rdf:RDF/rdf:Description/fedora:hasFixityService/@rdf:resource" /></field>
wwelling commented 2 months ago

Additional attempt similar to rdftype that did not work.

        <xsl:for-each select="rdf:RDF/rdf:Description/ldp:contains">
          <field name="contains"><xsl:value-of select="@rdf:resource" /></field>
        </xsl:for-each>
whikloj commented 2 months ago

Hi @wwelling, you are correct. By default we don't request containment triples from Fedora. I believe this was to avoid extra requests to Fedora, but I am not totally sure. I didn't even notice the ldp:contains was included in the default transform. If you are interested we can open a feature request to make this configurable.

wwelling commented 2 months ago

Hi @whikloj, thanks. I will try without preferOmit=PreferContainment parameter. If that doesn't work, I will try with preferInclude=PreferContainment parameter.

wwelling commented 2 months ago

Okay, it worked on a build without preferOmit=PreferContainment but only after reindexing. Switching back to fcrepo-camel-toolbox-6.5.0 branch to test with reindexing.

Does a container get reindex when a resource or child container added to it? Or does it require manually reindexing?

wwelling commented 2 months ago

Tested reindexing without removing preferOmit=PreferContainment and did not have contains indexed in any Solr document. Switching back to https://github.com/wwelling/fcrepo-camel-toolbox/commit/179a598803f0f891c4a8a3278c922113b9299b89.

wwelling commented 2 months ago

Here are the results without issuing reindexing request.

image

image

image

2024-05-01 13:45:47 INFO 18:45:47.970 [main] (ConfigurationClassParser) Properties location [file:${fcrepo-camel-toolbox.home:fcrepo-camel-toolbox-home}/config/fcrepo-camel-toolbox.properties] not resolvable: /fcrepo-camel-toolbox-home/config/fcrepo-camel-toolbox.properties (No such file or directory)
2024-05-01 13:45:47 INFO 18:45:47.970 [main] (ConfigurationClassParser) Properties location [file:${fcrepo.camel.toolbox.config.file}] not resolvable: Could not resolve placeholder 'fcrepo.camel.toolbox.config.file' in value "file:${fcrepo.camel.toolbox.config.file}"
2024-05-01 13:45:47 DEBUG 18:45:47.977 [main] (ConditionOnProperty) Prop solr.indexing.enabled: true
2024-05-01 13:45:47 DEBUG 18:45:47.985 [main] (ConditionOnProperty) Prop http.enabled: false
2024-05-01 13:45:47 DEBUG 18:45:47.985 [main] (ConditionOnProperty) Prop reindexing.enabled: true
2024-05-01 13:45:47 DEBUG 18:45:47.986 [main] (ConditionOnProperty) Prop triplestore.indexing.enabled: true
2024-05-01 13:45:47 DEBUG 18:45:47.986 [main] (ConditionOnProperty) Prop fixity.enabled: false
2024-05-01 13:45:47 DEBUG 18:45:47.986 [main] (ConditionOnProperty) Prop audit.enabled: false
2024-05-01 13:45:48 INFO 18:45:48.040 [main] (PostProcessorRegistrationDelegate$BeanPostProcessorChecker) Bean 'appConfig' of type [org.fcrepo.camel.toolbox.app.AppConfig$$EnhancerBySpringCGLIB$$f1b7de7c] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying)
2024-05-01 13:45:48 DEBUG 18:45:48.350 [main] (FcrepoComponent) Created Fcrepo Endpoint [fcrepo://http://fedora:8080/fcrepo/rest?accept=application/rdf+xml]
2024-05-01 13:45:48 INFO 18:45:48.358 [main] (XPathBuilder) Created default XPathFactory com.sun.org.apache.xpath.internal.jaxp.XPathFactoryImpl@43da41e
2024-05-01 13:45:48 INFO 18:45:48.435 [main] (HttpComponent) Created ClientConnectionManager org.apache.http.impl.conn.PoolingHttpClientConnectionManager@216e0771
2024-05-01 13:45:48 DEBUG 18:45:48.457 [main] (FcrepoComponent) Created Fcrepo Endpoint [fcrepo://http://fedora:8080/fcrepo/rest?accept=application%2Fn-triples&preferInclude=PreferContainment&preferOmit=ServerManaged]
2024-05-01 13:45:48 DEBUG 18:45:48.463 [main] (FcrepoComponent) Created Fcrepo Endpoint [fcrepo://http://fedora:8080/fcrepo/rest?accept=application%2Frdf+xml&preferInclude=PreferMinimalContainer]
2024-05-01 13:45:48 INFO 18:45:48.465 [main] (HttpComponent) Created ClientConnectionManager org.apache.http.impl.conn.PoolingHttpClientConnectionManager@36c2b646
2024-05-01 13:45:48 DEBUG 18:45:48.466 [main] (FcrepoComponent) Created Fcrepo Endpoint [fcrepo://http://fedora:8080/fcrepo/rest?accept=application%2Fn-triples&preferInclude=&preferOmit=http%3A%2F%2Fwww.w3.org%2Fns%2Fldp%23PreferContainment]
2024-05-01 13:45:48 INFO 18:45:48.694 [main] (log) Logging initialized @1024ms to org.eclipse.jetty.util.log.Slf4jLog
2024-05-01 13:45:48 INFO 18:45:48.722 [main] (Server) jetty-9.4.36.v20210114; built: 2021-01-14T16:44:28.689Z; git: 238ec6997c7806b055319a6d11f8ae7564adc0de; jvm 11.0.16+8
2024-05-01 13:45:48 INFO 18:45:48.735 [main] (ContextHandler) Started o.e.j.s.ServletContextHandler@69909c14{/,null,AVAILABLE}
2024-05-01 13:45:48 INFO 18:45:48.744 [main] (AbstractConnector) Started ServerConnector@6fff46bf{HTTP/1.1, (http/1.1)}{0.0.0.0:9080}
2024-05-01 13:45:48 INFO 18:45:48.744 [main] (Server) Started @1074ms
2024-05-01 13:45:48 INFO 18:45:48.764 [main] (AbstractCamelContext) Routes startup summary (total:16 started:16)
2024-05-01 13:45:48 INFO 18:45:48.764 [main] (AbstractCamelContext)     Started FcrepoSolrRouter (broker://topic:fedora)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoSolrReindex (broker://queue:solr.reindex)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoSolrIndexer (direct://index.solr)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoSolrDeleter (direct://delete.solr)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoSolrUpdater (direct://update.solr)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoSolrSend (direct://send.to.solr)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoReindexingRest (jetty:http://0.0.0.0:9080/reindexing)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoReindexingUsage (direct://usage)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoReindexingReindex (direct://reindex)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoReindexingTraverse (broker://queue:reindexing)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoReindexingRecipients (direct://recipients)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoTriplestoreRouter (broker://topic:fedora)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoTriplestoreReindex (broker://queue:triplestore.reindex)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoTriplestoreIndexer (direct://index.triplestore)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoTriplestoreDeleter (direct://delete.triplestore)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext)     Started FcrepoTriplestoreUpdater (direct://update.triplestore)
2024-05-01 13:45:48 INFO 18:45:48.765 [main] (AbstractCamelContext) Apache Camel 3.9.0 (camel-1) started in 494ms (build:20ms init:191ms start:283ms)
2024-05-01 13:45:48 INFO 18:45:48.770 [main] (Driver) fcrepo-camel-toolbox started.
2024-05-01 13:45:52 DEBUG 18:45:52.861 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (FcrepoProducer) Fcrepo Request [http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7] with method [GET]
2024-05-01 13:45:52 DEBUG 18:45:52.862 [Camel (camel-1) thread #3 - JmsConsumer[fedora]] (FcrepoProducer) Fcrepo Request [http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7] with method [GET]
2024-05-01 13:45:52 INFO 18:45:52.977 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Indexing Solr Object http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7
2024-05-01 13:45:52 INFO 18:45:52.978 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Sending RDF through log processor to log XML+RDF
2024-05-01 13:45:52 INFO 18:45:52.979 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) RDF+XML: <rdf:RDF
2024-05-01 13:45:52     xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
2024-05-01 13:45:52     xmlns:fedora="http://fedora.info/definitions/v4/repository#"
2024-05-01 13:45:52     xmlns:ldp="http://www.w3.org/ns/ldp#" > 
2024-05-01 13:45:52   <rdf:Description rdf:about="http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7">
2024-05-01 13:45:52     <fedora:lastModifiedBy>fedoraAdmin</fedora:lastModifiedBy>
2024-05-01 13:45:52     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Container"/>
2024-05-01 13:45:52     <fedora:lastModified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-05-01T18:45:52.716894Z</fedora:lastModified>
2024-05-01 13:45:52     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#RDFSource"/>
2024-05-01 13:45:52     <fedora:created rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-05-01T18:45:52.716894Z</fedora:created>
2024-05-01 13:45:52     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#BasicContainer"/>
2024-05-01 13:45:52     <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Resource"/>
2024-05-01 13:45:52     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Resource"/>
2024-05-01 13:45:52     <fedora:createdBy>fedoraAdmin</fedora:createdBy>
2024-05-01 13:45:52     <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Container"/>
2024-05-01 13:45:52   </rdf:Description>
2024-05-01 13:45:52 </rdf:RDF>
2024-05-01 13:45:52 
2024-05-01 13:45:52 INFO 18:45:52.979 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Sending RDF for Transform with with XSLT from file:///fcrepo-camel-toolbox-home/config/default_transform.xsl
2024-05-01 13:45:53 INFO 18:45:53.130 [Camel (camel-1) thread #3 - JmsConsumer[fedora]] (TriplestoreRouter) Indexing Triplestore Object http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7
2024-05-01 13:45:54 INFO 18:45:54.117 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) sending to solr...
2024-05-01 13:45:58 DEBUG 18:45:58.929 [Camel (camel-1) thread #3 - JmsConsumer[fedora]] (FcrepoProducer) Fcrepo Request [http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/fc9d5951-55c0-470a-93b9-82166e82dc79] with method [GET]
2024-05-01 13:45:58 DEBUG 18:45:58.929 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (FcrepoProducer) Fcrepo Request [http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/fc9d5951-55c0-470a-93b9-82166e82dc79] with method [GET]
2024-05-01 13:45:58 INFO 18:45:58.961 [Camel (camel-1) thread #3 - JmsConsumer[fedora]] (TriplestoreRouter) Indexing Triplestore Object http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/fc9d5951-55c0-470a-93b9-82166e82dc79
2024-05-01 13:45:58 INFO 18:45:58.962 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Indexing Solr Object http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/fc9d5951-55c0-470a-93b9-82166e82dc79
2024-05-01 13:45:58 INFO 18:45:58.962 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Sending RDF through log processor to log XML+RDF
2024-05-01 13:45:58 INFO 18:45:58.962 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) RDF+XML: <rdf:RDF
2024-05-01 13:45:58     xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
2024-05-01 13:45:58     xmlns:ebucore="http://www.ebu.ch/metadata/ontologies/ebucore/ebucore#"
2024-05-01 13:45:58     xmlns:premis="http://www.loc.gov/premis/rdf/v1#"
2024-05-01 13:45:58     xmlns:fedora="http://fedora.info/definitions/v4/repository#"
2024-05-01 13:45:58     xmlns:ldp="http://www.w3.org/ns/ldp#" > 
2024-05-01 13:45:58   <rdf:Description rdf:about="http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/fc9d5951-55c0-470a-93b9-82166e82dc79">
2024-05-01 13:45:58     <fedora:createdBy>fedoraAdmin</fedora:createdBy>
2024-05-01 13:45:58     <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Binary"/>
2024-05-01 13:45:58     <fedora:lastModified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-05-01T18:45:58.813330Z</fedora:lastModified>
2024-05-01 13:45:58     <ebucore:filename>.env</ebucore:filename>
2024-05-01 13:45:58     <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Resource"/>
2024-05-01 13:45:58     <premis:hasMessageDigest rdf:resource="urn:sha-512:c305b9730a1878baf34f982eb70bcad4c1e2f6549f3db8eaebefa40481fb2dc7e4ce3455303dc0afe7a34785bb90a5667646ed5253f0a892c58cc19ccd6a1ae4"/>
2024-05-01 13:45:58     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#NonRDFSource"/>
2024-05-01 13:45:58     <fedora:hasFixityService rdf:resource="http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/fc9d5951-55c0-470a-93b9-82166e82dc79/fcr:fixity"/>
2024-05-01 13:45:58     <premis:hasSize rdf:datatype="http://www.w3.org/2001/XMLSchema#long">2024</premis:hasSize>
2024-05-01 13:45:58     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Resource"/>
2024-05-01 13:45:58     <ebucore:hasMimeType>application/octet-stream</ebucore:hasMimeType>
2024-05-01 13:45:58     <fedora:lastModifiedBy>fedoraAdmin</fedora:lastModifiedBy>
2024-05-01 13:45:58     <fedora:created rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-05-01T18:45:58.813330Z</fedora:created>
2024-05-01 13:45:58   </rdf:Description>
2024-05-01 13:45:58 </rdf:RDF>
2024-05-01 13:45:58 
2024-05-01 13:45:58 INFO 18:45:58.962 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Sending RDF for Transform with with XSLT from file:///fcrepo-camel-toolbox-home/config/default_transform.xsl
2024-05-01 13:45:59 INFO 18:45:59.965 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) sending to solr...
2024-05-01 13:46:05 DEBUG 18:46:05.617 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (FcrepoProducer) Fcrepo Request [http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/996dfd7d-01db-44fa-9a71-f1a376671302] with method [GET]
2024-05-01 13:46:05 DEBUG 18:46:05.617 [Camel (camel-1) thread #3 - JmsConsumer[fedora]] (FcrepoProducer) Fcrepo Request [http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/996dfd7d-01db-44fa-9a71-f1a376671302] with method [GET]
2024-05-01 13:46:05 INFO 18:46:05.647 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Indexing Solr Object http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/996dfd7d-01db-44fa-9a71-f1a376671302
2024-05-01 13:46:05 INFO 18:46:05.647 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Sending RDF through log processor to log XML+RDF
2024-05-01 13:46:05 INFO 18:46:05.647 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) RDF+XML: <rdf:RDF
2024-05-01 13:46:05     xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
2024-05-01 13:46:05     xmlns:ebucore="http://www.ebu.ch/metadata/ontologies/ebucore/ebucore#"
2024-05-01 13:46:05     xmlns:premis="http://www.loc.gov/premis/rdf/v1#"
2024-05-01 13:46:05     xmlns:fedora="http://fedora.info/definitions/v4/repository#"
2024-05-01 13:46:05     xmlns:ldp="http://www.w3.org/ns/ldp#" > 
2024-05-01 13:46:05   <rdf:Description rdf:about="http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/996dfd7d-01db-44fa-9a71-f1a376671302">
2024-05-01 13:46:05     <premis:hasSize rdf:datatype="http://www.w3.org/2001/XMLSchema#long">5274</premis:hasSize>
2024-05-01 13:46:05     <ebucore:filename>docker-compose.yml</ebucore:filename>
2024-05-01 13:46:05     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#Resource"/>
2024-05-01 13:46:05     <fedora:lastModified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-05-01T18:46:05.494786Z</fedora:lastModified>
2024-05-01 13:46:05     <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Binary"/>
2024-05-01 13:46:05     <rdf:type rdf:resource="http://fedora.info/definitions/v4/repository#Resource"/>
2024-05-01 13:46:05     <fedora:lastModifiedBy>fedoraAdmin</fedora:lastModifiedBy>
2024-05-01 13:46:05     <fedora:hasFixityService rdf:resource="http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/996dfd7d-01db-44fa-9a71-f1a376671302/fcr:fixity"/>
2024-05-01 13:46:05     <rdf:type rdf:resource="http://www.w3.org/ns/ldp#NonRDFSource"/>
2024-05-01 13:46:05     <fedora:createdBy>fedoraAdmin</fedora:createdBy>
2024-05-01 13:46:05     <fedora:created rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-05-01T18:46:05.494786Z</fedora:created>
2024-05-01 13:46:05     <premis:hasMessageDigest rdf:resource="urn:sha-512:cdd3674d1ba453317e9e35e8cf5d96e3b34cc61bee2bce34b4266f2f8c6082b9f24b17b2cecd4dc278fed1133e9773fb87105d0858aa2c43c5cf5d5889138549"/>
2024-05-01 13:46:05     <ebucore:hasMimeType>application/octet-stream</ebucore:hasMimeType>
2024-05-01 13:46:05   </rdf:Description>
2024-05-01 13:46:05 </rdf:RDF>
2024-05-01 13:46:05 
2024-05-01 13:46:05 INFO 18:46:05.647 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) Sending RDF for Transform with with XSLT from file:///fcrepo-camel-toolbox-home/config/default_transform.xsl
2024-05-01 13:46:05 INFO 18:46:05.655 [Camel (camel-1) thread #3 - JmsConsumer[fedora]] (TriplestoreRouter) Indexing Triplestore Object http://fedora:8080/fcrepo/rest/1d07e16d-1334-43a2-97af-5151bfb1cdb7/996dfd7d-01db-44fa-9a71-f1a376671302
2024-05-01 13:46:06 INFO 18:46:06.650 [Camel (camel-1) thread #0 - JmsConsumer[fedora]] (SolrRouter) sending to solr...
wwelling commented 2 months ago

After reindexing.

curl -XPOST http://localhost:9080/reindexing -H "Content-Type: application/json" -d "[\"broker:queue:solr.reindex\",\"broker:queue:triplestore.reindex\"]"
Indexing started at http://fedora:8080/fcrepo/rest

image

wwelling commented 2 months ago

I think we can work with this.

@whikloj how do we go about putting in the feature request to make this configurable?

whikloj commented 2 months ago

Does a container get reindex when a resource or child container added to it? Or does it require manually reindexing?

It requires manual reindexing as there is actually no change to the parent container. The ldp:contains triples are calculated when you request the resource.

... how do we go about putting in the feature request to make this configurable?

We use JIRA for ticketing (https://fedora-repository.atlassian.net/browse/FCREPO) so you are welcome to request an account. I will open a feature request on your behalf right now and we can always make you the requestor once you have an account.

whikloj commented 2 months ago

https://fedora-repository.atlassian.net/browse/FCREPO-3939