search

Esri / geoportal-server-harvester

Metadata Harvester for Esri Geoportal Server
http://esri.github.io/geoportal-server/
Apache License 2.0
31 stars 24 forks source link

How to harvest a Entreprise Geodatabase #45

Closed xlhomme closed 5 years ago

xlhomme commented 6 years ago

Hi In order to harvest an Entreprise Geodatabase, should I export all the metada into XML metadata files ? Is It possible to create a connector ?

Best regards

pandzel-zz commented 6 years ago

In general, exporting XML or JSON from any source, storing it in a folder, then harvesting this folder is always a viable option. However, in your case it would be probably a very tedious job.

A better option would be to write a custom inbound adapter. In order to do that you would need to have an access to the ArcGIS Runtime SDK.

xlhomme commented 6 years ago

Hi If you have access to an arcsde sdk (files : jpe_sdk.jar, jsde_sdk.jar) it should be possible to write an harvester. GeoNetwork has such an harvester.

https://geonetwork-opensource.org/manuals/2.10.4/eng/users/managing_metadata/harvesting/sde/index.html

mhogeweg commented 6 years ago

that is correct. but similar to geonetwork, this would require additional installation, since we cannot ship those jar files with the harvester. similarly, the geonetwork license is not compatible with our geoportal license so it prevents us from combining their harvester into ours. open source/proprietary doesn't make a difference here. it's the license that dictates what you can do with some component.

In ArcMap we have a publishing client that pushes metadata to a geoportal (instead of a harvester pulling). Do you use ArcMap? if so, check out https://github.com/Esri/geoportal-server/tree/master/components/desktop/PublishClient

andrewrudin-austin commented 6 years ago

Is the 10.6 ArcCatalog Publishing Client compatible with Harvester version 2.5.2? I have a brand new GeoPortal Server/Harvester on the same server. I'm trying to populate it with XML's extracted from a geodatabase. When I follow the Publishing Client use instructions I get errors. I tried pointing it at both the /geoportal and the /harvester server URLs with no luck.

zguo commented 6 years ago

The ArcCatalog Publish Client is intended for publishing to geoportal 1.2.x, if your metadata from geodtabase is already extracted to a folder, you can use harvester to harvest the folder into a geoportal 2.x instance.

zguo commented 5 years ago

Implemented in the updated harvester, now you can harvest geodatabase metadata directly through JDBC database broker, please see https://github.com/Esri/geoportal-server-harvester/wiki/Brokers#jdbc-database.

Zahid-Mia commented 2 years ago

I have followed the guidance in https://github.com/Esri/geoportal-server-harvester/wiki/Brokers#jdbc-database Copied mssql-jdbc-10.2.0.jre11 into ..\Tomcat 9.0\lib Added lines in POM.xml

com.microsoft.sqlserver mssql-jdbc 10.2.0.jre11

Broker

Tried older version as well. Unfortunately, I couldn’t make it work. The log file error is not clear to me. Just wondering if there any other documentation (like step by step).

mhogeweg commented 2 years ago

you should not have to rebuild the harvester for this. Just putting the JDBC driver in the Tomcat/lib folder, restarting Tomcat after this, and providing the correct info should be sufficient. Can you provide the error message?

in the fields for the select statement, primary key, title and description: does this match your table structure? is the database_name unique?

Zahid-Mia commented 2 years ago

Hi Marten

Thank you very much for your reply. As you suggested please see the error message below I am having. Please note I am trying this from my local computer. Log file is also attached herewith.

Error opening JDBC connection to: jdbc:sqlserver://desktop-ni994f7:1433;databaseName=EWR

Please see below for the screen shot for the broker definition, dbo.gdb_items table structure etc. I appreciate your patient supporting the Geoportal users.

Thanks Zahid

[cid:65d6841a-948e-4a9c-99bb-84965c223abf] [cid:68fc0b27-1f9e-470e-8e17-42563987fa4e]

From: Marten @.> Sent: 17 February 2022 14:49 To: Esri/geoportal-server-harvester @.> Cc: Zahid Mia @.>; Comment @.> Subject: Re: [Esri/geoportal-server-harvester] How to harvest a Entreprise Geodatabase (#45)

you should not have to rebuild the harvester for this. Just putting the JDBC driver in the Tomcat/lib folder, restarting Tomcat after this, and providing the correct info should be sufficient. Can you provide the error message?

in the fields for the select statement, primary key, title and description: does this match your table structure? is the database_name unique?

— Reply to this email directly, view it on GitHubhttps://github.com/Esri/geoportal-server-harvester/issues/45#issuecomment-1043030231, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AHLXE3HO4MT336OYOC75G6TU3UDIJANCNFSM4EP6F2SQ. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub. You are receiving this because you commented.Message ID: @.***>

mhogeweg commented 2 years ago

hmm... seems the log file did not get attached,

question:

Zahid-Mia commented 2 years ago

Hi Marten Thank you again for your reply. Please see the attachment for the responses to your queries along with screen shot for each step. Earlier I attached the log file as zip file with other files in the logs folder. Anyway, please see the attachment for the logfile as a single file here with. I have followed your steps and still couldn't resolve. I hope the above helps.

Thanks Zahid

From: Marten @.> Sent: 21 February 2022 22:35 To: Esri/geoportal-server-harvester @.> Cc: Zahid Mia @.>; Comment @.> Subject: Re: [Esri/geoportal-server-harvester] How to harvest a Entreprise Geodatabase (#45)

hmm... seems the log file did not get attached,

question:

— Reply to this email directly, view it on GitHubhttps://github.com/Esri/geoportal-server-harvester/issues/45#issuecomment-1047273120, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AHLXE3DZCFB72QHPCNERFXLU4K42NANCNFSM4EP6F2SQ. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub. You are receiving this because you commented.Message ID: @.***>