search

hbz / lobid-organisations

Transformation, web frontend, and API for lobid-organisations
http://lobid.org/organisations
Eclipse Public License 2.0
13 stars 3 forks source link

Add links to libraries.org #99

Open acka47 opened 8 years ago

acka47 commented 8 years ago

Marshall Breeding for a long time has been maintaining libraries.org "A directory of libraries throughout the world". It contains 485 entries for Germany and interesting additional information (e.g. which ILSs they have been using). See for example UB Mannheim in libraries.org vs. UB Mannheim in lobid-organisations

Linking entries in lobid.org to their respective entry in libraries.org would be nice.

TobiasNx commented 10 months ago

By now https://librarytechnology.org/libraries/search.pl states 8728 libraries. I am not sure how to get these.

Phu2 commented 10 months ago

@mbreeding Can you help please?

TobiasNx commented 10 months ago

Question would be: How can I query these libraries? Is there an API? Does the metadata contain ISILs or any other identifier, that I could use to match our records.

mbreeding commented 10 months ago

There isn’t an official api to libraries.org, but there are URL strings that you can use to return HTML pages.

For example, you can search for public libraries in Germany:

https://librarytechnology.org/libraries/search.pl?Country=Germany&Type=Public

Most records for public libraries will include the DBS-ID

You can search for records by this identifier: https://librarytechnology.org/libraries/search.pl?DBSID=AJ471

To create links to records in libraries.org, use this form: https://librarytechnology.org/library/2742

Does this answer your question?

-marshall

Marshall Breeding Editor, Library Technology Guides @.**@.> https://librarytechnology.org/

From: TobiasNx @.> Sent: Friday, July 7, 2023 3:47 AM To: hbz/lobid-organisations @.> Cc: Marshall Breeding @.>; Mention @.> Subject: Re: [hbz/lobid-organisations] Add links to libraries.org (#99)

Question would be: How can I query these libraries? Is there an API? Does the metadata contain ISILs or any other identifier, that I could use to match our records.

— Reply to this email directly, view it on GitHubhttps://github.com/hbz/lobid-organisations/issues/99#issuecomment-1625071796, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABYALYCLC7YZBIURGSCZAR3XO7EI7ANCNFSM4BYEAAIQ. You are receiving this because you were mentioned.Message ID: @.**@.>>

Phu2 commented 10 months ago

Thanks a lot @mbreeding Is it allowed to extract the identifiers of all german libraries from the HTML pages?

mbreeding commented 10 months ago

In principal yes, but I could also generate a list for you that matches the libraries.org ID with the DBS-ID.

-marshall

From: Phu Tu @.> Sent: Friday, July 7, 2023 9:10 AM To: hbz/lobid-organisations @.> Cc: Marshall Breeding @.>; Mention @.> Subject: Re: [hbz/lobid-organisations] Add links to libraries.org (#99)

Thanks a lot @mbreedinghttps://github.com/mbreeding Is it allowed to extract the identifiers of all german libraries from the HTML pages?

— Reply to this email directly, view it on GitHubhttps://github.com/hbz/lobid-organisations/issues/99#issuecomment-1625473636, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABYALYCNX2L5UWAV2ASS7PDXPAKC5ANCNFSM4BYEAAIQ. You are receiving this because you were mentioned.Message ID: @.**@.>>

Phu2 commented 10 months ago

It would be great! As not all records include the DBS-ID it would be handy to have the other identifiers, too. Is that feasible?

mbreeding commented 10 months ago

Here is the report:

https://librarytechnology.org/libraries/consortia/germany-public.pl

-marshall

From: Phu Tu @.> Sent: Friday, July 7, 2023 9:23 AM To: hbz/lobid-organisations @.> Cc: Marshall Breeding @.>; Mention @.> Subject: Re: [hbz/lobid-organisations] Add links to libraries.org (#99)

It would be great! As not all records include the DBS-ID it would be handy to have the other identifiers, too. Is that feasible?

— Reply to this email directly, view it on GitHubhttps://github.com/hbz/lobid-organisations/issues/99#issuecomment-1625491468, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABYALYEEV45WFWC4BLQSRW3XPALVFANCNFSM4BYEAAIQ. You are receiving this because you were mentioned.Message ID: @.**@.>>

TobiasNx commented 10 months ago

Thanks @mbreeding such a list would be helpful.

I see that these only include public libraries, right? e.g.: https://librarytechnology.org/library/29922 is missing in this list. Could you include all german libraries in the list? Also could you include other identifiers such as WorldCat Registry ID if provided?

Then I could use this list for mapping our lobid organisation records to your library.org records.

mbreeding commented 10 months ago

I have expanded the report to include all libraries in Germany and to also provide the OCLC Symbol and Registry Number when available. These numbers are not likely to be present on many records in this set.

https://librarytechnology.org/libraries/consortia/germany-public.pl

It would also be helpful if you have other identifiers in your database, that we could likewise find a way to populate them into libraries.org.

-marshall

From: TobiasNx @.> Sent: Monday, July 10, 2023 12:51 AM To: hbz/lobid-organisations @.> Cc: Marshall Breeding @.>; Mention @.> Subject: Re: [hbz/lobid-organisations] Add links to libraries.org (#99)

Thanks @mbreedinghttps://github.com/mbreeding such a list would be helpful.

I see that these only include public libraries, right? e.g.: https://librarytechnology.org/library/29922 is missing in this list. Could you include all german libraries in the list? Also could you include other identifiers such as WorldCat Registry ID if provided?

Then I could use this list for mapping our lobid organisation records to your library.org records.

— Reply to this email directly, view it on GitHubhttps://github.com/hbz/lobid-organisations/issues/99#issuecomment-1628274734, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABYALYHIFSMIM7H56WNRG6DXPOJ5PANCNFSM4BYEAAIQ. You are receiving this because you were mentioned.Message ID: @.**@.>>

TobiasNx commented 10 months ago

Still need to update the context but implemented this on test: http://test.lobid.org/organisations/search?q=exists%3A"librariesOrgID" http://test.lobid.org/organisations/DBS-AA612.json

Phu2 commented 10 months ago

Just tried out http://test.lobid.org/organisations/search?q=exists%3A"librariesOrgID" and got

Error: all shards failed, cause: Failed to parse query [exists:"librariesOrgID]

Phu2 commented 10 months ago

Oops, it's just the missing quote at the end.

acka47 commented 10 months ago

Oops, it's just the missing quote at the end

You can also just leave them out in _exists_ queries: http://test.lobid.org/organisations/search?q=_exists_%3AlibrariesOrgID (fixed)

TobiasNx commented 10 months ago

The link seems broken, but querying work: _exists_:librariesOrgID

TobiasNx commented 9 months ago

http://test.lobid.org/organisations/search?q=_exists_%3AlibrariesOrgID

librariesOrgID still needs to be added to lobid vocabs.

 "sameAs": [
    "https://librarytechnology.org/library/207140"
  ]

List is created based on the provided data.

acka47 commented 9 months ago

+1 Strange, that this only worked for public libraries but not for university libraries and others. Here are some examples with libraries.org entry but without librariesOrgId in lobid-organisation:

Or just search for "Universitätsbibliothek" at https://librarytechnology.org and see that most of these have no librariesOrgId in lobid.

TobiasNx commented 9 months ago

+1 Strange, that this only worked for public libraries but not for university libraries and others. Here are some examples with libraries.org entry but without librariesOrgId in lobid-organisation:

* https://librarytechnology.org/library/61409

* https://librarytechnology.org/library/61959

Or just search for "Universitätsbibliothek" at https://librarytechnology.org and see that most of these have no librariesOrgId in lobid.

It seems that almost only public libreries have additional identifiers like DBS ID so that we can map them. Perhaps mbreeding can help and explain why the higherEd libraries are missing these identifiers and what his data source is.

mbreeding commented 9 months ago

A few years ago, I did a project to incorporate public libraries in Germany into libraries.org. One portion of that effort included using lobid.org http://lobid.org/organisations/search?q=classification.label.de%3A%22%C3%96ffentliche+Bibliothek%22+and+location.adress.adressCountry%3A%22DE%22

I have not done a similar project for academic libraries in Germany, since those are better represented. I would be interested in gathering additional data on Academic libraries in Germany, or at least placing lobid identifiers in the existing records.

-marshall

From: TobiasNx @.> Sent: Wednesday, August 9, 2023 7:36 AM To: hbz/lobid-organisations @.> Cc: Marshall Breeding @.>; Mention @.> Subject: Re: [hbz/lobid-organisations] Add links to libraries.org (#99)

+1 Strange, that this only worked for public libraries but not for university libraries and others. Here are some examples with libraries.org entry but without librariesOrgId in lobid-organisation:

Or just search for "Universitätsbibliothek" at https://librarytechnology.org and see that most of these have no librariesOrgId in lobid.

It seems that almost only public libreries have additional identifiers like DBS ID so that we can map them. Perhaps mbreedinghttps://github.com/mbreeding can help and explain why the higherEd libraries are missing these identifiers and what his data source is.

— Reply to this email directly, view it on GitHubhttps://github.com/hbz/lobid-organisations/issues/99#issuecomment-1671244861, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABYALYATGWFHGY4UTA2XV7LXUN72TANCNFSM4BYEAAIQ. You are receiving this because you were mentioned.Message ID: @.**@.>>

acka47 commented 9 months ago

I would be interested in gathering additional data on Academic libraries in Germany, or at least placing lobid identifiers in the existing records.

We have set up a – rather basic – reconciliation endpoint for lobid-organisations in 2015 that could be used for matching the entries, see https://lobid.org/organisations/api/en#openrefine .

TobiasNx commented 9 months ago

When we close our milestone: https://github.com/hbz/lobid-organisations/milestone/1 I think it could be a good time to have a look at matching these.

TobiasNx commented 8 months ago

The newest changes are implemented. Even though the milestone is not closed due to some needed changes in the GUI and documentation.

You can find the links to librariesOrg in the productive system: http://lobid.org/organisations/search?q=_exists_%3AlibrariesOrgID

It could be a good time to reconcile now: https://github.com/hbz/lobid-organisations/issues/99#issuecomment-1671275810

@mbreeding you can contact us if you need any help with the reconciliation endpoint.

@fsteeg should we add the links to libraries.org to the GUI too?