Baleen

Baleen 2 has now reached the end of it's life, and we encourage all users to move to Baleen 3. There is no intention to provide further updates or any significant support for Baleen 2.

Baleen is an extensible text processing capability that allows entity-related information to be extracted from unstructured and semi-structured data sources. It makes available in a structured format things of interest otherwise stored in formats such as text documents - references to people, organisations, unique identifiers, location information.

Baleen is written in Java 8 using the software project management tool Maven 3 and draws heavily on the Apache Unstructured Information Management Architecture (UIMA) which provides a framework, components and infrastructure to handle unstructured information management.

Baleen was written by the Defence Science and Technology Laboratory (Dstl) in support of UK Defence users looking to extract entities and search unstructured text documents. License information can be found in the accompanying LICENSE.txt file in this repository and the licenses of libraries on which Baleen is dependent are listed in the file THIRD-PARTY.txt.

Baleen is still under active development, and is released here not as a final product but as a work in progress. As such, there may be bugs, issues, typos, mistakes in the documentation, and more. We hope that contributions from other users will improve Baleen and result in a better framework for others to use.

Upgrading to 2.4 and later

Baleen 2.4 (and later) contain a number of changes that may make it incompatible with older pipelines - for upgrade guidance see the Upgrading Between Versions wiki page.

Getting Started

Baleen includes an in-built server, which hosts full documentation and guides on how to use Baleen. To get started, you will need to launch this server and read this documentation. To launch the server, run the following command.

java -jar baleen-2.8.0-SNAPSHOT.jar

Once running, the server can be accessed at http://localhost:6413.

If you require the Javadoc to be available through the in-built server, then you should place the Baleen Javadoc JAR in the same directory as the Baleen JAR.

Prerequisites

Running

To run Baleen, you will need:

A sensible amount of RAM. Start with 4GB and alter according to the number of annotators being employed.
Java 8 or larer

Developing

The develop with Baleen, we suggest you use:

Oracle Java JDK 1.8
Eclipse Mars or greater (assumed to include Maven)
Maven

Baleen requires Java 8 or later.

Licence

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this software except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License

Data

Baleen contains data derived from other data sources. For more information, please refer to the Baleen source code.

Code-Point Open

Licensed under the Open Government Licence (OGL) v3 - http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/

Countries JSON

Licensed under the ODC Open Database Licence (ODbL) 1.0 - http://opendatacommons.org/licenses/odbl/1.0/

Any rights in individual contents of the database are licensed under the Database Contents License - http://opendatacommons.org/licenses/dbcl/1.0/

Countries GeoJSON

Licensed under the ODC Public Domain Dedication and Licence (PDDL) 1.0 - http://opendatacommons.org/licenses/pddl/1.0/

OpenNLP Language Models

Licensed under the Apache Software License 2.0 - http://www.apache.org/licenses/LICENSE-2.0

dstl / baleen

readme