dadoonet / fscrawler

Elasticsearch File System Crawler (FS Crawler)

https://fscrawler.readthedocs.io/

Apache License 2.0

1.32k stars 295 forks source link

crawler elasticsearch java tika

readme

File System Crawler for Elasticsearch

Welcome to the FS Crawler for Elasticsearch

This crawler helps to index binary documents such as PDF, Open Office, MS Office.

Main features:

Local file system (or a mounted drive) crawling and index new files, update existing ones and removes old ones.
Remote file system over SSH/FTP crawling.
REST interface to let you "upload" your binary documents to elasticsearch.

Latest versions

Current "most stable" versions are:

Elasticsearch	FS Crawler	Released	Docs
6.x, 7.x, 8.x	2.10-SNAPSHOT		2.10-SNAPSHOT

GitHub Release Date GitHub last commit

Docker Pulls Docker Image Size (tag) Docker Image Version (latest semver)

Build and Quality Status

GitHub stats

GitHub commits since latest release (by SemVer including pre-releases) GitHub commit activity (branch) GitHub contributors

GitHub issues GitHub pull requests

Documentation

The guide has been moved to ReadTheDocs.

Contribute

Works on my machine - and yours ! Spin up pre-configured, standardized dev environments of this repository, by clicking on the button below.

License

GitHub

Read more about the Apache2 License.

Thanks

Thanks to JetBrains for the IntelliJ IDEA License!

Thanks to SonarCloud for the free analysis!