opensemanticsearch / open-semantic-etl

Python based Open Source ETL tools for file crawling, document processing (text extraction, OCR), content analysis (Entity Extraction & Named Entity Recognition) & data enrichment (annotation) pipelines & ingestor to Solr or Elastic search index & linked data graph database
https://opensemanticsearch.org/etl
GNU General Public License v3.0
254 stars 69 forks source link

Dedupe content type group #118

Closed opensemanticsearch closed 4 years ago

opensemanticsearch commented 4 years ago

Dedupe content_type_group_ss f.e. if multiple embedded images, its enough to have content type group image once.

Mandalka commented 4 years ago

Done in plugin enhance_contenttype_group