search

edponce / FACET

Framework for Annotation and Concept Extraction in Text
Other
2 stars 0 forks source link

Non-pickle serializers do not work with Simstring #18

Open edponce opened 4 years ago

edponce commented 4 years ago

Simstring matcher uses 'sets' to store strings, but 'sets' are not supported by all serializers. We have to specifically use 'pickle' serializer.

The issue is that 'sets' is the correct data structure to use (performance is hindered substantially if other collection data structures are used instead).