DFKI-NLP / sherlock

State-of-the-art Information Extraction
3 stars 1 forks source link

`sherlock/feature_converters` directory is in a confusing place or confusingly named #36

Closed GabrielKP closed 2 years ago

GabrielKP commented 2 years ago

The concept of InputFeatures is dependent on the representations and functions used in the transformers package.

With the support of AllenNLP (#8) there will be an additional set of something which is equivalent to InputFeatures but is based on AllenNLP.

Neither the current positioning nor the name of the directory sherlock/feature_converters and its contents reflect that they are transformers-only.

I propose to change this, but do not exactly know how. Some ideas (and my subjective feeling about them):

@leonhardhennig Opinions?

GabrielKP commented 2 years ago

I also could implement the allennlp support without touching sherlock/feature_converters and handle all the dataconversion in the annotator itself. This would ensure (a) backward compability and (b) ease of implementation. Still, the confusion about feature_converter would remain too.

What is the usecase of a separate feature_converter?

GabrielKP commented 2 years ago

This issue is solved, feature_converter now relies on the framwork parameter and thus is not only dependent on transformers anymore