Closed GabrielKP closed 2 years ago
I also could implement the allennlp support without touching sherlock/feature_converters
and handle all the dataconversion in the annotator
itself. This would ensure (a) backward compability and (b) ease of implementation. Still, the confusion about feature_converter
would remain too.
What is the usecase of a separate feature_converter?
This issue is solved, feature_converter now relies on the framwork
parameter and thus is not only dependent on transformers anymore
The concept of
InputFeatures
is dependent on the representations and functions used in thetransformers
package.With the support of AllenNLP (#8) there will be an additional set of something which is equivalent to
InputFeatures
but is based on AllenNLP.Neither the current positioning nor the name of the directory
sherlock/feature_converters
and its contents reflect that they aretransformers
-only.I propose to change this, but do not exactly know how. Some ideas (and my subjective feeling about them):
annotators
folder (this seems cumbersome later on, e.g. if somebody wants to use them)sherlock/feature_converters
into something likesherlock/feature_converters_transformer
, createsherlock/feature_converters_allennlp
and call it a day (this is not clean)@leonhardhennig Opinions?