Open stegben opened 5 years ago
Turn integers or floats to normalized token, e.g.
123 => _3int_ 32.21 => _2float2_ ..., etc.
123
_3int_
32.21
_2float2_
Basically, these ops are wrapper of text_normalizer.factory.NumberToken
text_normalizer.factory.NumberToken
Turn integers or floats to normalized token, e.g.
123
=>_3int_
32.21
=>_2float2_
..., etc.Basically, these ops are wrapper of
text_normalizer.factory.NumberToken