wit-ai / wit

Natural Language Interface for apps and devices
https://wit.ai/
936 stars 91 forks source link

Many written dutch numbers are not recognized by built-in wit/number entitiy #2620

Open hig-dev opened 1 year ago

hig-dev commented 1 year ago

Do you want to request a feature, report a bug, or ask a question about wit? Report a bug.

What is the current behavior?

This applies to the language dutch (NL).

I am using the HTTP speech endpoint to transcribe audio and to extract a number using the wit/number entitiy. For the numbers 100 - 999 the transcribed text is usually like the following:

Honderddrieënzestig: <-- this is not recognized as a number, and wit.ai does not extract a number (here it should be 163)

Sometimes the transcribed text looks like: Honderd tweeënzestig: <-- here the number will be correctly extracted (here it is 162)

So, in conclusion, if there is not a space between "honderd" and the rest of the number, the recognition of the number fails.

Examples where the extraction of the number fails:

[
  {
    "Text": "Honderdeen",
    "ExpectedNumber": 101
  },
  {
    "Text": "honderddrie",
    "ExpectedNumber": 103
  },
  {
    "Text": "honderdvier",
    "ExpectedNumber": 104
  },
  {
    "Text": "Honderdvijf",
    "ExpectedNumber": 105
  },
  {
    "Text": "Honderdzes",
    "ExpectedNumber": 106
  },
  {
    "Text": "honderdzeven",
    "ExpectedNumber": 107
  },
  {
    "Text": "Honderdacht",
    "ExpectedNumber": 108
  },
  {
    "Text": "Honderdnegen",
    "ExpectedNumber": 109
  },
  {
    "Text": "Honderdtien",
    "ExpectedNumber": 110
  },
  {
    "Text": "honderdelf",
    "ExpectedNumber": 111
  },
  {
    "Text": "Honderddertien",
    "ExpectedNumber": 113
  },
  {
    "Text": "Honderdvijftien",
    "ExpectedNumber": 115
  },
  {
    "Text": "Honderdzestien",
    "ExpectedNumber": 116
  },
  {
    "Text": "Honderdzeventien",
    "ExpectedNumber": 117
  },
  {
    "Text": "Honderdachttien",
    "ExpectedNumber": 118
  },
  {
    "Text": "Honderdnegentien",
    "ExpectedNumber": 119
  },
  {
    "Text": "Honderdtwintig",
    "ExpectedNumber": 120
  },
  {
    "Text": "Honderdeenentwintig",
    "ExpectedNumber": 121
  },
  {
    "Text": "Honderdtweeëntwintig",
    "ExpectedNumber": 122
  },
  {
    "Text": "honderddrieëntwintig",
    "ExpectedNumber": 123
  },
  {
    "Text": "honderdvierentwintig",
    "ExpectedNumber": 124
  },
  {
    "Text": "honderdvijfentwintig",
    "ExpectedNumber": 125
  },
  {
    "Text": "Honderdzesentwintig",
    "ExpectedNumber": 126
  },
  {
    "Text": "Honderdzevenentwintig",
    "ExpectedNumber": 127
  },
  {
    "Text": "Honderdachtentwintig",
    "ExpectedNumber": 128
  },
  {
    "Text": "Honderdnegenentwintig",
    "ExpectedNumber": 129
  },
  {
    "Text": "honderddertig",
    "ExpectedNumber": 130
  },
  {
    "Text": "Honderdeenendertig",
    "ExpectedNumber": 131
  },
  {
    "Text": "honderdtweeëndertig",
    "ExpectedNumber": 132
  },
  {
    "Text": "honderddrieëndertig",
    "ExpectedNumber": 133
  },
  {
    "Text": "honderdvierendertig",
    "ExpectedNumber": 134
  },
  {
    "Text": "honderdvijfendertig",
    "ExpectedNumber": 135
  },
  {
    "Text": "honderdzesendertig",
    "ExpectedNumber": 136
  },
  {
    "Text": "honderdzevenendertig",
    "ExpectedNumber": 137
  },
  {
    "Text": "honderdachtendertig",
    "ExpectedNumber": 138
  },
  {
    "Text": "Honderdnegenendertig",
    "ExpectedNumber": 139
  },
  {
    "Text": "Honderdveertig",
    "ExpectedNumber": 140
  },
  {
    "Text": "Honderdeenenveertig",
    "ExpectedNumber": 141
  },
  {
    "Text": "honderdtweeënveertig",
    "ExpectedNumber": 142
  },
  {
    "Text": "honderddrieënveertig",
    "ExpectedNumber": 143
  },
  {
    "Text": "honderdvierenveertig",
    "ExpectedNumber": 144
  },
  {
    "Text": "Honderdvijfenveertig",
    "ExpectedNumber": 145
  },
  {
    "Text": "Honderdzesenveertig",
    "ExpectedNumber": 146
  },
  {
    "Text": "Honderdzevenenveertig",
    "ExpectedNumber": 147
  },
  {
    "Text": "Honderdachtenveertig",
    "ExpectedNumber": 148
  },
  {
    "Text": "Honderdnegenenveertig",
    "ExpectedNumber": 149
  },
  {
    "Text": "honderdvijftig",
    "ExpectedNumber": 150
  },
  {
    "Text": "Honderdeenenvijftig",
    "ExpectedNumber": 151
  },
  {
    "Text": "honderdtweeënvijftig",
    "ExpectedNumber": 152
  },
  {
    "Text": "Honderddrieënvijftig",
    "ExpectedNumber": 153
  },
  {
    "Text": "Honderdvijfenvijftig",
    "ExpectedNumber": 155
  },
  {
    "Text": "Honderdzesenvijftig",
    "ExpectedNumber": 156
  },
  {
    "Text": "Honderdzevenenvijftig",
    "ExpectedNumber": 157
  },
  {
    "Text": "Honderdachtenvijftig",
    "ExpectedNumber": 158
  },
  {
    "Text": "honderdnegenenvijftig",
    "ExpectedNumber": 159
  },
  {
    "Text": "Honderdzestig",
    "ExpectedNumber": 160
  },
  {
    "Text": "Honderdeenenzestig",
    "ExpectedNumber": 161
  },
  {
    "Text": "honderdtweeënzestig",
    "ExpectedNumber": 162
  },
  {
    "Text": "Honderddrieënzestig",
    "ExpectedNumber": 163
  },
  {
    "Text": "Honderdvierenzestig",
    "ExpectedNumber": 164
  },
  {
    "Text": "Honderdvijfenzestig",
    "ExpectedNumber": 165
  },
  {
    "Text": "Honderdzesenzestig",
    "ExpectedNumber": 166
  },
  {
    "Text": "Honderdzevenenzestig",
    "ExpectedNumber": 167
  },
  {
    "Text": "Honderdachtenzestig",
    "ExpectedNumber": 168
  },
  {
    "Text": "Honderdnegenenzestig",
    "ExpectedNumber": 169
  },
  {
    "Text": "Honderdzeventig",
    "ExpectedNumber": 170
  },
  {
    "Text": "Honderdeenenzeventig",
    "ExpectedNumber": 171
  },
  {
    "Text": "Honderdtweeënzeventig",
    "ExpectedNumber": 172
  },
  {
    "Text": "Honderddrieënzeventig",
    "ExpectedNumber": 173
  },
  {
    "Text": "Honderdvierenzeventig",
    "ExpectedNumber": 174
  },
  {
    "Text": "Honderdvijfenzeventig",
    "ExpectedNumber": 175
  },
  {
    "Text": "Honderdzesenzeventig",
    "ExpectedNumber": 176
  },
  {
    "Text": "Honderdzevenenzeventig",
    "ExpectedNumber": 177
  },
  {
    "Text": "Honderdachtenzeventig",
    "ExpectedNumber": 178
  },
  {
    "Text": "Honderdnegenenzeventig",
    "ExpectedNumber": 179
  },
  {
    "Text": "Honderdtachtig",
    "ExpectedNumber": 180
  }
]

If applicable, what is the App ID where you are experiencing this issue? If you do not provide this, we cannot help. 612490360532442