Assigning same start and end values for multiple occurrences of a word in same sentence

[sravyaysk]

• While creating training data using rasa-ui, If there are multiple occurrences of a word in a sentence, then the first word occurrence "start" and "end" values are assigned to all the other word occurrences.
• This is creating issues when training using ner_crf as it uses them as it features.

Example:

This is the json format data obtained where two INR values are having same "start" and "end" values:

      { "text": "My December expenses: Cycle INR 10,000 School Fees INR 5,000",
        "intent": "balance_sheet",
        "entities": [
          {
            "start": 32,
            "end": 38,
            "value": "10,000",
            "entity": "amount"
          },
          {
            "start": 39,
            "end": 50,
            "value": "School Fees",
            "entity": "item_name"
          },
          {
            "start": 28,
            "end": 31,
            "value": "INR",
            "entity": "currency"
          },
          {
            "start": 55,
            "end": 60,
            "value": "5,000",
            "entity": "amount"
          },
          {
            "start": 3,
            "end": 11,
            "value": "December",
            "entity": "month"
          },
          {
            "start": 22,
            "end": 27,
            "value": "Cycle",
            "entity": "item_name"
          },
          {
            "start": 28,
            "end": 31,
            "value": "INR",
            "entity": "currency"
          } ] }