Some wikipage entries not get found in formulasearch

[Hyper-Node]

When saving a page entries for indexes for page get created. However, some entries or sometimes entries can't be found with the search although they are in the index files.

Example is this on MathSearfchTest 2 page, each entry is saved with a dedicated pageedit:

first edit: :$5\; million\; \backslash times\; 12$ second edit: :$test\; -\; b2$

First enty gets applied to index, but cant be found here: https://portal.mardi4nfdi.de/wiki/Special:MathSearch Second entry also gets applied to index and can be found.

Analysis:

• 4 million \times 15 readded is also not found

• adding something simple afterwards like "t23=c" is found after the faulty edits on the page

• checking index files for this entries, the non findable entries are located in the index (see comment)

• "a \times b" in example is found, also "5 \times 12"

• "4 million" is not found or faulty, this seems to cause the issue ("4 milion" one l is also not found)

• "4 mi" is found, "lion" is also found

• "4 milon" is found, only difference from "4 milion" which is not found is the second "i" this seems to cause the problem

• "4 mili" is found "4 milio" is not found -> maybe because number of letters defining a variable exceeded ?

• "4 gungo" is not found "4 gung" is found -> speaks for length assumption

• further: see screenshot

• it seems to be the condition for the bug: variable which exceeds 5 letters and has double letter is not found.
  

-> tbd mathml index comparison of similar faulty and working examples

[Hyper-Node]

<math xmlns="http://www.w3.org/1998/Math/MathML" alttext="{\displaystyle{\displaystyle 5million\times 12}}" class="ltx_Math" display="inline" id="p1.1.m1.1">
  <semantics id="p1.1.m1.1a">
    <mrow id="p1.1.m1.1.12" xref="p1.1.m1.1.12.cmml">
      <mrow id="p1.1.m1.1.12.1" xref="p1.1.m1.1.12.1.cmml">
        <mn id="p1.1.m1.1.1" xref="p1.1.m1.1.1.cmml">5</mn>
        <mo id="p1.1.m1.1.12.1.1" xref="p1.1.m1.1.12.1.1.cmml">⁢</mo>
        <mi id="p1.1.m1.1.2" xref="p1.1.m1.1.2.cmml">m</mi>
        <mo id="p1.1.m1.1.12.1.1a" xref="p1.1.m1.1.12.1.1.cmml">⁢</mo>
        <mi id="p1.1.m1.1.3" xref="p1.1.m1.1.3.cmml">i</mi>
        <mo id="p1.1.m1.1.12.1.1b" xref="p1.1.m1.1.12.1.1.cmml">⁢</mo>
        <mi id="p1.1.m1.1.4" xref="p1.1.m1.1.4.cmml">l</mi>
        <mo id="p1.1.m1.1.12.1.1c" xref="p1.1.m1.1.12.1.1.cmml">⁢</mo>
        <mi id="p1.1.m1.1.5" xref="p1.1.m1.1.5.cmml">l</mi>
        <mo id="p1.1.m1.1.12.1.1d" xref="p1.1.m1.1.12.1.1.cmml">⁢</mo>
        <mi id="p1.1.m1.1.6" xref="p1.1.m1.1.6.cmml">i</mi>
        <mo id="p1.1.m1.1.12.1.1e" xref="p1.1.m1.1.12.1.1.cmml">⁢</mo>
        <mi id="p1.1.m1.1.7" xref="p1.1.m1.1.7.cmml">o</mi>
        <mo id="p1.1.m1.1.12.1.1f" xref="p1.1.m1.1.12.1.1.cmml">⁢</mo>
        <mi id="p1.1.m1.1.8" xref="p1.1.m1.1.8.cmml">n</mi>
      </mrow>
      <mo id="p1.1.m1.1.9" xref="p1.1.m1.1.9.cmml">×</mo>
      <mn id="p1.1.m1.1.11" xref="p1.1.m1.1.11.cmml">12</mn>
    </mrow>
    <annotation-xml encoding="MathML-Content" id="p1.1.m1.1b">
      <apply id="p1.1.m1.1.12.cmml" xref="p1.1.m1.1.12">
        <times id="p1.1.m1.1.9.cmml" xref="p1.1.m1.1.9"/>
        <apply id="p1.1.m1.1.12.1.cmml" xref="p1.1.m1.1.12.1">
          <times id="p1.1.m1.1.12.1.1.cmml" xref="p1.1.m1.1.12.1.1"/>
          <cn id="p1.1.m1.1.1.cmml" type="integer" xref="p1.1.m1.1.1">5</cn>
          <ci id="p1.1.m1.1.2.cmml" xref="p1.1.m1.1.2">𝑚</ci>
          <ci id="p1.1.m1.1.3.cmml" xref="p1.1.m1.1.3">𝑖</ci>
          <ci id="p1.1.m1.1.4.cmml" xref="p1.1.m1.1.4">𝑙</ci>
          <ci id="p1.1.m1.1.5.cmml" xref="p1.1.m1.1.5">𝑙</ci>
          <ci id="p1.1.m1.1.6.cmml" xref="p1.1.m1.1.6">𝑖</ci>
          <ci id="p1.1.m1.1.7.cmml" xref="p1.1.m1.1.7">𝑜</ci>
          <ci id="p1.1.m1.1.8.cmml" xref="p1.1.m1.1.8">𝑛</ci>
        </apply>
        <cn id="p1.1.m1.1.11.cmml" type="integer" xref="p1.1.m1.1.11">12</cn>
      </apply>
    </annotation-xml>
    <annotation encoding="application/x-tex" id="p1.1.m1.1c">{\displaystyle{\displaystyle 5million\times 12}}</annotation>
  </semantics>
</math>

[Hyper-Node]

...

[Hyper-Node]

Eventually recheck this in new environment.

[physikerwelt]

Update formula search index. Continue https://gerrit.wikimedia.org/r/c/mediawiki/extensions/MathSearch/+/1069110/1