search

sahanruwantha / siconv

The siconv Python package simplifies the conversion between Sinhala and Singlish languages. Whether you're dealing with Sinhala text that needs transformation into Singlish or vice versa, siconv offers a user-friendly solution.
GNU General Public License v3.0
7 stars 2 forks source link

Issue: Performance Optimization Needed #24

Open IsiraUdaththa opened 3 months ago

IsiraUdaththa commented 3 months ago

The process is too slow for practical applications. I tested its accuracy using data from Kaggle:

100%|█████████████| 440024/440024 [00:27<00:00, 16197.57it/s]

--- Test Results ---
Passed   : 55868
Failed   : 384156
Accuracy : 0.127

sinhala_to_singlish: Speed is at 16197.57it/s, but accuracy requires enhancement.

` 0%|▏            | 1249/440024 [00:21<2:17:42, 53.10it/s]`

singlish_to_sinhala: Speed is at 53.10it/s, which is unacceptable.

For the code used in these tests, please refer to this repository .

sahanruwantha commented 3 months ago

Is there anyway that I could get the test script that you used

IsiraUdaththa commented 3 months ago

Here is the test script. I forked the repo.

https://github.com/IsiraUdaththa/siconv/tree/dev/tests

sahanruwantha commented 3 months ago

Thanks, I'll look into it