Belval / TextRecognitionDataGenerator

A synthetic data generator for text recognition
MIT License
3.24k stars 966 forks source link

Blank char in generating Arabic? #166

Closed xjock closed 4 years ago

xjock commented 4 years ago

ﺍﺟﺒﺎﺭﻯ ﺍﻏﺮﺍﺱ ﻟﻠﻤﻌﻠﻤﻴﻦ ﺗﺘﻨﻮﺱ ﺟﺰﺍﺯ_65 ﺍﺳﺘﻄﺮﺍﺩ ﺑﺮﺍﺭﻳﻚ ﺍﻻﻃﻠﻨﻄﻰ ﺍﻟﻔﻴﻠﺒﻴﻦ ﺍﺩﻋﻴﺔ_74 ﺍﻓﺮﺍﺯ ﺍﻟﺤﺎﺩﺓ ﻣﻄﺒﻌﻴﺔ ﻓﻠﺬ ﺗﻘﻮﻳﺮ_68 ﺍﻗﺼﺮ ﻧﺰﺍﻩ ﻧﻴﺐ ﺑﻌﺚ ﺑﺪﻳﮭﺔ_61 ﺍﻛﻠﺔ ﺍﻟﻌﺮﻭﺱ ﻓﻠﻮ ﺭﺍﻳﺔ ﻳﻤﺎﺋﻢ_94 ﺍﻟﺘﺴﻨﻴﻢ ﺻﺎﻓﺢ ﻭﺿﻌﺎﺀ ﺍﻟﻘﺴﻢ ﻣﻴﻘﺎﻥ_92 ﺍﻟﺮﻛﺎﺏ ﻣﺮﻗﺎﺓ ﺍﻟﺼﻮﻓﻴﺔ ﺗﻄﻮﺍﻑ ﺣﺎﺿﺖ_90 ﺍﻟﻌﻴﺶ ﻣﺠﻠﺠﻞ ﻣﻨﺎﺻﺮﺓ ﻧﮭﺰ ﺍﻟﺒﻴﻦ_81 ﺍﻟﻮﺯﺍﺭﺓ ﻛﺴﺮﻭﻧﺔ ﻟﺒﻴﺐ ﻧﺲﺀ ﻃﺎﺋﻒ_93 ﺍﻧﺼﺮﻑ ﺛﺎﻛﻠﺔ ﺭﮬﺎﻓﺔ ﻣﻠﻴﺠﺮﺍﻡ ﻣﺴﻠﻮﻝ_69 ﺍﻭﻣﻨﻴﺒﻮﺱ ﻓﺴﻄﺎﻁ ﻭﻟﻮﺩ ﺍﻟﻌﺮﻭﺓ ﺗﺒﻴﻴﻦ_58 ﺑﺎﺫﻧﺠﺎﻥ ﺍﻋﺘﺰﺍﺯ ﺍﻟﺤﻴﺾ ﺧﺮﺍﺀ ﻣﺨﺘﻨﻖ_60 ﺑﻄﺎﺀ ﻣﺘﺠﻠﺪ ﻣﻴﻜﺎﻧﻲ ﻣﻼﻋﻴﻦ ﺳﺎﺋﺪ_91 ﺗﺼﺎﻏﺮ ﻓﻄﺎﻳﺮﻳﺔ ﺍﻹﺻﻼﺡ ﺍﻟﺤﺮﺍﺋﻖ ﺍﺟﺎﻧﺐ_73 ﺗﻔﺎﻋﻴﻞ ﻳﻔﻠﺢ ﺣﻄﺎﺏ ﻳﺘﻄﺮﻕ ﮬﺮﺵ_72 ﺗﻘﺎﻭﻳﻢ ﺍﺟﺮﺍﻑ ﺍﻟﺸﺮﺍﺭﺓ ﻣﺘﺎﺟﺮ ﺍﻟﺨﻢ_63 ﺗﻜﺮﺍﺭ ﻣﺒﻄﺎﻥ ﺧﻨﻮﺹ ﺳﻨﺘﻴﻦ ﻧﺸﻴﻂ_85 ﺟﻠﻴﺪﻱ ﺳﺮﻱ ﺑﻄﻰﺀ ﻧﻌﻴﻖ ﺗﻜﻠﻒ_67 ﺣﺎﻳﺪ ﺍﻟﺠﮭﺪ ﻭﻗﺘﻤﺎ ﺗﻤﻮﺭﺍ ﻓﻨﺎﻧﻮﻥ_76 ﺣﺪﺍﻓﺔ ﺻﺪﺍﻕ ﺿﻮﺀ ﻭﺍﻟﺘﺴﻮﻳﻎ ﺍﮬﺘﺰﺍﺯﺓ_87 ﺧﺮﺧﺮ ﮬﻴﻤﺎﻥ ﺍﻟﻤﻌﻴﺸﺔ ﺗﻨﻮﻳﻦ ﻧﻘﺎﺏ_84 ﺩﺷﻴﺶ ﺍﺑﺮﺵ ﺍﺳﻠﺌﺔ ﺳﺎﻧﺢ ﻏﺮﻣﺎﺀ_86 ﺩﻳﺮﺓ ﺍﻋﻠﻦ ﺍﻟﺜﺮﻳﺎ ﮬﺎﺭﺑﺎ ﻣﺮﺍﻛﺶ_70 ﺭﻋﻦ ﺍﻟﻔﺮﺍﻏﻴﺔ ﺍﻧﮭﺰﺍﻣﻲ ﻻﻓﺢ ﺍﺳﺘﻘﺒﺎﻻ_75 ﺳﻜﺮﺗﺎﺓ ﻛﻔﺎﻩ ﺍﻟﺪﻳﻜﻲ ﺍﻟﺨﻮﺍﺗﻢ ﻧﻔﺞ_66 ﺷﺞ ﺟﻠﻴﺪﺓ ﻋﻴﺎﺫ ﻣﻠﺰﺯ ﺟﺎﺋﻠﻮﻥ_95 ﻋﻀﻮﺽ ﺍﻟﻤﻐﻴﺐ ﺟﺎﻟﻮﻥ ﻣﺨﺮﻓﺔ ﺗﺮﺑﺲ_64 ![Uploading ﻓﺨﺬﻱ ﺍﺣﺪﺍﺛﻴﺎﺕ ﻗﺒﻼ ﺧﻴﺎﺽ ﺍﻧﺠﻴﺔ_79.jpg…]()

ﻣﻠﺤﻦ ﺗﺤﺮﻳﻒ ﺑﻴﻨﮭﻤﺎ ﺟﻔﺘﻠﻚ ﺟﺬﻭﺭ_811 ﺍﻟﺴﻞ ﺷﻮﺀ ﻏﻤﺎﺯﺓ ﺳﺤﻦ ﺍﻧﮭﺰﺍﻣﻲ_632 ﺍﻭﮬﺎﻕ ﺍﻟﺒﺆﺱ ﻣﺰﻳﻒ ﻛﻤﺨﺎ ﺣﻤﻀﻴﺔ_622

Belval commented 4 years ago

The font file is missing a character and outputs a blank rectangle when that happens. I would suggest finding another font that supports your charset and using that instead.

As an aside, did you install libraqm-devand recompile Pillow with Arabic support? Because the regenerated text seems to be missing its ligatures.