search

ahmetaa / zemberek-nlp

NLP tools for Turkish.
Other
1.15k stars 210 forks source link

About server #155

Closed koust closed 6 years ago

koust commented 6 years ago

I want to use the zemberek library quickly. What should be minimum server features?

My server features: 1 Cpu and 1 GB Ram hosted by digital ocean.

Note: Load time average 7-8s.

ahmetaa commented 6 years ago

Please hang on for about one or two weeks, I will provide this information in the next version because there will be several internal changes.

ahmetaa commented 6 years ago

But current version probably works okay with that configuration depending on usage scenario.

koust commented 6 years ago

I understand. you think, it possible to get performance by with this server feature and good configuration?

ahmetaa commented 6 years ago

When you say "Load Time" do you mean initialization time? We have changed the dictionary mechanism in the new version, it loads from a binary file which is much faster. But there are other files are loaded during initialization that may slow down system.

Bu arada, dilerseniz Türkçe yazabilirsiniz.

koust commented 6 years ago

Sunucuya request atıyorum ve o sırada initialization ve json olarak dönüş alıyorum. Google chrome network üzerinden page Load Time bakıyorum onu kastetmiştim. Yeni versiyonu bekliyorum. Geri dönüşünüz için teşekkür ederim.

mdakin commented 6 years ago

Yeni versiyonun bellek kullanim ve performans karakteristikleri farkli olacak, serverin ayaga kalkis suresi su anda orta karar bir bilgisayarda ~1-2 sn civari olmasi lazim. Sunucu ayaga kalktiktan sonra saniyede binlerce kelimeyi cozumleyebilir.

Yakinda daha kapsamli bir server versiyonu yazmayi dusunuyorum. Izlemek istersen surada: https://github.com/mdakin/zemberek-io