search

whylabs / langkit

🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
https://whylabs.ai
Apache License 2.0
839 stars 67 forks source link

Any plan to support multilingual? #74

Open jack1981 opened 1 year ago

jack1981 commented 1 year ago

Multilingual is "must have" feature for prod deployment for most international companies , any plan to support it for modules ? For example , perspective api supports multilingual https://developers.perspectiveapi.com/s/about-the-api-attributes-and-languages?language=en_US

The concern is some of open source libs and models langkit integrated did not support multilingual yet.

andrewelizondo commented 1 year ago

@jack1981 Thanks for the question! We launched with English support primarily but we do plan to support additional languages in the near future. Do you have a top list of initial languages to support?

jack1981 commented 1 year ago

@andrewelizondo thanks for the response , sorry to take more days to reply as I want to answer the question carefully ( without languages bias :) ) Personally ( not on behalf of company ) , below list of languages will be sufficient for most of cases , I think community can pick up priority

English French Spanish Italian German Russian Portuguese Dutch Polish Chinese (Simplified) Chinese (Traditional) Japanese Korean Swedish Danish Norwegian Finnish Turkish Hungarian Czech Thai Indonesian Malaysian Vietnamese Filipino Hindi Arabic Hebrew Greek Icelandic

lj163ucas commented 1 year ago

We need Chinese. Thanks @andrewelizondo