bar plot languages count LLM dataset

[huseinzol05]

Fasttext model trained on,

lang_labels_v2 = {
    0: 'standard-english',
    1: 'local-english',
    2: 'manglish',
    3: 'standard-indonesian',
    4: 'socialmedia-indonesian',
    5: 'standard-malay',
    6: 'local-malay',
    7: 'standard-mandarin',
    8: 'local-mandarin',
    9: 'other',
}

Steps to reproduce the fasttext training at https://github.com/huseinzol05/malaya/blob/5.1/pretrained-model/language-detection-v2/train-fasttext-auto.ipynb

[huseinzol05]

• Directory https://github.com/huseinzol05/malay-dataset/blob/master/prepare-llm/count.ipynb