Testing the new tagger dictionary

jaumeortola commented 2 years ago

We have a new tagger dictionary ready to use in this branch: https://github.com/languagetool-org/languagetool/tree/pt-new-pos-dict The differences with the current master branch can be seen in this file. diff-results-2022-04-28T12 50.zip

There are still many undesired differences. I will track here the revision.

[x] ABREVIATIONS_DR[3] [g/m]
[x] ABREVIATIONS_PUNCTUATION[1] [g/m]
[x] ABREVIATIONS_PUNCTUATION[2] [g/m]
[x] ACENTUAÇÃO_VOGAL_ÊNCLISE[1] [g/m]
[x] ACHO_QUE[1] [g/m]
[x] ADJ_PARA_PRA_CARAÇAS_CARAMBA[1] [g/m]
[x] ADVERBIOS_MODO_EM_SEQUENCIA[1] [g/m]
[x] ADVERBIOS_MODO_EM_SEQUENCIA[2] [g/m]
[x] AI_AÍ[1] [g/m]
[x] ALTERNATIVE_CONJUNCTIONS_COMMA[2] [g/m]
[x] ALUGAR_CASA[1] [g/m]
[x] ALÉM_AQUÉM_RECÉM[1] [g/m]
[x] AO90_COMPOUNDS_GENERIC_PREFIX[13] [g/m]
[x] AO90_COMPOUNDS_GENERIC_PREFIX[15] [g/m]
[x] AO90_COMPOUNDS_GENERIC_PREFIX[16] [g/m]
[x] AO90_COMPOUNDS_GENERIC_PREFIX[1] [g/m]
[x] AO90_COMPOUNDS_GENERIC_PREFIX[20] [g/m]
[x] AO90_COMPOUNDS_GENERIC_PREFIX[5] [g/m]
[x] AO90_COMPOUNDS_GENERIC_PREFIX[7] [g/m]
[x] AO90_MONTHS_CASING[1] [g/m]
[x] AO90_WEEKDAYS_CASING[1] [g/m]
[x] AO_MEU_VER[1] [g/m]
[x] ARCHAISMS[4] [g/m]
[x] ARTICLES_PRECEDING_LOCATIONS[1] [g/m]
[x] ATRAVES_DE_POR[1] [g/m]
[x] AUXILIARY_VERB_INFINITIVE[1] [g/m]
[x] AUXILIARY_VERB_INFINITIVE[2] [g/m]
[x] AU[1] [g/m]
[x] AVOID_GERUND[1] [g/m]
[x] AVOID_GERUND[2] [g/m]
[x] AVOID_GERUND[3] [g/m]
[x] A_MAIORIA_SINGULAR[1] [g/m]
[x] A_NOUN_VERB[2] [g/m]
[x] A_NOUN_VERB[3] [g/m]
[x] A_WORD[1] [g/m]
[x] A_WORD[2] [g/m]
[x] BARBARISMS[1] [g/m]
[x] BARBARISMS[2] [g/m]
[x] BEM_FEITO[1] [g/m]
[x] BRASILEIRISMO_16_ATERRISAR[19] [g/m]
[x] BRASILEIRISMO_17_DECOLAR[20] [g/m]
[x] BRASILEIRISMO_20_REVISAR[24] [g/m]
[x] CACOPHONY[10] [g/m]
[x] CACOPHONY[1] [g/m]
[x] CACOPHONY[2] [g/m]
[x] CHAMAR_DENOMINAR_DE[1] [g/m]
[x] CHILDISH_LANGUAGE[1] [g/m]
[x] CLICHE_127_POR[59] [g/m]
[x] CLICHE_17_IR[29] [g/m]
[x] CLICHE_25_ABRIR[66] [g/m]
[x] CLICHE_3123_PERDER[225] [g/m]
[x] CLICHE_313_BATER[115] [g/m]
[x] CLICHE_319_BOTAR_2[121] [g/m]
[x] CLICHE_320_BRINCAR[122] [g/m]
[x] CLICHE_323_CAIR[125] [g/m]
[x] CLICHE_327_CANTAR[129] [g/m]
[x] CLICHE_338_COLOCAR[140] [g/m]
[x] CLICHE_374_DAR[176] [g/m]
[x] CLICHE_388_ESTAR[190] [g/m]
[x] CLICHE_389_ESTAR_2[192] [g/m]
[x] CLICHE_391_ESTAR[194] [g/m]
[x] CLICHE_444_TIRAR[269] [g/m]
[x] CLICHE_450_TRAZER[275] [g/m]
[x] CLICHE_46_NÃO[232] [g/m]
[x] CLICHE_7_FAZER[19] [g/m]
[x] COLOCACAO_ADVERBIOS_LUGAR[1] [g/m]
[x] COLOCACAO_ADVERBIOS_LUGAR[2] [g/m]
[x] COLOCACAO_ADVERBIO[1] [g/m]
[x] COLOCAÇÃO_ADVÉRBIO[1] [g/m]
[x] CONCORDANCIA_COM_NUCLEO_DO_SUJEITO_V2[1] [g/m]
[x] CONFUSÃO_ATE_ATÉ[1] [g/m]
[x] CONFUSÃO_ESTA_ESTÁ[1] [g/m]
[x] CONFUSÃO_ESTA_ESTÁ[2] [g/m]
[x] CONFUSÃO_E_É[1] [g/m]
[x] CONFUSÃO_E_É[3] [g/m]
[x] CONFUSÃO_MAS_MAIS[1] [g/m]
[x] CONFUSÃO_NOS_NÓS[1] [g/m]
[x] CONFUSÃO_TER_ESTAR[1] [g/m]
[x] CONFUSÃO_À_HÁ[2] [g/m]
[x] CONJUNTIVO_OBRIGATORIO[3] [g/m]
[x] CONTRACOES2[3] [g/m]
[x] CONTRACOES_OBRIGATORIAS[3] [g/m]
[x] CONTRACOES_OBRIGATORIAS[5] [g/m]
[x] CORRER_RISCO_ARRISCAR[1] [g/m]
[x] CRASE_CONFUSION[10] [g/m]
[x] CRASE_CONFUSION[14] [g/m]
[x] CRASE_CONFUSION[1] [g/m]
[x] CRASE_CONFUSION[3] [g/m]
[x] CRASE_CONFUSION[4] [g/m]
[x] CRASE_CONFUSION[6] [g/m]
[x] CRASE_CONFUSION[7] [g/m]
[x] CRASE_CONFUSION_2[1] [g/m]
[x] CRASE_CONFUSION_2[2] [g/m]
[x] CUJO_LIGACAO_NOME_ADJETIVO_NUMERAL[1] [g/m]
[x] DASH_ENUMERATION_SPACE_RULE[1] [g/m]
[x] DASH_RULE[3] [g/m]
[ ] DENTRO_DE_DA_DAS_DO_DOS_EM_NA_NAS_NO_NOS[1] [g/m]
[ ] DENTRO_DE_DA_DAS_DO_DOS_EM_NA_NAS_NO_NOS[2] [g/m]
[ ] DENTRO_DE_DA_DAS_DO_DOS_EM_NA_NAS_NO_NOS[3] [g/m]
[ ] DENTRO_DE_DA_DAS_DO_DOS_EM_NA_NAS_NO_NOS[4] [g/m]
[ ] DENTRO_DE_DA_DAS_DO_DOS_EM_NA_NAS_NO_NOS[5] [g/m]
[ ] DEPOIS_DE_APÓS[1] [g/m]
[ ] DET_FEM_MAS_A_O[1] [g/m]
[ ] DE_FORMA-MODO_ADJ[1] [g/m]
[ ] DE_MANEIRA_ADVERBIO_MODO[1] [g/m]
[ ] DE_VOCES_VOSSAS[1] [g/m]
[ ] DIACRITICS[1] [g/m]
[ ] DIFERENTES[1] [g/m]
[ ] DOSE_DOZE[2] [g/m]
[ ] DOS_HUMANOS_HUMANO[1] [g/m]
[ ] DOS_HUMANOS_HUMANO[2] [g/m]
[ ] DOUBLE_PUNCTUATION[4] [g/m]
[ ] DO_MUNDO_REAL_real_reais[1] [g/m]
[ ] EASILY_CONFUSED_RARE_WORDS[9] [g/m]
[ ] ELES_ELAS[1] [g/m]
[ ] ELES_ELAS[2] [g/m]
[ ] ELES_ELAS[3] [g/m]
[ ] ELES_ELAS[4] [g/m]
[ ] ELLIPSIS[1] [g/m]
[ ] EMPREGAR_TERMO[1] [g/m]
[ ] EM_QUE_O_OS_A_AS_ONDE[1] [g/m]
[ ] ENUMERATIONS_AND_AND[1] [g/m]
[ ] ENUMERATION_COMMAS[1] [g/m]
[ ] ENUMERATION_COMMAS[2] [g/m]
[ ] ERROS_DE_CRASE_MARCOAGPINTO[1] [g/m]
[ ] ERRO_DE_CONCORDNCIA_DO_GÉNERO_MASCULINO_O[1] [g/m]
[ ] ESPERA_QUE_INDICATIVO[1] [g/m]
[ ] ESQUECER_VERB[1] [g/m]
[ ] ESTAR_ADVÉRBIO_A_VERBO_VERBO_ADVÉRBIO[1] [g/m]
[ ] ESTAR_ADVÉRBIO_A_VERBO_VERBO_ADVÉRBIO[6] [g/m]
[ ] ESTAR_CLARO_DE_QUE[5] [g/m]
[ ] ESTAR_DE_ACORDO[1] [g/m]
[ ] ESTA_ESTÁ[1] [g/m]
[ ] ESTA_ESTÁ[3] [g/m]
[ ] ESTA_ESTÁ[4] [g/m]
[ ] ETC_USAGE[1] [g/m]
[ ] ETC_USAGE[2] [g/m]
[ ] ETC_USAGE[3] [g/m]
[ ] EU_NÓS_REMOVAL[1] [g/m]
[ ] EU_NÓS_REMOVAL[2] [g/m]
[ ] E_NO_COMECO[1] [g/m]
[ ] E_QUE_QUE[1] [g/m]
[ ] E_QUE_VERBO_E_VERBO[1] [g/m]
[ ] E_É_SÃO_FOI_FORAM_SENDO_SIDO[1] [g/m]
[ ] FAZER_EFETUAR_REALIZAR_CONDUZIR_CONCRETIZAR_ELABORAR[1] [g/m]
[ ] FAZER_EFETUAR_REALIZAR_CONDUZIR_CONCRETIZAR_ELABORAR[2] [g/m]
[ ] FAZER_USO_DE-USAR-RECORRER[1] [g/m]
[ ] FAZER_USO_DE-USAR-RECORRER[2] [g/m]
[ ] FEEDBACK[1] [g/m]
[ ] FINAL_STOPS[3] [g/m]
[ ] FORMAL_PRA_PARA[1] [g/m]
[ ] FRAGMENT_TWO_PREPOSITIONS[1] [g/m]
[ ] FUTURE_CONJUGATION_ERROR[1] [g/m]
[ ] GENDER_ESTE_ESTA[2] [g/m]
[ ] GENERAL_GENDER_AGREEMENT_ERRORS[1] [g/m]
[ ] GENERAL_GENDER_AGREEMENT_ERRORS[2] [g/m]
[ ] GENERAL_GENDER_AGREEMENT_ERRORS[3] [g/m]
[ ] GENERAL_GENDER_AGREEMENT_ERRORS[4] [g/m]
[ ] GENERAL_GENDER_AGREEMENT_ERRORS[5] [g/m]
[ ] GENERAL_GENDER_AGREEMENT_ERRORS[6] [g/m]
[ ] GENERAL_GENDER_AGREEMENT_ERRORS[7] [g/m]
[ ] GENERAL_GENDER_AGREEMENT_ERRORS[8] [g/m]
[ ] GENERAL_GENDER_AGREEMENT_ERRORS[9] [g/m]
[ ] GENERAL_NUMBER_AGREEMENT_ERRORS[1] [g/m]
[ ] GENERAL_NUMBER_AGREEMENT_ERRORS[2] [g/m]
[ ] GENERAL_NUMBER_AGREEMENT_ERRORS[3] [g/m]
[ ] GENERAL_NUMBER_AGREEMENT_ERRORS[4] [g/m]
[ ] GENERAL_NUMBER_AGREEMENT_ERRORS[5] [g/m]
[ ] GENERAL_NUMBER_AGREEMENT_ERRORS[6] [g/m]
[ ] GENERAL_NUMBER_AGREEMENT_ERRORS[7] [g/m]
[ ] GENERAL_NUMBER_AGREEMENT_ERRORS[8] [g/m]
[ ] GENERAL_NUMBER_AGREEMENT_ERRORS[9] [g/m]
[ ] GENERAL_PRONOMIAL_COLOCATIONS[1] [g/m]
[ ] GENERAL_PRONOMIAL_COLOCATIONS[2] [g/m]
[ ] GENERAL_PRONOMIAL_COLOCATIONS[3] [g/m]
[ ] GENERAL_VERB_AGREEMENT_ERRORS[10] [g/m]
[ ] GENERAL_VERB_AGREEMENT_ERRORS[11] [g/m]
[ ] GENERAL_VERB_AGREEMENT_ERRORS[2] [g/m]
[ ] GENERAL_VERB_AGREEMENT_ERRORS[3] [g/m]
[ ] GENERAL_VERB_AGREEMENT_ERRORS[4] [g/m]
[ ] GENERAL_VERB_AGREEMENT_ERRORS[5] [g/m]
[ ] GENERAL_VERB_AGREEMENT_ERRORS[6] [g/m]
[ ] GENERAL_VERB_AGREEMENT_ERRORS[7] [g/m]
[ ] GENERAL_VERB_AGREEMENT_ERRORS[8] [g/m]
[ ] GENERAL_VERB_AGREEMENT_ERRORS[9] [g/m]
[ ] GENTILICOS_LINGUAS[1] [g/m]
[ ] GOOGLE[1] [g/m]
[ ] HAVIA_PRESENTE_CONJUNTIVO_IMPESSOAL[1] [g/m]
[ ] HIFENIZADOR_VERBOS_2[1] [g/m]
[ ] HIFENIZADOR_VERBOS_2[2] [g/m]
[ ] HIFENIZADOR_VERBOS_2[3] [g/m]
[ ] HIFENIZADOR_VERBOS_2[4] [g/m]
[ ] HIFENIZADOR_VERBOS_2[5] [g/m]
[ ] HIPHEN_SPACE_RULES[1] [g/m]
[ ] HIPHEN_SPACE_RULES[2] [g/m]
[ ] HOMONYM_VIAGEM_2[2] [g/m]
[ ] HOURS_ABREVIATION[3] [g/m]
[ ] HÁ-ATRÁS[1] [g/m]
[ ] HÁ_TEMPO_QUE_VERBO_V2[2] [g/m]
[ ] IMPERSONAL_FAZER_TIME_EXPRESSION[1] [g/m]
[ ] INFORMALITIES[112] [g/m]
[ ] INFORMALITIES[1] [g/m]
[ ] INFORMALITIES[27] [g/m]
[ ] INFORMALITIES[34] [g/m]
[ ] INFORMALITIES[3] [g/m]
[ ] INFORMALITIES[50] [g/m]
[ ] INFORMALITIES[51] [g/m]
[ ] INIMIGO_ADVERSÁRIO_ALIADO_OPONENTE[1] [g/m]
[ ] INTERJECTIONS_PUNTUATION[2] [g/m]
[ ] INTERJECTIONS_PUNTUATION[3] [g/m]
[ ] INTERNET_ABBREVIATIONS[1] [g/m]
[ ] INVARIABLE_NOUNS[10] [g/m]
[ ] INVARIABLE_NOUNS[12] [g/m]
[ ] INVARIABLE_NOUNS[1] [g/m]
[ ] IRREGULAR_PAST_PARTICIPLES[1] [g/m]
[ ] IRREGULAR_PAST_PARTICIPLES[2] [g/m]
[ ] IR_AOS_POUCOS_BOCADOS_BOCADINHOS[1] [g/m]
[ ] IR_CONTRACTION_NOUN[1] [g/m]
[ ] IR_CONTRACTION_NOUN[2] [g/m]
[ ] KLEENEX[1] [g/m]
[ ] LHE_S_ME_TE_VOS_VERB[1] [g/m]
[ ] LINKING_VERB_PREDICATE_AGREEMENT[1] [g/m]
[ ] LINKING_VERB_PREDICATE_AGREEMENT[2] [g/m]
[ ] LP_PARONYMS[52] [g/m]
[ ] MADRUGADA_MATINAL[1] [g/m]
[ ] MAU_MAL_CONFUSION[2] [g/m]
[ ] MUITOS_MUITO[1] [g/m]
[ ] MUITOS_MUITO[2] [g/m]
[ ] MULTIPLICATION_SIGN[1] [g/m]
[ ] MULTIPLICATION_SIGN[3] [g/m]
[ ] NA_NÃO[1] [g/m]
[ ] NON_IMPERSONAL_VERBS[1] [g/m]
[ ] NO_VERB[1] [g/m]
[ ] NUM_NÃO[1] [g/m]
[ ] OBLIQUOUS_PRONOUN_VERB[1] [g/m]
[ ] OBLIQUOUS_PRONOUN_VERB[2] [g/m]
[ ] OBLIQUOUS_PRONOUN_VERB[3] [g/m]
[ ] OPENING_EXCLAMATION[1] [g/m]
[ ] ORDINAL_ABREVIATION[1] [g/m]
[ ] ORDINAL_ABREVIATION[3] [g/m]
[ ] O_FACTO_DA_ACÇÂO[1] [g/m]
[ ] PARA-POR_TER_PARTICIPIO-PASSADO[1] [g/m]
[ ] PARA-POR_TER_PARTICIPIO-PASSADO[2] [g/m]
[ ] PARA-POR_TER_PARTICIPIO-PASSADO[4] [g/m]
[ ] PARENTESESE_AND_QUOTES_SPACING[3] [g/m]
[ ] PARONYM_ABRENUNCIO_1[4] [g/m]
[ ] PARONYM_EXPERIENCIA_126[103] [g/m]
[ ] PARONYM_MAFIA_196[164] [g/m]
[ ] PARONYM_MEDIA_201[169] [g/m]
[ ] PARONYM_MEDICA_484[408] [g/m]
[ ] PARONYM_NOTICIA_224[188] [g/m]
[ ] PARONYM_POLITICA_523[448] [g/m]
[ ] PARONYM_PREVIA_526[451] [g/m]
[ ] PARONYM_PUBLICA_535[460] [g/m]
[ ] PARONYM_SABIA_554[472] [g/m]
[ ] PARONYM_VARIA_340[284] [g/m]
[ ] PARONYM_VIVENCIA_350[291] [g/m]
[ ] PASSAR_A_VERBO[1] [g/m]
[ ] PAST_FUTURE_CONFUSION[3] [g/m]
[ ] PHRASAL_VERB_RESIDIR_EM[9] [g/m]
[ ] PHRASAL_VERB_TER_DE_QUE[8] [g/m]
[ ] PHRASE_REPETITION[1] [g/m]
[ ] PORQUE_É_POR_SER[1] [g/m]
[ ] POR_QUEH_PORQUE[1] [g/m]
[ ] POR_QUE_PORQUE[4] [g/m]
[x] POR_QUE_PORQUE[9] [g/m]
[ ] POSSESSIVE_WITHOUT_ARTICLE[1] [g/m]
[ ] POSSESSIVE_WITHOUT_ARTICLE[2] [g/m]
[ ] POSSESSIVE_WITHOUT_ARTICLE[3] [g/m]
[ ] POSSIVELMENTE_CONJUNTIVO[1] [g/m]
[ ] POST-IT[1] [g/m]
[ ] PP_OBJ_IND[1] [g/m]
[ ] PP_OBJ_IND[2] [g/m]
[ ] PROCLISE_COMECO_FRASE[1] [g/m]
[ ] PROCLISE_COMECO_FRASE[6] [g/m]
[ ] PROFANITY[1] [g/m]
[ ] QUE_ESTAR_CONTRACAO_PREPOSICAO[1] [g/m]
[ ] QUE_FORAM_FOI_SÃO_É_SENDO[1] [g/m]
[ ] QUE_FORAM_FOI_SÃO_É_SENDO[2] [g/m]
[ ] QUE_FORAM_FOI_SÃO_É_SENDO[3] [g/m]
[ ] QUE_FORAM_FOI_SÃO_É_SENDO[4] [g/m]
[ ] QUE_HÁ_QUE_NÃO_HÁ[1] [g/m]
[ ] QUE_SER_ESTAR_PARTPASSADO[1] [g/m]
[ ] QUE_SUBJ_VS_INF_PESS[1] [g/m]
[ ] QUE_SUBJ_VS_INF_PESS[2] [g/m]
[ ] QUE_VERBO[1] [g/m]
[ ] QUE_VERBO[2] [g/m]
[ ] QUE_VERBO[3] [g/m]
[ ] QUE_VERBO[4] [g/m]
[ ] QUE_VERBO_A_VERBOINFINITIVO[1] [g/m]
[ ] QUE_VERB_GERUND[1] [g/m]
[ ] QUE_É-SÃO_NC-ADJ_COMO-POR[1] [g/m]
[ ] REDUNDANCY_JUNTO_COM[5] [g/m]
[ ] REDUNDANCY_SEGUIR_EM_FRENTE[10] [g/m]
[ ] REDUNDANT_CONJUNCTIONS[1] [g/m]
[ ] REFLEXIVE_VERB_SE_AGREEMENT[1] [g/m]
[ ] REFLEXIVE_VERB_SE_AGREEMENT[2] [g/m]
[ ] REPEATED_WORDS[1] [g/m]
[ ] REPEATED_WORDS_3X[1] [g/m]
[ ] ROMAN_NUMBERS_CHECKER[1] [g/m]
[ ] SAO-E_PARA_SER-SEREM_PARTPASSADO[1] [g/m]
[ ] SENTENCE_FRAGMENT[2] [g/m]
[ ] SER_ADJECTIVE_AGREEMENT[1] [g/m]
[ ] SER_ADJECTIVE_AGREEMENT[3] [g/m]
[ ] SER_CAPAZ_DE_CONSEGUIR[1] [g/m]
[ ] SIMPLIFICAR_COMO_SENDO[1] [g/m]
[ ] SIMPLIFICAR_CONVERTER_PARA_VERBO_INFINITIVO[1] [g/m]
[ ] SIMPLIFICAR_CONVERTER_PARA_VERBO_INFINITIVO[2] [g/m]
[ ] SIMPLIFICAR_O_QUE_VERBO_VERBOGERUNDIO[1] [g/m]
[ ] SIMPLIFICAR_POIS_REMOVER[1] [g/m]
[ ] SIMPLIFICAR_QUE_E_TEM_TÊM[1] [g/m]
[ ] SIMPLIFICAR_REMOVER_É_QUE_PARTICÍPIO[1] [g/m]
[ ] SIMPLIFICAR_VERBO_TER_MAIS_PARTICIPIO_PASSADO[1] [g/m]
[ ] SIMPLIFICAR_VERBO_TER_MAIS_PARTICIPIO_PASSADO[2] [g/m]
[ ] SIMPLIFICAR_VERBO_TER_MAIS_PARTICIPIO_PASSADO[3] [g/m]
[ ] SIMPLIFICAR_VERBO_TER_MAIS_PARTICIPIO_PASSADO[4] [g/m]
[ ] SMART_QUOTES[1] [g/m]
[ ] SMART_QUOTES[2] [g/m]
[ ] SPACE_AFTER_PUNCTUATION[2] [g/m]
[ ] SPACE_BEFORE_PUNCTUATION[1] [g/m]
[ ] SUBSTANTIVOS_USADOS_COMO_ADJETIVOS_INVARIAVEIS_V2[1] [g/m]
[ ] T-V_DISTINCTION[10] [g/m]
[ ] T-V_DISTINCTION[11] [g/m]
[ ] T-V_DISTINCTION[1] [g/m]
[ ] T-V_DISTINCTION[2] [g/m]
[ ] T-V_DISTINCTION[3] [g/m]
[ ] T-V_DISTINCTION[4] [g/m]
[ ] T-V_DISTINCTION[6] [g/m]
[ ] T-V_DISTINCTION[7] [g/m]
[ ] T-V_DISTINCTION[8] [g/m]
[ ] T-V_DISTINCTION[9] [g/m]
[ ] TER_PARTICIPIO-PASSADO[1] [g/m]
[ ] TER_PARTICIPIO-PASSADO[2] [g/m]
[ ] TER_PARTICIPIO-PASSADO[3] [g/m]
[ ] TER_PARTICIPIO-PASSADO[4] [g/m]
[ ] TESE_PHD_FICOU_DEMONSTRADO_QUE_DEMONSTRÁMOS_QUE[1] [g/m]
[ ] TESE_PHD_PROCURAR_PROVAR_PROVARA[1] [g/m]
[ ] TESE_PHD_PROCURAR_PROVAR_PROVARA[2] [g/m]
[ ] TE_DE[1] [g/m]
[ ] TIME_FORMAT[2] [g/m]
[ ] TIME_FORMAT[3] [g/m]
[ ] TIRAR_FOTOGRAFIA[2] [g/m]
[ ] TODOS_FOLLOWED_BY_NOUN_PLURAL[1] [g/m]
[ ] TODOS_FOLLOWED_BY_NOUN_SINGULAR[1] [g/m]
[ ] UNA_UNAS_UMA_UMAS_CONFUSÃO[1] [g/m]
[ ] UPPERCASE_AFTER_COMMA[1] [g/m]
[ ] VERBO1_QUE_VERBO2_VERBO3_O_QUE[1] [g/m]
[ ] VERBO_ESTAR_A_VERBO_INF[1] [g/m]
[ ] VERBO_ESTAR_A_VERBO_INF[2] [g/m]
[ ] VERBO_ESTAR_A_VERBO_INF[3] [g/m]
[ ] VERBO_ESTAR_A_VERBO_INF[4] [g/m]
[ ] VERBO_ESTAR_A_VERBO_INF[5] [g/m]
[ ] VERBO_ESTAR_A_VERBO_INF[6] [g/m]
[ ] VERBO_INFINITIVO[1] [g/m]
[ ] VERBO_PARA_PRONOME_PESSOAL[1] [g/m]
[ ] VERBO_PARA_PRONOME_PESSOAL[2] [g/m]
[ ] VERBO_PARA_PRONOME_PESSOAL[3] [g/m]
[ ] VERBO_PARA_PRONOME_PESSOAL[6] [g/m]
[ ] VERB_COMMA_CONJUNCTION[18] [g/m]
[ ] VERB_COMMA_CONJUNCTION[25] [g/m]
[ ] VERB_COMMA_CONJUNCTION[2] [g/m]
[ ] VERB_COMMA_CONJUNCTION[39] [g/m]
[ ] VERB_COMMA_CONJUNCTION[3] [g/m]
[ ] VERB_COMMA_CONJUNCTION[4] [g/m]
[ ] VERB_COMMA_CONJUNCTION[5] [g/m]
[ ] VERB_COMMA_CONJUNCTION[7] [g/m]
[ ] VERB_QUE_É_VERB_SER[1] [g/m]
[ ] VERB_QUE_É_VERB_SER[2] [g/m]
[ ] VERB_QUE_É_VERB_SER[3] [g/m]
[ ] VER_OBSERVAR_CONSTATAR[1] [g/m]
[ ] VIR_A_VERBO_VERBO[1] [g/m]
[ ] VISTO_DADO_QUE[2] [g/m]
[ ] VISTO_POR[1] [g/m]
[ ] WORDINESS[10] [g/m]
[ ] WORDINESS[11] [g/m]
[ ] WORDINESS[16] [g/m]
[ ] WORDINESS[25] [g/m]
[ ] WORDINESS[26] [g/m]
[ ] WORDINESS[28] [g/m]
[ ] WORDINESS[7] [g/m]
[ ] WORDINESS[9] [g/m]
[ ] ZERO_MEDIDA_SINGULAR[1] [g/m]
[ ] À_VERBO_DE[1] [g/m]
[ ] É_PLURAL[1] [g/m]
[ ] É_QUE_AS-OS_NC_É-SÃO[1] [g/m]
[ ] COMMA_PARENTHESIS_WHITESPACE [g/m]
[ ] HUNSPELL_RULE [g/m]
[ ] PORTUGUESE_WORD_REPEAT_BEGINNING_RULE [g/m]
[ ] PORTUGUESE_WORD_REPEAT_RULE [g/m]
[ ] PT_AGREEMENT_REPLACE [g/m]
[ ] PT_ARCHAISMS_REPLACE [g/m]
[ ] PT_BARBARISMS_REPLACE [g/m]
[ ] PT_COMPOUNDS_POST_REFORM [g/m]
[ ] PT_PT_SIMPLE_REPLACE [g/m]
[ ] PT_REDUNDANCY_REPLACE [g/m]
[ ] PT_SIMPLE_REPLACE [g/m]
[ ] PT_WIKIPEDIA_COMMON_ERRORS [g/m]
[ ] PT_WORDINESS_REPLACE [g/m]
[ ] PT_WORD_COHERENCY [g/m]
[ ] SENTENCE_WHITESPACE [g/m]
[ ] TOO_LONG_SENTENCE [g/m]
[ ] UPPERCASE_SENTENCE_START [g/m]

marcoagpinto commented 2 years ago

@jaumeortola

Hello!

Sorry, I have been somewhat confused.

A "new tagger dictionary" means that we won't have added.txt any more?

jaumeortola commented 2 years ago

All words in added.txt can be moved to the tagger dictionary. But when necessary, we will be able to add words to added.txt. For each new version of the tagger dictionary, added.txtcan be emptied.

marcoagpinto commented 2 years ago

@jaumeortola @ Ricardo Joseh Lima

Here is the current status of the PT rules Rules Structure 20220428.odt .

jaumeortola commented 2 years ago

@marcoagpinto This is important. I am about to upgrade to the new tagger dictionary. My plan is to do the merge now, and be ready tomorrow morning to solve any major issue that can show up in the nightly diffs, e.g. disabling temporarily some rules if they have too many false positives.

You can see here the kind of diffs we'll find tomorrow. Please, unzip and take a look. There are some 'random' unexpected diffs, but I think it will be manageable. diff-results-2022-05-12T09 17.zip

Is that okay for you?

As I have said in other comments, with the new tagger dictionary, there will be many more tagged words, and many more words that need disambiguation. We'll need to write more disambiguation rules, and better pattern rules. One suggestion for writing rules. <token negate_pos="yes" postag="..."> gives unexpected results. It's better to use <token><exception postag="..."/></token>.

marcoagpinto commented 2 years ago

@jaumeortola

It is okay for me; however, I haven't yet finished the new POSs names list:

This is what I have in a text document:

SUGGEST THE FIXES BELOW AFTER THE RELEASE OF 5.7.
FIX THE NAS/NOS, ETC.:
keep old POSes for legacy/compatibility.
2022-02-25+:

destes + destas

esta

estas

este

estes

das

dos

mas

pela

pelas

pelo

pelos

à > a+a > SPS00+* > SPS00:DA0FS0
à > a+as > SPS00+* > SPS00:DA0FP0

ao > a+o > SPS00+* > SPS00:DA0MS0
aos > a+os > SPS00+* > SPS00:DA0MP0

dela > de+ela > SPS00+PP3FS00 > SPS00:PP3FS00
delas > de+elas > SPS00+PP3FP00 > SPS00:PP3FP00

dele > de+ele > SPS00+PP3MS00 > SPS00:PP3MS00
deles > de+eles > SPS00+PP3MP00 > SPS00:PP3MP00

dessa > de+essas > SPS00+* > SPS00:DD0FS0:PD0FS000
* shouldn't it be: de+essa?
dessas > de+estas > SPS00+* > SPS00:DD0FP0:PD0FP000
* shouldn't it be: de+essas?

disso > de+isso > SPS00+PD0NN00 > SPS00:PD0NN00

na > em+a > SPS00+DA > SPS00:DA0FS0
nas > em+as > SPS00+DA > SPS00:DA0FP0

no > em+o > SPS00+DA > SPS00:DA0MS0
nos > em+os > SPS00+DA > SPS00:DA0MP0

nela > em+ela > SPS00+PP3FS00 > SPS00:PP3FS00
nelas > em+elas > SPS00+PP3FP00 > SPS00:PP3FP00

nele > em+ele > SPS00+PP3MS00 > SPS00:PP3MS00
neles > em+eles > SPS00+PP3MP00 > SPS00:PP3MP00

Also, I need to use negate_pos because some rules work better this way (are easier to create). If I use “exception” I will have to add there all possibilities, while negating we just negate one or more postags.

Thanks!

jaumeortola commented 2 years ago

Most of the new tags for contractions are here (https://github.com/languagetool-org/portuguese-pos-dict/blob/main/src-dict/resta-lt.txt), and the XML rules have been updated accordingly. If we find something missing, it can be put in added.txt (and later on moved to the tagger dictionary).

marcoagpinto commented 2 years ago

Excellent work!

Thank you, @jaumeortola

PS→ Why can't I tag Ricardo Joseh Lima?

@ Ricardo Joseh Lima

jaumeortola commented 2 years ago

Okay. I will do the merge now. I suggest not doing major changes today in the rules, until we see tomorrow's differences (and fix eventual problems).

Why can't I tag Ricardo Joseh Lima?

I don't know. He has not been mentioned before. You need to write his full username.

ricardojosehlima commented 2 years ago

Hi @jaumeortola and @marcoagpinto the first tagging of my name 14 days ago also didn't work I don't know why and only now I am seeing this thread, came here because Marco tagged me in another thread and linked to here.

It's really a huge and great work being done, and I can be looking with some time and attention to some issues.

One that draws my attention is the paronym rule that I was discussing with Marco in another thread. The cases that end with 'a' are problematic, the results for 'previa' and 'varia' are false positives - the suggestions shouldn't be made. In that thread I suggested that verbs ending with 'a' shouldn't be part of this rule or should have some more severe restrictions for the rule to apply.

Also, there seem to be two files concerning barbarisms: result_java_PT_BARBARISMS_REPLACE seems to apply only to pt-pt but result_grammar_BARBARISMS[1] seems to apply to all variants of Portuguese and if this is the case for this file then it needs revision for the Brazilian variant, I can make it soon.

jaumeortola commented 2 years ago

Also, I need to use negate_pos because some rules work better this way (are easier to create). If I use “exception” I will have to add there all possibilities, while negating we just negate one or more postags.

@marcoagpinto You don't need to add "all possibilities". Usually, you can write the same postag with negate_pos or inside exception. But using negate_pos the logic can be tricky and difficult to grasp. With exception, the logic is much easier, that's why I recommend to use exception.

jaumeortola commented 2 years ago

@marcoagpinto Have you looked into the zip file I posted here? These are (roughly) the differences we'll find in the nightly diffs tomorrow. We can start to address any problems we detect. If you tell me where the false positives are, I can help to fix them. For example, I am fixing now "quantas pessoas" in GENERAL_GENDER_AGREEMENT_ERRORS[3].

marcoagpinto commented 2 years ago

@jaumeortola

I unzipped the file and opened a couple of HTMLs to see how they look like.

At 5am, I will start working on the real thing. 🙂

marcoagpinto commented 2 years ago

I need to download the nightly tonight to have all the new postags (.oxt + stand-alone + wikipedia).

marcoagpinto commented 2 years ago

@jaumeortola

I have sent an e-mail to the Health Centre asking for a medical leave, so I am at home this weekend, and maybe the next.

Could you explain what I should do?

Looking at the 2022-05-13 results, I spotted: https://internal1.languagetool.org/regression-tests/via-http/2022-05-13/pt-PT/result_grammar_INFORMALITIES[3].html

It removed thousands of hits with diminutives.

I now agree that it is a good choice to remove them.

Thanks!

marcoagpinto commented 2 years ago

@jaumeortola

I have downloaded the nightly stand-alone tool.

TESTRULES PT throws tons of errors:

C:\Users\marco\Desktop\LanguageTool-20220514-snapshot\LanguageTool-5.8-SNAPSHOT>testrules pt
Running XML pattern tests...
LanguageTool version 5.8-SNAPSHOT (2022-05-14 16:45:35 +0000, 485e17b)
Known languages: [Arabic, English, English (US), English (GB), English (Australian), English (Canadian), English (New Zealand), English (South African), Persian, French, German, German (Germany), German (Austria), German (Swiss), Simple German, Polish, Catalan, Catalan (Valencian), Italian, Breton, Dutch, Dutch (Belgium), Portuguese, Portuguese (Portugal), Portuguese (Brazil), Portuguese (Angola preAO), Portuguese (Moçambique preAO), Russian, Asturian, Belarusian, Chinese, Danish, Esperanto, Irish, Galician, Greek, Japanese, Khmer, Romanian, Slovak, Slovenian, Spanish, Spanish (voseo), Swedish, Tamil, Tagalog, Ukrainian, Testlanguage]
Running XML validation for pt/grammar.xml...
Running pattern rule tests for Portuguese (org.languagetool.language.Portuguese)...
Exception in thread "main" java.lang.RuntimeException: Could not activate rules
        at org.languagetool.JLanguageTool.<init>(JLanguageTool.java:340)
        at org.languagetool.JLanguageTool.<init>(JLanguageTool.java:299)
        at org.languagetool.MultiThreadedJLanguageTool.<init>(MultiThreadedJLanguageTool.java:94)
        at org.languagetool.MultiThreadedJLanguageTool.<init>(MultiThreadedJLanguageTool.java:84)
        at org.languagetool.MultiThreadedJLanguageTool.<init>(MultiThreadedJLanguageTool.java:67)
        at org.languagetool.MultiThreadedJLanguageTool.<init>(MultiThreadedJLanguageTool.java:51)
        at org.languagetool.rules.patterns.PatternRuleTest.createToolForTesting(PatternRuleTest.java:178)
        at org.languagetool.rules.patterns.PatternRuleTest.runTestForLanguage(PatternRuleTest.java:162)
        at org.languagetool.rules.patterns.PatternRuleTest.runGrammarRulesFromXmlTestIgnoringLanguages(PatternRuleTest.java:155)
        at org.languagetool.rules.patterns.PatternRuleTest.main(PatternRuleTest.java:766)
Caused by: java.io.IOException: Cannot load or parse input stream of '/org/languagetool/rules/pt/grammar.xml'
        at org.languagetool.rules.patterns.PatternRuleLoader.getRules(PatternRuleLoader.java:80)
        at org.languagetool.Language.getPatternRules(Language.java:646)
        at org.languagetool.JLanguageTool.activateDefaultPatternRules(JLanguageTool.java:668)
        at org.languagetool.JLanguageTool.<init>(JLanguageTool.java:333)
        ... 9 more
Caused by: java.lang.RuntimeException: Could not create filter class using constructor public org.languagetool.rules.pt.AdvancedSynthesizerFilter()
        at org.languagetool.rules.patterns.RuleFilterCreator.getFilter(RuleFilterCreator.java:54)
        at org.languagetool.rules.patterns.XMLRuleHandler.setRuleFilter(XMLRuleHandler.java:668)
        at org.languagetool.rules.patterns.PatternRuleHandler.createRules(PatternRuleHandler.java:674)
        at org.languagetool.rules.patterns.PatternRuleHandler.createRules(PatternRuleHandler.java:701)
        at org.languagetool.rules.patterns.PatternRuleHandler.createRules(PatternRuleHandler.java:701)
        at org.languagetool.rules.patterns.PatternRuleHandler.createRules(PatternRuleHandler.java:701)
        at org.languagetool.rules.patterns.PatternRuleHandler.endElement(PatternRuleHandler.java:424)
        at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.endNamespaceScope(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.handleEndElement(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.endElement(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(Unknown Source)
        at javax.xml.parsers.SAXParser.parse(Unknown Source)
        at org.languagetool.rules.patterns.PatternRuleLoader.getRules(PatternRuleLoader.java:77)
        ... 12 more
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
        at java.lang.reflect.Constructor.newInstance(Unknown Source)
        at org.languagetool.rules.patterns.RuleFilterCreator.getFilter(RuleFilterCreator.java:47)
        ... 34 more
Caused by: com.google.common.util.concurrent.UncheckedExecutionException: java.nio.file.NoSuchFileException: \pt\portuguese_synth.dict
        at com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4943)
        at org.languagetool.rules.spelling.morfologik.MorfologikSpeller.getDictionaryWithCaching(MorfologikSpeller.java:95)
        at org.languagetool.synthesis.BaseSynthesizer.getDictionary(BaseSynthesizer.java:115)
        at org.languagetool.synthesis.BaseSynthesizer.createStemmer(BaseSynthesizer.java:129)
        at org.languagetool.synthesis.BaseSynthesizer.<init>(BaseSynthesizer.java:66)
        at org.languagetool.synthesis.BaseSynthesizer.<init>(BaseSynthesizer.java:101)
        at org.languagetool.synthesis.pt.PortugueseSynthesizer.<init>(PortugueseSynthesizer.java:34)
        at org.languagetool.rules.pt.AdvancedSynthesizerFilter.<init>(AdvancedSynthesizerFilter.java:36)
        ... 39 more
Caused by: java.nio.file.NoSuchFileException: \pt\portuguese_synth.dict
        at sun.nio.fs.WindowsException.translateToIOException(Unknown Source)
        at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source)
        at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source)
        at sun.nio.fs.WindowsFileSystemProvider.newByteChannel(Unknown Source)
        at java.nio.file.Files.newByteChannel(Unknown Source)
        at java.nio.file.Files.newByteChannel(Unknown Source)
        at java.nio.file.spi.FileSystemProvider.newInputStream(Unknown Source)
        at java.nio.file.Files.newInputStream(Unknown Source)
        at morfologik.stemming.Dictionary.read(Dictionary.java:63)
        at org.languagetool.rules.spelling.morfologik.MorfologikSpeller$1.load(MorfologikSpeller.java:55)
        at org.languagetool.rules.spelling.morfologik.MorfologikSpeller$1.load(MorfologikSpeller.java:48)
        at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3529)
        at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2278)
        at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2155)
        at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2045)
        at com.google.common.cache.LocalCache.get(LocalCache.java:3951)
        at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
        at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4935)
        at com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4941)
        ... 46 more
Running disambiguator rule tests...
Running disambiguation tests for Portuguese...
Exception in thread "main" java.lang.RuntimeException: Could not activate rules
        at org.languagetool.JLanguageTool.<init>(JLanguageTool.java:340)
        at org.languagetool.JLanguageTool.<init>(JLanguageTool.java:299)
        at org.languagetool.JLanguageTool.<init>(JLanguageTool.java:359)
        at org.languagetool.JLanguageTool.<init>(JLanguageTool.java:265)
        at org.languagetool.tagging.disambiguation.rules.DisambiguationRuleTest.testDisambiguationRulesFromXML(DisambiguationRuleTest.java:70)
        at org.languagetool.tagging.disambiguation.rules.DisambiguationRuleTest.main(DisambiguationRuleTest.java:238)
Caused by: java.io.IOException: Cannot load or parse input stream of '/org/languagetool/rules/pt/grammar.xml'
        at org.languagetool.rules.patterns.PatternRuleLoader.getRules(PatternRuleLoader.java:80)
        at org.languagetool.Language.getPatternRules(Language.java:646)
        at org.languagetool.JLanguageTool.activateDefaultPatternRules(JLanguageTool.java:668)
        at org.languagetool.JLanguageTool.<init>(JLanguageTool.java:333)
        ... 5 more
Caused by: java.lang.RuntimeException: Could not create filter class using constructor public org.languagetool.rules.pt.AdvancedSynthesizerFilter()
        at org.languagetool.rules.patterns.RuleFilterCreator.getFilter(RuleFilterCreator.java:54)
        at org.languagetool.rules.patterns.XMLRuleHandler.setRuleFilter(XMLRuleHandler.java:668)
        at org.languagetool.rules.patterns.PatternRuleHandler.createRules(PatternRuleHandler.java:674)
        at org.languagetool.rules.patterns.PatternRuleHandler.createRules(PatternRuleHandler.java:701)
        at org.languagetool.rules.patterns.PatternRuleHandler.createRules(PatternRuleHandler.java:701)
        at org.languagetool.rules.patterns.PatternRuleHandler.createRules(PatternRuleHandler.java:701)
        at org.languagetool.rules.patterns.PatternRuleHandler.endElement(PatternRuleHandler.java:424)
        at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.endNamespaceScope(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.handleEndElement(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.endElement(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(Unknown Source)
        at javax.xml.parsers.SAXParser.parse(Unknown Source)
        at org.languagetool.rules.patterns.PatternRuleLoader.getRules(PatternRuleLoader.java:77)
        ... 8 more
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
        at java.lang.reflect.Constructor.newInstance(Unknown Source)
        at org.languagetool.rules.patterns.RuleFilterCreator.getFilter(RuleFilterCreator.java:47)
        ... 30 more
Caused by: com.google.common.util.concurrent.UncheckedExecutionException: java.nio.file.NoSuchFileException: \pt\portuguese_synth.dict
        at com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4943)
        at org.languagetool.rules.spelling.morfologik.MorfologikSpeller.getDictionaryWithCaching(MorfologikSpeller.java:95)
        at org.languagetool.synthesis.BaseSynthesizer.getDictionary(BaseSynthesizer.java:115)
        at org.languagetool.synthesis.BaseSynthesizer.createStemmer(BaseSynthesizer.java:129)
        at org.languagetool.synthesis.BaseSynthesizer.<init>(BaseSynthesizer.java:66)
        at org.languagetool.synthesis.BaseSynthesizer.<init>(BaseSynthesizer.java:101)
        at org.languagetool.synthesis.pt.PortugueseSynthesizer.<init>(PortugueseSynthesizer.java:34)
        at org.languagetool.rules.pt.AdvancedSynthesizerFilter.<init>(AdvancedSynthesizerFilter.java:36)
        ... 35 more
Caused by: java.nio.file.NoSuchFileException: \pt\portuguese_synth.dict
        at sun.nio.fs.WindowsException.translateToIOException(Unknown Source)
        at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source)
        at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source)
        at sun.nio.fs.WindowsFileSystemProvider.newByteChannel(Unknown Source)
        at java.nio.file.Files.newByteChannel(Unknown Source)
        at java.nio.file.Files.newByteChannel(Unknown Source)
        at java.nio.file.spi.FileSystemProvider.newInputStream(Unknown Source)
        at java.nio.file.Files.newInputStream(Unknown Source)
        at morfologik.stemming.Dictionary.read(Dictionary.java:63)
        at org.languagetool.rules.spelling.morfologik.MorfologikSpeller$1.load(MorfologikSpeller.java:55)
        at org.languagetool.rules.spelling.morfologik.MorfologikSpeller$1.load(MorfologikSpeller.java:48)
        at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3529)
        at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2278)
        at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2155)
        at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2045)
        at com.google.common.cache.LocalCache.get(LocalCache.java:3951)
        at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
        at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4935)
        at com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4941)
        ... 42 more
Running XML bitext pattern tests...
Bitext pattern tests successful.
Validating false-friends.xml...
Validation successfully finished.

jaumeortola commented 2 years ago

@marcoagpinto There is a missing element in the CPATH. Edit the file testrules.bat and add ;libs/portuguese-pos-dict.jar to SET CPATH. It will be fixed in the next snapshot.

marcoagpinto commented 2 years ago

@jaumeortola

I have downloaded the nightly.

A TESTRULES PT now gives a warning:

Testing rule 2700...
Testing rule 2800...
Skipped 0 rules for variant language to avoid checking rules more than once
2824 rules tested.
Tests finished!
Running disambiguator rule tests...
Running disambiguation tests for Portuguese...
*** WARNING: The Portuguese rule: JUNTO_A[1], token [2], contains "a|com" that is not marked as regular expression but probably is one.
100...
200...
300...
317 rules tested (241ms)

But I can't find any JUNTO_A rule in the grammar.xml.

jaumeortola commented 2 years ago

@marcoagpinto JUNTO_A is a disambiguation rule. It is fixed in a branch I am going to merge today.

marcoagpinto commented 2 years ago

@jaumeortola

I was improving an antipattern and found a typo in a tag: Se nos dias após a cirurgia ainda sentir interferências nos sono, converse com o seu médico sobre outras soluções possíveis.

interferências nos sono, "nos" is tagged as: SPS00::DA0MP0

It has "::" instead of ":".

jaumeortola commented 2 years ago

Fixed. You can write down these changes in added.txt/removed.txt. https://github.com/languagetool-org/languagetool/commit/577ac2c382e166e6005a51deca610fd44218672f

marcoagpinto commented 2 years ago

Write down? How? I don't understand.

jaumeortola commented 2 years ago

Add all the changes you want to the files added.txt/removed.txt. From time to time, I will move them to portuguese-pos-dict.

marcoagpinto commented 2 years ago

ahhh.. I now understand after seeing your commit.

p-goulart commented 6 months ago

No longer relevant (new tagger has been live for 1+ year).

languagetool-org / portuguese-pos-dict

Testing the new tagger dictionary #5