Azure / azure-sdk-for-python

This repository is for active development of the Azure SDK for Python. For consumers of the SDK we recommend visiting our public developer docs at https://learn.microsoft.com/python/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-python.
MIT License
4.53k stars 2.76k forks source link

PII identification for pt-pt language stopped recognizing AGE category #32277

Open snovaisg opened 11 months ago

snovaisg commented 11 months ago

it was working a month or two ago. Now, no matter what examples i try, it never recognizes the AGE. For english it still works fine though

xiangyan99 commented 11 months ago

Thanks for reaching out.

Could you share more information of which library did you use and the version of the library?

Thank you.

github-actions[bot] commented 11 months ago

Hi @snovaisg. Thank you for opening this issue and giving us the opportunity to assist. To help our team better understand your issue and the details of your scenario please provide a response to the question asked above or the information requested above. This will help us more accurately address your issue.

snovaisg commented 11 months ago

@xiangyan99 I'm using azure-ai-textanalytics version 5.2.1 in python.

Though i have tried other options, such as through the rest api and even using different model versions and api versions and nothing. Basically it stopped detecting the category AGE in portuguese language, while it was working just fine a few months ago.

github-actions[bot] commented 11 months ago

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @mikaelsitruk.

kristapratico commented 11 months ago

@snovaisg can you share an example text which reproduces the issue?

@quentinRobinson - can you investigate why PII extraction might have changed?

snovaisg commented 11 months ago

“O João tem 25 anos”

This a very simple example where 25 used to be recognized as AGE but not anymore.

snovaisg commented 11 months ago

@kristapratico any updates?

quentinRobinson commented 11 months ago

We are still investigating this issue

snovaisg commented 10 months ago

@quentinRobinson have you found anything about this matter? Unfortunately it still can't recognize the Quantity-Age category