daxa-ai / pebblo

Pebblo enables developers to safely load data and promote their Gen AI app to deployment
https://daxa.ai/pebblo
MIT License
116 stars 26 forks source link

added changes for github and slack token #512

Closed gr8nishan closed 2 weeks ago

gr8nishan commented 2 weeks ago

Added a new pii for Github Fine Grained Token """\b((?:githubpat)[a-zA-Z0-9_]{36,255})\b"""

Adding github_pat as mentioned here and based on test data we created.

Slack Changed from - """(xoxb|xoxp|xapp|xoxa|xoxr)-[0-9]{10,13}-[a-zA-Z0-9-]""" To - """(xoxb|xoxp|xapp|xoxa|xoxr|xoxo|xoxs|xoxe)-[0-9]{10,13}-[a-zA-Z0-9-]"""

Adding as mentioned here

Google API Changed from - """(?i)(?:youtube)(?:.|[\n\r]){0,40}\bAIza[0-9A-Za-z-]{35}\b""" To - """\bAIza[0-9A-Za-z-]{35}\b Changing as mentioned here

Reducing confidence score from 0.8 to 0.4 for Github token Github Finegrained Token Google API Key

This is done to support format like

"Git":"value" "Pat":"value" Git:value Key:value key-value

Check images With Confidence = 0.8

Screenshot 2024-08-30 at 5 53 53 PM

With Confidence = 0.4

Screenshot 2024-08-30 at 5 47 37 PM