-
There are already a number of guidance documents, governance frameworks, security checklists and more. Within AI Readiness we'd like to conduct a thorough literature review, cataloguing and summarisin…
-
https://safe.ai/about
-
List of tasks: (see this item description below)
- [x] #131
- [x] Add protected material check
- [x] Add prompt attack check [Prompt shield](https://learn.microsoft.com/en-us/azure/ai-services/c…
-
The idea is to do to AI safety what https://github.com/vipulnaik/donations/blob/master/cause-area-guidance/animal-welfare.md (still a WIP) does for animal welfare.
To see where this cause area is …
-
Based on what we discussed on the discord call, I will be looking more into dataset improvements. The scraper already works well, as mentioned from TODOs just needs to be expanded. Also some related t…
-
### Problem Description
Gemini API supports safety settings, but the app lacks safety settings controls. Integration would be valuable.
### Solution Description
https://ai.google.dev/gemini-api/doc…
-
```meta
Time: 2024-09-09 6:00PM Eastern
UTCTime: 2024-09-09 22:00 UTC
Duration: 2h
Location: ATL BitLab, 684 John Wesley Dobbs Ave NE, Unit A1, Atlanta, GA 30312
```
![aitl-ai-builders-septemb…
-
I tried this on Safety gym with just changing env_name, using info['cost'] for constraint calculations, and computing cost returns as undiscounted sum of costs instead of discounted sum of cost -
`r…
-
DeepEval docs have a Google Vertex AI implementation sample here:
https://docs.confident-ai.com/docs/metrics-introduction#google-vertexai-example
However, it has a number of issues:
1. It doesn…
-
I would like to compare the same evaluation using an Open AI model and a custom assistant.
https://platform.openai.com/docs/api-reference/assistants