1jamesthompson1 / TAIC-report-summary

Using LLM technologies to analyze transport accident investigation reports
https://taic-document-searcher-cfdkgxgnc3bxgbeg.australiaeast-01.azurewebsites.net/
GNU General Public License v3.0
0 stars 0 forks source link

Move openai calls to be within an azure openai #246

Open 1jamesthompson1 opened 3 weeks ago

1jamesthompson1 commented 3 weeks ago

State

The engine is reliant on using many outside companies with various api calls

Problem

This makes the app vunerable to change

Solution

Use the azure openai service to remove the dependcy on openai. This could also mean that anthopric is not needed as it could use gpt-4o instead of claude. However voyageai would have to stay as the embedding is not available from open ai.

1jamesthompson1 commented 2 weeks ago

Guide for how to do it here: https://learn.microsoft.com/en-us/azure/ai-services/openai/quickstart?tabs=command-line%2Cpython-new&pivots=programming-language-python

I am waiting on TAIC azure permissions to create the resource. Then I just have to create an abstraction layer to use azureai rather than openai.