[EAGLE-3330][EAGLE-3321] Add public llms for testing

[stmugisha]

• add llma2, claudev2, falcon and instructorxl to python grpc client tests

NB: I nolonger have push/write access to this repo hence creating a PR from a fork

[HarmitMinhas96]

Are these models deployed in all three envs?

[stmugisha]

No they aren't. The accounts and models are in prod

[HarmitMinhas96]

No they aren't. The accounts and models are in prod

These tests run in all three envs. One goal is to make sure problems are caught before getting to prod.

[stmugisha]

They previously just copied over all the content into all the envs via resource syncing: but if we're to test just one of the models then creating the models and accounts in all envs can be done manually.

[HarmitMinhas96]

We should probably reduce it to one hosted LLM and a single API wrapped LLM

[stmugisha]

I guess you'll have to merge it as I don't have permission to do so

[HarmitMinhas96]

Any idea why the tests aren't running as expected here?

[stmugisha]

I guess it could be because of credentials. I remember Arman and Marco doing something with the actions to run the tests.

[stmugisha]

Closing as this was copied into another PR and merged.