Proxy Error - Githubissues

IBM / ibm-generative-ai

IBM-Generative-AI is a Python library built on IBM's large language model REST interface to seamlessly integrate and extend this service in Python programs.

https://ibm.github.io/ibm-generative-ai/

Apache License 2.0

245 stars 101 forks source link

Proxy Error #341

Closed csbobby closed 3 months ago

csbobby commented 5 months ago

Version Information

Package Version: 2.2.0
Operating System: Linux

What is the expected behavior?

Run a program to call APIs under the global http proxy setting

What is the actual behavior?

Tomas2D commented 5 months ago

The default SDK's endpoint is https://bam-api.res.ibm.com, which does not require any special network configuration.

csbobby commented 5 months ago

Thank you for the response. Our cluster supports the SDK endpoint, but cluster nodes need to use a proxy, this works for most of pkgs. And this pkg doesn't seem to provide a method for us to do so. @Tomas2D

Tomas2D commented 3 months ago

You can do it by setting GENAI_API variable or by passing the value to the Client class directly.