Question about HuggingFace deployment

[yoursbest]

Describe the bug

• I duplicated Langflow/Langflow (1.0.5) to my own private HuggingFace space.
• I used the Models-OpenAI component and adjusted both openai_api_base and openai_api_key to my own OpenAI-compatible API.
• The flow doesn't work due to AuthenticationError (My OpenAI-compatible API responded but said the token was invalid.)
• I pull the 1.0.5 docker image and ran it locally. I did the same setup with the same api_base and api_key. The flow works.

My question: To deploy Langflow on HuggingFace, is there any special configurations needed to make it fully work?

Thank you! Great Project!

Browser and Version

• Edge
• Version 126.0.2592.68 (Official build) (arm64)

[dosubot[bot]]

To deploy Langflow on HuggingFace and ensure it works correctly with your OpenAI-compatible API, you need to make sure that the necessary environment variables are correctly set. Specifically, you should ensure that the following environment variables are configured:

• OPENAI_API_KEY
• AZURE_OPENAI_API_KEY
• AZURE_OPENAI_API_VERSION
• AZURE_OPENAI_API_INSTANCE_NAME
• AZURE_OPENAI_API_DEPLOYMENT_NAME
• AZURE_OPENAI_API_EMBEDDINGS_DEPLOYMENT_NAME

Additionally, other relevant environment variables might be necessary depending on your setup, such as:

• ANTHROPIC_API_KEY
• GOOGLE_API_KEY
• ASTRA_DB_APPLICATION_TOKEN
• ASTRA_DB_API_ENDPOINT
• COHERE_API_KEY
• GROQ_API_KEY
• HUGGINGFACEHUB_API_TOKEN
• PINECONE_API_KEY
• SEARCHAPI_API_KEY
• SERPAPI_API_KEY
• UPSTASH_VECTOR_REST_URL
• UPSTASH_VECTOR_REST_TOKEN
• VECTARA_CUSTOMER_ID
• VECTARA_CORPUS_ID
• VECTARA_API_KEY

These variables need to be set in the environment for proper authentication and functionality ^[1][2][3].

Additionally, ensure that the LANGFLOW_STORE_ENVIRONMENT_VARIABLES is set to true (default) to add all variables listed in LANGFLOW_VARIABLES_TO_GET_FROM_ENVIRONMENT to your user's Global Variables ^[4].

For debugging the AuthenticationError, you can enable detailed logging by setting the log_level to DEBUG in the logging configuration. This will capture detailed logs that may include information about the AuthenticationError ^[5].

By ensuring these configurations, you should be able to resolve the authentication issues when deploying Langflow on HuggingFace.

To continue talking to Dosu, mention @dosu.

[nicoloboschi]

Nothing special. Maybe pasting the flow and the entire error here could help debugging more.

You might want to try DataStax hosting which provides a free hosted playground for LangFlow https://langflow.datastax.com/