Set custom headers for adapters

[jlev]

I'd starting to production-ize my LLM with NLUX and Langserve. Is there a way to set authorization headers for the adapter? I am using streaming mode, and I'd like to require an auth0 token with each request.

https://github.com/nluxai/nlux/blob/latest/packages/js/langchain/src/langserve/adapter/stream.ts#L22

Should I make a custom adapter, or is this something that could be passed into the ChatAdapterExtras, like it is for NLBridge?

[salmenus]

( I just removed my last comment — after looking at the suggested code change )

[salmenus]

Thanks for suggesting this @jlev — It's an important one, indeed.

Do you want to implement it @jlev ?

In order to enable developers to provide headers to LangServe, here is a suggested way:

API / Usage

The usage should be as per following:

const [customHeaders, setCustomHeaders] = useState<LangServeHeaders>({ key: 'value' });

const adapter = useChatAdapter({
    url: 'https://<Your LangServe Runnable URL>',
    headers: customHeaders
});

1. New type LangServeHeaders should be added
2. New attribute headers should be added to LS adapter options
3. The React hook useChatAdapter should be updated to support the new attribute

Suggested Implementation

Here are few hints to assist in implementing the change

1. We start by making the change in the JS version packages/js/langchain of the adapter:

• New LangServeHeaders type here
• New headers option to add to ChatAdapterOptions
• Update the adapter builder (used in JS and by React hook) to enable providing the new option

2. We add support for headers option in React Hooks:

• Update the useChatAdapter hook to enable supplying the headers option when it's provided

3. We pass the headers to LangChain when available

• Add a getter for headers in the LangServeAbstractAdapter — similar to get endpointUrl()
• Update fetch and stream LangServe adapters to access headers (via this.headers) and add them to the fetch request.

Give it a try and let me know @jlev — I'll keep an eye on Discord to answer any question and assist. I'm assigning this issue to you, since I feel like you'll handle it 😎

[salmenus]

PR updated. New NPM published with code change. Available starting from version 1.0.4 ( @nlux/react & adapters )

Thank you @jlev for contributing 🙏