search

aiverify-foundation / moonshot

Moonshot - A simple and modular tool to evaluate and red-team any LLM application.
https://aiverify-foundation.github.io/moonshot/
Apache License 2.0
144 stars 27 forks source link

[Question] Moonshot compatibility with forward proxy server #301

Open SidPad03 opened 1 month ago

SidPad03 commented 1 month ago

Hi all,

Our company is working on a project that requires capturing and analyzing traffic data exchanged between our client application, in this case, Moonshot, and our host server via a forward proxy server configured to monitor and manage the traffic. The forward proxy server will act as a firewall, so all client-host traffic must be mediated by this forward proxy server.

Could someone advise me on the necessary modifications/setup required for Moonshot to ensure it is compatible with this arrangement?

saddepalli commented 1 month ago

Yes, this would be a great feature as many organizations have explicit proxies enabled.

In case of browsers, proxy settings can be made via PAC file. In case of curl as a client, one can use command like this: curl -x "http://user:pwd@:" "chatgpt.com"

To test public LLMs using Moonshot project via proxies would be a great addition.