arekusandr / last_layer

Ultra-fast, low latency LLM prompt injection/jailbreak detection ⛓️
MIT License
94 stars 3 forks source link

Security #1

Open niallcm opened 3 months ago

niallcm commented 3 months ago

Do you have any plans to publish the source of the .so files so that the safety of the package can be assessed? As it stands, with only the binaries included in the source, I don't see how anyone could trust that this package won't steal credentials.

arekusandr commented 3 months ago

Hi @niallcm thx for asking this question! The library runs completely offline and has a self-contained ML mode there are no network calls made. You can deny all outgoing app traffic using a firewall in the cloud just in case you have concerns.

We can share the source code only with enterprise users, that might change in the future