search

AbanteAI / rawdog

Generate and auto-execute Python scripts in the cli
Apache License 2.0
1.75k stars 134 forks source link

Add leash mode #68

Closed jakethekoenig closed 4 months ago

jakethekoenig commented 4 months ago

If leash mode is enabled the script is double checked with the leash_model before execution and a message is printed if its deemed unsafe.

A cute leash is added to the ascii art dog.

biobootloader commented 4 months ago

Haha I'm scared to test this by asking for dangerous things

I think I'll modify temporarily to give me override after it decides so I can test

jakethekoenig commented 4 months ago

Haha I'm scared to test this by asking for dangerous things

I think I'll modify temporarily to give me override after it decides so I can test

Good idea. I didn't really test this PR as much as I should

biobootloader commented 4 months ago

So far it it's hard to find something the base model will do that the leash model won't let it!

image
jakethekoenig commented 4 months ago

So far it it's hard to find something the base model will do that the leash model won't let it! image

Honestly I'm not really surprised. I added it because I knew Grant wanted it but I'm skeptical. In a lot of ways it seems like asking an llm the same thing twice. You're not really going to get new information. And if you really care about safety you're going to want to read the script first anyway.

biobootloader commented 4 months ago
image

finally got one but the leash stops it and the reason is: it's safe 😆

granawkins commented 4 months ago

So far it it's hard to find something the base model will do that the leash model won't let it! image

Honestly I'm not really surprised. I added it because I knew Grant wanted it but I'm skeptical. In a lot of ways it seems like asking an llm the same thing twice. You're not really going to get new information. And if you really care about safety you're going to want to read the script first anyway.

Ya I'm not married to this idea, it started out (like most things) as an offhand tweet. I enjoy using dry-run quite a lot, so maybe that's enough.

jakethekoenig commented 4 months ago

So far it it's hard to find something the base model will do that the leash model won't let it! image

Honestly I'm not really surprised. I added it because I knew Grant wanted it but I'm skeptical. In a lot of ways it seems like asking an llm the same thing twice. You're not really going to get new information. And if you really care about safety you're going to want to read the script first anyway.

Ya I'm not married to this idea, it started out (like most things) as an offhand tweet. I enjoy using dry-run quite a lot, so maybe that's enough.

I definitely want at least the leash ASCII art from this pr

granawkins commented 4 months ago

I changed leash to just do what dry-run used to do.