joshcarp / llm.go

MIT License
49 stars 3 forks source link

Initial file structure for CLI. #4

Closed albertpurnama closed 1 month ago

albertpurnama commented 2 months ago

I'm intentionally not linking the GH issue because it doesn't solve the issue yet. This is merely a quick vibe check on the folder/cmd structure.

Initial implementation of llmgo's CLI.

Here's a demo video

https://github.com/joshcarp/llm.go/assets/14824254/6e8be9c7-8b83-4f36-bbe6-799eeeab273d

I'm opening this PR early to get feedback on the structure of the command itself.

joshcarp commented 2 months ago

Works better than I expected, I haven't looked at the parameter/tokenizer binary files but what do you think about having them load directly from huggingface?

We'll put it in another issue, but having it load from here: https://huggingface.co/joshcarp/llm.go/tree/main for example would mean that we could unlock the potential to go install it as a CLI.

albertpurnama commented 1 month ago

Resolved @joshcarp !

joshcarp commented 1 month ago

Thanks @albertpurnama!