search

tjake / Jlama

Jlama is a modern LLM inference engine for Java
Apache License 2.0
499 stars 48 forks source link

add jbang catalog #54

Closed maxandersen closed 1 week ago

maxandersen commented 1 week ago

just a proposal to add jbang-catalog.json so you can run this as jbang jlama@tjake/jlama

+ automatic dependency updates and verification of the jbang catalog content.

if this was instead put in tjake/jbang-catalog repo it would be even shorter to run and not "overlap" with jlama itself.

updated readme and remove jlama.java as redundant now with https://github.com/tjake/jbang-catalog/pull/1

maxandersen commented 1 week ago

I kind of like your suggestion of the separate repo so I made one here

cool - I'll "port" this pr over there.

One question I had, can I have the installer include this compiler directives file I couldn't see how to do that without placing it manually?

TIL - java compiler directives files!

I think there is a way to support it nicely using jbangs "remote file arguments" feature https://www.jbang.dev/documentation/guide/latest/running.html#remote-file-arguments

allows you to do jbang something.java %https://github.com/tjake/Jlama/blob/main/inlinerules.json% but in this case its for the build part....I'll have a think on how that would be doable.

maxandersen commented 1 week ago

fyi, the remote file argument trick does not work at this time. I opened https://github.com/jbangdev/jbang/issues/1838 to see if can make it work.

tjake commented 1 week ago

Closing this since its in jbang-catalog repo. Thank you!