search

abcsys / libem

Compound AI toolchain for fast and accurate entity matching, powered by LLMs.
https://libem.org
Apache License 2.0
19 stars 3 forks source link

Add llama3 support on llama.cpp for non-apple silicon devices and benchmark results #50

Closed Char15Xu closed 3 months ago

zenodflow commented 3 months ago

@Char15Xu This is nice. Could you first rebase your branch to the current main?

I did a bunch of updates over feat-local in https://github.com/abcsys/libem/pull/40.

For example, I refactored the get_cost.py to cost.__init__.py.

Char15Xu commented 3 months ago

it should be good now.