Open altxxr0 opened 4 months ago
There's an error text in your project file, as below.
<Target Name="EnsureNuGetPackageBuildImports" BeforeTargets="PrepareForBuild">
<PropertyGroup>
<ErrorText>This project references NuGet package(s) that are missing on this computer. Use NuGet Package Restore to download them. For more information, see http://go.microsoft.com/fwlink/?LinkID=322105. The missing file is {0}.</ErrorText>
</PropertyGroup>
<Error Condition="!Exists('..\packages\LLamaSharp.Backend.Cpu.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cpu.props')" Text="$([System.String]::Format('$(ErrorText)', '..\packages\LLamaSharp.Backend.Cpu.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cpu.props'))" />
<Error Condition="!Exists('..\packages\LLamaSharp.Backend.Cuda12.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cuda12.props')" Text="$([System.String]::Format('$(ErrorText)', '..\packages\LLamaSharp.Backend.Cuda12.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cuda12.props'))" />
<Error Condition="!Exists('..\packages\LLamaSharp.Backend.Cuda11.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cuda11.props')" Text="$([System.String]::Format('$(ErrorText)', '..\packages\LLamaSharp.Backend.Cuda11.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cuda11.props'))" />
<Error Condition="!Exists('..\packages\LLamaSharp.Backend.OpenCL.0.11.2\build\netstandard2.0\LLamaSharp.Backend.OpenCL.props')" Text="$([System.String]::Format('$(ErrorText)', '..\packages\LLamaSharp.Backend.OpenCL.0.11.2\build\netstandard2.0\LLamaSharp.Backend.OpenCL.props'))" />
</Target>
Have you installed any backend packages of LLamaSharp? As you can see here.
Yes, Every backend is installed, because without most of the backends it would error that you din''t install the correct backend
Is the current released Nuget Packages not functioning?
Could you please take a look at your output folder? For example, bin/debug/net6/
. If there's a folder named runtimes
, please check if there are dll files named llama.dll
in its subfolders.
C:\Users(Username)\source\repos\Relate\Relate\bin\Debug Directory of C:\Users(Username)\source\repos\Relate\Relate\bin\Debug
23/04/2024 04:15 pm
No There is no runtime
folder only the native library of llama.dll
Please add the following code to the very beginning of your program first.
NativeLibraryConfig.Instance.WithLibrary("<path>");
<path>
is the path to a llama.dll
, which you can choose one from the dlls shown above. If you don't know which to choose, please download this llama.dll, and this llava_shared.dll if you want to use LLaVA. This might be a quick fix for your problem.
However, that's a bit weird to have llama.dll
but without the runtimes
folder, might be a BUG here. Could you please tell me more information to further dig on this issue?
Yeah, I'l tests it.
.NET Runtime is 8.0.204
Also
Severity Code Description Project File Line Suppression State
Error CS1061 'NativeLibraryConfig' does not contain a definition for 'WithLibrary' and no accessible extension method 'WithLibrary' accepting a first argument of type 'NativeLibraryConfig' could be found (are you missing a using directive or an assembly reference?) Relate C:\Users\jpfau\source\repos\Relate\Relate\Program.cs 16 Active
Please use WithLibrary(filename, null)
if you don't need to use the LLaVA model.
It seems, that the llava_shared,dll library only exists in the avx folders of deps.zip Is it currently only possible to use llava for avx backends?
It should be also in the root folder:
Program.cs
Project File
Exeception Details