turboderp / exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs
MIT License
3.53k stars 274 forks source link

safetensors with aio.h does not build on windows #289

Closed bjj closed 8 months ago

bjj commented 8 months ago

Commits from this morning that #include <aio.h> do not build on Windows

turboderp commented 8 months ago

I've restricted it to Linux with the latest commit. I'll be able to do some full tests on Windows later.

bjj commented 8 months ago

I think this is resolved? I installed 0.0.12 today and it worked.