Spews complete nonsense after any prompt

[Stooovie]

Tried StableLM model with llama inference. This is an answer to "hi!"

{ ========== [EXPL] | 1) {prompt}

• 2) (1, "2") [/EXPL]}; template <class E, class S> struct test_pair { typedef pair<E,S> type; };

int main(void) {

define PRINT0(x) cout << #x ": " << x << endl

//PRINTTEST test_pair<short int, string> a; cout << "sizeof(std::pair <char, std::basic_string , long, short>) = "; printtest1(a); }

I have not found any way to get any output that wouldn't be total BS.

[guinmoon]

Hi. Try to disable Mmap and correct prompt template.

[trufae]

this issue is related to this https://github.com/guinmoon/LLMFarm/issues/91