search

mybigday / llama.rn

React Native binding of llama.cpp
MIT License
300 stars 24 forks source link

cannot load model #49

Open loekTheDreamer opened 7 months ago

loekTheDreamer commented 7 months ago

issue in the README regarding model loading. It mentions the 'gguf' model but lacks clear instructions. is file loading implemented yet? No model found is always result.

ramyareye commented 7 months ago

@loekTheDreamer I tried with downloading with https://lmstudio.ai/

loekTheDreamer commented 7 months ago

when using the exmple project the models load fine.

But when adding the file to the project directory and using RNFS the error is always No model found :

    initLlama({
      model: `${RNFS.MainBundlePath}/gp2-q2_k.gguf`,
      // /Users/doris/Library/Developer/CoreSimulator/Devices/FB284989-91D5-4526-BC32-3B6CB88D84A7/data/Containers/Bundle/Application/70FB6F7D-3F5A-45DC-B21F-FEAEB2870926/Thailate.app/gp2-q2_k.gguf
      use_mlock: true,
      n_gpu_layers: Platform.OS === 'ios' ? 0 : 0, // > 0: enable GPU
      // embedding: true,
    })
loekTheDreamer commented 1 week ago

please can someone provide feedback on this