Open SpaceTimeEvent2 opened 2 weeks ago
UPD. I commented these lines in node_modules/react-native-llm-mediapipe/ios/LlmInferenceModel.swift and it's running now, although i'm not sure yet, if it runs as intended, it responds something on the first prompt, and stops responding for the second prompt.
final class LlmInferenceModel {
weak var delegate: LlmInferenceModelDelegate?
private lazy var inference: LlmInference! = {
let llmOptions = LlmInference.Options(modelPath: self.modelPath)
llmOptions.maxTokens = self.maxTokens
//llmOptions.topK = self.topK
//llmOptions.temperature = self.temperature
//llmOptions.randomSeed = self.randomSeed
return try? LlmInference(options: llmOptions)
}()
I managed with some effort, to spin up the project from example app, but after I install llm-mediapipe using npm on freshly generated project, I get an error after running the project
Output: ... Lots of errors ... /Users/user/Library/Developer/Xcode/DerivedData/LlmProject-afbekltqetkvwhabyqjxrvrkpevz/Build/Intermediates.noindex/Pods.build/Debug-iphonesimulator/react-native-llm-mediapipe.build/Objects-normal/arm64/react_native_llm_mediapipe.abi.json /Users/user/Data_local/projects/mntl/llm_research/makingitwork/LlmProject/node_modules/react-native-llm-mediapipe/ios/LlmInferenceModel.swift:32:16: error: value of type 'LlmInference.Options' has no member 'topk' llmOptions.topk = self.topK .... warning: Run script build phase 'Bundle React Native code and images' will be run during every build because it does not specify any outputs. To address this issue, either add output dependencies to the script phase, or configure it to run in every build by unchecking "Based on dependency analysis" in the script phase. (in target 'LlmProject' from project 'LlmProject')
--- xcodebuild: WARNING: Using the first of multiple matching destinations: { platform:iOS Simulator, id:A0DDE1B1-E28F-45E5-964F-3D8FEA09663D, OS:18.0, name:iPhone SE (3rd generation) } { platform:iOS Simulator, id:A0DDE1B1-E28F-45E5-964F-3D8FEA09663D, OS:18.0, name:iPhone SE (3rd generation) } BUILD FAILED
The following build commands failed: SwiftEmitModule normal arm64 Emitting\ module\ for\ react_native_llm_mediapipe (in target 'react-native-llm-mediapipe' from project 'Pods') EmitSwiftModule normal arm64 (in target 'react-native-llm-mediapipe' from project 'Pods') Building workspace LlmProject with scheme LlmProject and configuration Debug (3 failures)