Open yhnz1234 opened 2 months ago
To use LLAMA3 on a smartphone, you can follow these steps and use the following tools:
Web-Based Interface:
Mobile Apps:
Develop Your Own Mobile App:
Use Jupyter Notebooks on Mobile:
Cloud-Based Solutions:
These are some of the ways and tools you can use to work with LLAMA3 on a smartphone.
Thank you so much. it is really helpful! I prefer quantized model for edge device uses
Now I use is in termux.Using ollama in termux and download some model.So I can use LLM in my Android!
Thank you so much. it is really helpful! I prefer quantized model for edge device uses
Great!! LoRA (Low-Rank Adaptation) and QLoRA (Quantized LoRA) are some of the good techniques for quantization
What tools can I use?