search

google-coral / pycoral

Python API for ML inferencing and transfer-learning on Coral devices
https://coral.ai
Apache License 2.0
355 stars 146 forks source link

Create a chatbot with coral and raspberry pi 4b #139

Open LoKoNaoX opened 7 months ago

LoKoNaoX commented 7 months ago

Description

I'm trying to create a chatbot with coral and raspberry pi. But I have used LLama2 models to create the text recognosation and I can make question to the model about the text and documents. It is posible to do that with coral o use it to proccess all the information?

Click to expand! ### Issue Type Support, Feature Request ### Operating System Linux ### Coral Device USB Accelerator ### Other Devices Rapsberry Pi 4 ### Programming Language _No response_ ### Relevant Log Output _No response_
nvtkaszpir commented 5 months ago

no, coral has not enough memory, everything would be on the host and not on the device.