googlecreativelab / teachablemachine-community

Example code snippets and machine learning code for Teachable Machine
https://g.co/teachablemachine
Apache License 2.0
1.5k stars 666 forks source link

how to use sound model from teachable machine using tflite_audio in Flutter :( >> Please I need help or online tutorial #168

Open Malakmud opened 3 years ago

Malakmud commented 3 years ago

hi, I'm trying to build a Flutter app that recognizes human voices and then display the speaker's name the app should upload or record the voice then processing the voice offline to tell the user who is talking I did the model by using teachable machine but I do not know how to integrate the sound model using tflite_audio in Flutter is there any course or video that can help me how to do this?

also, I have two questions 1) is it possible to process the audio offline? (not streaming) 2) can I train a new entry for the model within the code?

Caldarie commented 3 years ago

Hi @Malakmud,

I’m the writer for the tflite_audio plugin. You’ve mentioned that you had difficulties integrating the model to the plugin. Is there a particular step from the readme that you are stuck in?

As for your questions:

  1. yes, with the tflite_audio plugin you can definitely process and classify audio sounds offline
  2. Do you mean increasing the number of inputs? Or do you mean increasing the number of labels? In that case, you could try transfer learning

Did these answers satisfy your question?

Malakmud commented 3 years ago

Thank you @Caldarie I tried your code for teachable machine in flutter but when I run the app it keeps loading the model and I couldn't use the functionality how can I improve that? it takes a lot of time to load the model

also, can you tell me how to do it offline?

and is there any tutorial that explains these things because I'm a beginner in Flutter, ML, Voice Recognition</3

Caldarie commented 3 years ago

thank you for the reply,

Hmm, considering that this is a problem with the plugin and not teachable machine, could you open the issue over there? Link here

As for your first question, the plugin only works offline. There is no online function.

As for our second question - unfortunately, there are no tutorials at the moment besides the readme. However, I can help walk you with the process

Malakmud commented 3 years ago

can you imagine that the model still loading! ok, I will open this issue I meant by "offline": can I upload audio then do the function on it rather than recording? can I talk with you on LinkedIn or any app other? it will be easier for me? @Caldarie

Caldarie commented 3 years ago

Unfortunately, I do not use Linkedin.

As for your question, I will answer it if can you open the issue here, This would really help others should they have a similar problem as you.

Michael

dfybc commented 2 years ago

Hi, is there any demo on how to run audio tflite model on raspberry PI?@Caldarie