spring98 / flutter-yolo-realtime-plugin

실시간 객체검출 플러그인 배포 (2023)
MIT License
7 stars 4 forks source link

in order to modify this app, what should I do? #4

Open jaaaaaang opened 8 months ago

jaaaaaang commented 8 months ago

Thank you very much!!

I am new to app development, although my background is in data science.

I would like to make modifications to this app; specifically, I want to issue a warning if the user's head moves while swinging the golf ball. To attempt this, which file should I edit? (Where is the Dart file?)

This might be an easy task for some, but as a beginner, I find it challenging. I would greatly appreciate any advice you can offer. Thank you!

spring98 commented 8 months ago

hello!

If you want to get information about the movement of the user's head when swinging a golf ball, it would be a good idea to refer to pose estimation.

This plugin:: yolo > object detection

What you want:: yolo > pose estimation.

This plugin does not implement pose estimation. We have received this request before, so we will add it in the next update.

Sorry for not being able to help you.

thank you

jaaaaaang commented 8 months ago

oh! thanks for quick reply!!

what I think is that I would warn the situation where the people detection box moves significantly beyond the predetermined threshold I have set.

after I posted last issue, I found some dart files and I am trying edit them... (just text of button hahahaha) anyway, belows are my todo lists. 1) I left only "people" in the objects list. (done) 2) calculate the center of the box of people and check the movement of it. (I will) 3) I should put the function which warn with sound ^^ when the situation will occur. (I will)

I may not be as smart as you, making it challenging for me to fully comprehend. Nevertheless, with my limited skills, I'm humorously attempting to navigate and find solutions.

in order to do what I want, could you give me some advice ? where should I put the code(functions) ? I mean , which file should I edit?

spring98 commented 8 months ago

I have identified the problem you are facing.

I think we can give you a more accurate answer if you give us information about your current level of ability to use the flutter framework.

I'm not sure if you want to change the internals of the plugin or if you're curious about how to use the plugin, but I'll answer assuming it's the latter.

The YoloRealTimeView widget allows you to get box information about a person in real time. (captureBox) At this time, the center of the square is final centerX = boxes[i].rect.center.dx; final centerY = boxes[i].rect.center.dy; You can get it like this: If you figure out the movement of that value, you can solve list number 2.

If you need any help, please leave a message anytime!

thank you

jaaaaaang commented 8 months ago

Hey ^^ Happy New Year!!!!!!

I've successfully created my test_sound app, and it worked perfectly. I also integrated your code with my_sound_test_code, and the combined code executed without errors. However, it did not produce the expected sound. I mean that the app isn't producing sound.

there is "print('Successfully played'); " In my code, so I can see the log 'Successfully played' in my console.

Q: Could this issue be due to an error in my code? Q: When I press the button in this app, the camera activates and detects objects. Could the lack of sound be because the camera is in operation?

Once I achieve this question part, my next step is to incorporate code to monitor the movement of the people detection box in order to warn properly. For your reference, I've attached the two code files as text files below.

combined_code.txt my_sound_test.txt