TexasInstruments / edgeai-benchmark

This repository has been moved. The new location is in https://github.com/TexasInstruments/edgeai-tensorlab
https://github.com/TexasInstruments/edgeai
Other
3 stars 0 forks source link

about the param.yaml(how to product) #12

Open Onehundred0906 opened 1 year ago

Onehundred0906 commented 1 year ago

excuse me can you explain how i can product the .yaml file of my model in details? or i need to learn which scripts? thanks 2022-12-01 17-30-45屏幕截图

mathmanu commented 1 year ago

For compiling your own models and producing compiled output, you can use the following script: https://github.com/TexasInstruments/edgeai-benchmark/blob/master/run_custom_pc.sh Which invokes this: https://github.com/TexasInstruments/edgeai-benchmark/blob/master/scripts/benchmark_custom.py

See the above script and modify it to compile your own model.

Onehundred0906 commented 1 year ago

Hello, I'm sorry to bother you again, but when I compile my model trained on my own datasets, some mistake occurs like that: 2022-12-02 16-34-31屏幕截图 2022-12-02 16-34-53屏幕截图 2022-12-02 16-35-20屏幕截图

and my pipeline_configs is defined as follows: 2022-12-02 16-36-05屏幕截图 can you help me solute my blocks? i'm very glad to expect your reply! very Thanks.

Onehundred0906 commented 1 year ago

i'm sorry, ‘不是目录’ is present ‘Not a directory’in the first picture !

mathmanu commented 1 year ago

The assertion error seems to be saying that: dataset_selection is set, but dataset_category is not defined in pipeline_config:

Is this the error that you are referring to?

Wondering why dataset_selection is set. Have you set dataset_selection in settings_base.yaml by any chance?

Onehundred0906 commented 1 year ago

emmm, i change the dataset_selection as coco, the follows is mine 2022-12-02 17-34-05屏幕截图

thanks for your reply!

mathmanu commented 1 year ago

If you set dataset_selection to default value (null), are you able to run the script?

Onehundred0906 commented 1 year ago

yeah i have tried that you said, the mistake didn't occur, but i don't know why the compile time is so long so long? i can set somewhat to decrease the compile time? expect to reply!

very thanks! 2022-12-02 21-16-24屏幕截图 2022-12-02 21-16-41屏幕截图

Onehundred0906 commented 1 year ago

Thanks for your help. i have completed the compile process, but i have some questions that need your help.

  1. the 'run_import' and 'run_inference' present what, or tell me how to set them? True or False 2022-12-02 23-41-27屏幕截图

  2. what's the function of the params('num_frames' and 'calibration_frames'), and i should how to set them, i guess they influence the precision of model-deploying? 2022-12-02 23-42-01屏幕截图 i expect your soon reply ! very thanks!

mathmanu commented 1 year ago

calibration_... parameters influences the import time and accuracy. Reducing these may reduce accuracy for some models. 25, 25 may give good results, but for quick experimentation you can use 10, 10 as you have shown above. num_frames determines the number frames used for inference.

Onehundred0906 commented 1 year ago

Thanks for your guide very much, i have tried this model to TDA4 board and find the accuracy is so low, i will modify the calibration_frames into 25 or 50 and verify it again.

But i have another question about the TDA4VM demo show on TDA4VM-SK-SDK. If you know, you can explain for me, if not, i will also appreciate it very much for your help.

when i modify the inputs's resolution(width and height) from 640x640 to 1920x1080[pic_1], to my surpuise, the fps is almost the same from 16.65 to 18.65[pic_2], emm, my model is yolov5l.

2022-12-06 16-56-40屏幕截图 2022-12-06 16-59-18屏幕截图

mathmanu commented 1 year ago

@shyam-j Can you take a look at this?

ravi-rahul commented 1 year ago

Thanks for your guide very much, i have tried this model to TDA4 board and find the accuracy is so low, i will modify the calibration_frames into 25 or 50 and verify it again.

But i have another question about the TDA4VM demo show on TDA4VM-SK-SDK. If you know, you can explain for me, if not, i will also appreciate it very much for your help.

when i modify the inputs's resolution(width and height) from 640x640 to 1920x1080[pic_1], to my surpuise, the fps is almost the same from 16.65 to 18.65[pic_2], emm, my model is yolov5l.

2022-12-06 16-56-40屏幕截图 2022-12-06 16-59-18屏幕截图

Hi @Onehundred0906

Here the framerate is capped by the DLInference time (44ms <---> FPS = 1000/44 ~ 22)

Onehundred0906 commented 1 year ago

Thanks for your reply