Unable to view benchmark results for minigpt4

dusty-nv / jetson-containers

Machine Learning Containers for NVIDIA Jetson and JetPack-L4T

MIT License

2.09k stars 435 forks source link

Unable to view benchmark results for minigpt4 #337

Open lakshanthad opened 9 months ago

lakshanthad commented 9 months ago

Hello,

I am running JetPack 5.1.2 on an Orin NX 16GB device and following the page below to perform the minigpt4 benchmarks: https://github.com/dusty-nv/jetson-containers/tree/master/packages/llm/minigpt4

However, after the benchmarks is finished, I cannot find the minigpt4.csv file. What I am trying to find is to obtain the tokens/ second.

Best Regards, Lakshantha

dusty-nv commented 9 months ago

Hi @lakshanthad, did you run benchmark.py with --save /data/minigpt4.csv ? If you started the container with run.sh, it will automatically mount your jetson-containers/data directory to /data inside the container. Otherwise, specify a different path that you mounted inside the container, so you can view the CSV file outside.