Open giusecesa4 opened 6 years ago
HaiqingSun
commented
6 years ago Hi,
The Alexnet test has a bit long run time, please try to wait for enough time, such as ~6000s. We are working on improve the performance now. If still meet the hang issue, could you please send the test log? thanks a lot!
Best Regards, Haiqing
ghost
commented
6 years ago @giusecesa4 Could you check what happens when you reserve more RAM for NVDLA and disable dla_info and dla_debug in kernel module? I get this assertion:
creating new runtime context...
Emulator starting
submitting tasks...
[ 21.731567] Assertion Fail("/home/user/Projects/intuition/soft/nvdla/kmd/port/linux/../../firmware/conv.c"408):(((uint32_t)conv_surface->dst_data.line_stride == (uint32_t)(conv_surface->dst_data.width * atom_size)))UPDATE: Added extra dump before assertion. Looks like some issue with input data structure.
[ 73.345542] conv_surface: line_stride = 8, width = 1, atom_size = 32
[ 73.351706] Assertion Fail("/home/user/Projects/intuition/soft/nvdla/kmd/port/linux/../../firmware/conv.c"412):(((uint32_t)conv_surface->dst_data.line_stride == (uint32_t)(conv_surface->dst_data.width * atom_size)))
JunningWu
commented
6 years ago Could you please share your dsa file with me, if it's possible .I am new to FPGA, it take me some days to setup the environment, however with no progress.Thanks a lot.
Junning Wu
邮箱：wujunning11@gmail.com
Signature is customized by Netease Mail Master
On 07/04/2018 20:30, giusecesa4 wrote: Hi, I am running the NVDLA small architecture on a FPGA.I succeded at running almost all the flatbufs tests available in the UMD. I just have a problem with the loadable NN_L0_1_small_fbuf , which is supposed to be an AlexNet NN precompiled for the small architecture. The process stalls at a certain point and the FPGA stops working. Does anyone have the same problem or know how to solve it? When will the compiler for the NVDLA small be available?
—You are receiving this because you are subscribed to this thread.Reply to this email directly, view it on GitHub, or mute the thread. {"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/nvdla/sw","title":"nvdla/sw","subtitle":"GitHub repository","main_image_url":"https://assets-cdn.github.com/images/email/message_cards/header.png","avatar_image_url":"https://assets-cdn.github.com/images/email/message_cards/avatar.png","action":{"name":"Open in GitHub","url":"https://github.com/nvdla/sw"}},"updates":{"snippets":[{"icon":"DESCRIPTION","message":"AlexNet NN on NVDLA small (#70)"}],"action":{"name":"View Issue","url":"https://github.com/nvdla/sw/issues/70"}}} [ { "@context": "http://schema.org", "@type": "EmailMessage", "potentialAction": { "@type": "ViewAction", "target": "https://github.com/nvdla/sw/issues/70", "url": "https://github.com/nvdla/sw/issues/70", "name": "View Issue" }, "description": "View this Issue on GitHub", "publisher": { "@type": "Organization", "name": "GitHub", "url": "https://github.com" } }, { "@type": "MessageCard", "@context": "http://schema.org/extensions", "hideOriginalBody": "false", "originator": "AF6C5A86-E920-430C-9C59-A73278B5EFEB", "title": "AlexNet NN on NVDLA small (#70)", "sections": [ { "text": "", "activityTitle": "giusecesa4", "activityImage": "https://assets-cdn.github.com/images/email/message_cards/avatar.png", "activitySubtitle": "@giusecesa4", "facts": [ { "name": "Repository: ", "value": "nvdla/sw" }, { "name": "Issue #: ", "value": 70 } ] } ], "potentialAction": [ { "name": "Add a comment", "@type": "ActionCard", "inputs": [ { "isMultiLine": true, "@type": "TextInput", "id": "IssueComment", "isRequired": false } ], "actions": [ { "name": "Comment", "@type": "HttpPOST", "target": "https://api.github.com", "body": "{\n\"commandName\": \"IssueComment\",\n\"repositoryFullName\": \"nvdla/sw\",\n\"issueId\": 70,\n\"IssueComment\": \"{{IssueComment.value}}\"\n}" } ] }, { "name": "Close issue", "@type": "HttpPOST", "target": "https://api.github.com", "body": "{\n\"commandName\": \"IssueClose\",\n\"repositoryFullName\": \"nvdla/sw\",\n\"issueId\": 70\n}" }, { "targets": [ { "os": "default", "uri": "https://github.com/nvdla/sw/issues/70" } ], "@type": "OpenUri", "name": "View on GitHub" }, { "name": "Unsubscribe", "@type": "HttpPOST", "target": "https://api.github.com", "body": "{\n\"commandName\": \"MuteNotification\",\n\"threadId\": 352978108\n}" } ], "themeColor": "26292E" } ]
giusecesa4
commented
6 years ago @HaiqingSun even if I wait a lot of time, the process stalls. This is the log file you asked: result.log
What about the compiler? Looking at the forum I see that it is going to be committed in a few days.
@mmaciag I am going to try it very soon. Thank you for the advice.
I also have another question. Is it possible to understand the properties of the loadable files? I am trying to retrieve the performances of the different engines, but this is not possible without knowing the characteristics of the loadable I put at the input. Thank you for your collaboration
ghost
commented
6 years ago @giusecesa4 I think you don't have to, since your logs contain Assertion Fail as well. My first log had it too, I just had to read it more carefully :). The atomic size obviously should be 8 for _nvsmall. There is a lot of 'Skip dequeue op' due to assertion.
Exiting from erroneous state could be also improved IMHO. Now it hangs the application and kernel driver which cannot be unloaded until system reboot.
smsharif1991
commented
6 years ago Hi @giusecesa4 ,
I ran NN_L0_1_small_fbuf on FPGA and platform and it run successfully. Make sure that your configuration is proper.
Here is the output:
[ 70.747544] opendla: loading out-of-tree module taints kernel. [ 70.767928] reset engine done [ 70.782568] [drm] Initialized nvdla 0.0.0 20171017 for 10200000.nvdla on minor 0
creating new runtime context... [ 86.717877] random: crng init done Emulator starting submitting tasks... [ 5457.654370] Enter:dla_read_network_config [ 5457.660334] Exit:dla_read_network_config status=0 [ 5457.661169] Enter: dla_initiate_processors [ 5457.666951] Enter: dla_submit_operation [ 5457.667661] Prepare Convolution operation index 0 ROI 0 dep_count 1 [ 5457.668576] Enter: dla_prepare_operation [ 5457.672678] processor:Convolution group:0, rdma_group:0 available [ 5457.675999] Enter: dla_read_config [ 5457.688025] Exit: dla_read_config [ 5457.688759] Exit: dla_prepare_operation status=0 [ 5457.691837] Enter: dla_program_operation [ 5457.692580] Program Convolution operation index 0 ROI 0 Group[0] [ 5457.704308] no desc get due to index==-1 [ 5457.708056] no desc get due to index==-1 [ 5457.708710] no desc get due to index==-1 [ 5457.709239] no desc get due to index==-1 [ 5457.712651] no desc get due to index==-1 [ 5457.713330] Enter: dla_op_programmed [ 5457.716816] Update dependency operation index 2 ROI 0 DEP_COUNT=2 [ 5457.720138] Update dependency operation index 1 ROI 0 DEP_COUNT=1 [ 5457.721064] enable SDP in dla_update_dependency as depdency are resolved [ 5457.724548] Enter: dla_enable_operation [ 5457.725270] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5457.728937] Exit: dla_enable_operation status=0 [ 5457.732043] Exit: dla_op_programmed [ 5457.732683] Exit: dla_program_operation status=0 [ 5457.733408] Exit: dla_submit_operation [ 5457.737216] Enter: dla_dequeue_operation [ 5457.740263] Dequeue op from Convolution processor, index=2 ROI=0 [ 5457.741352] Enter: dla_submit_operation [ 5457.744447] Prepare Convolution operation index 2 ROI 0 dep_count 1 [ 5457.745315] Enter: dla_prepare_operation [ 5457.748532] processor:Convolution group:1, rdma_group:0 available [ 5457.749424] Enter: dla_read_config [ 5457.762097] Exit: dla_read_config [ 5457.762683] Exit: dla_prepare_operation status=0 [ 5457.763286] Enter: dla_program_operation [ 5457.763835] Program Convolution operation index 2 ROI 0 Group[1] [ 5457.771456] no desc get due to index==-1 [ 5457.772900] no desc get due to index==-1 [ 5457.773436] no desc get due to index==-1 [ 5457.776795] no desc get due to index==-1 [ 5457.777414] no desc get due to index==-1 [ 5457.780475] Enter: dla_op_programmed [ 5457.781096] Update dependency operation index 6 ROI 0 DEP_COUNT=3 [ 5457.784383] Update dependency operation index 3 ROI 0 DEP_COUNT=2 [ 5457.785239] Exit: dla_op_programmed [ 5457.788264] Exit: dla_program_operation status=0 [ 5457.788975] Exit: dla_submit_operation [ 5457.792065] Exit: dla_dequeue_operation [ 5457.792807] Enter: dla_submit_operation [ 5457.793353] Prepare SDP operation index 1 ROI 0 dep_count 0 [ 5457.796871] Enter: dla_prepare_operation [ 5457.799842] processor:SDP group:0, rdma_group:0 available [ 5457.800651] Enter: dla_read_config [ 5457.812217] Exit: dla_read_config [ 5457.813016] Exit: dla_prepare_operation status=0 [ 5457.816045] Enter: dla_program_operation [ 5457.816704] Program SDP operation index 1 ROI 0 Group[0] [ 5457.824702] no desc get due to index==-1 [ 5457.825341] no desc get due to index==-1 [ 5457.828410] no desc get due to index==-1 [ 5457.829482] no desc get due to index==-1 [ 5457.832844] Enter: dla_op_programmed [ 5457.833451] Update dependency operation index 3 ROI 0 DEP_COUNT=1 [ 5457.836757] enable SDP in dla_update_dependency as depdency are resolved [ 5457.839843] Enter: dla_enable_operation [ 5457.840541] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5457.844139] Exit: dla_enable_operation status=0 [ 5457.844847] Exit: dla_op_programmed [ 5457.845343] Exit: dla_program_operation status=0 [ 5457.848803] Enter: dla_enable_operation [ 5457.851760] Enable SDP operation index 1 ROI 0 [ 5457.852935] Enter: dla_op_enabled [ 5457.853467] Update dependency operation index 0 ROI 0 DEP_COUNT=1 [ 5457.857572] enable Convolution in dla_update_dependency as depdency are resolved [ 5457.860927] Enter: dla_enable_operation [ 5457.861479] Enable Convolution operation index 0 ROI 0 [ 5457.865407] Enter: dla_op_enabled [ 5457.868236] Exit: dla_op_enabled [ 5457.868841] Exit: dla_enable_operation status=0 [ 5457.869438] Exit: dla_op_enabled [ 5457.872747] Exit: dla_enable_operation status=0 [ 5457.873454] Exit: dla_submit_operation [ 5457.876543] Enter: dla_dequeue_operation [ 5457.877183] Dequeue op from SDP processor, index=3 ROI=0 [ 5457.880393] Enter: dla_submit_operation [ 5457.881040] Prepare SDP operation index 3 ROI 0 dep_count 0 [ 5457.884260] Enter: dla_prepare_operation [ 5457.888341] processor:SDP group:1, rdma_group:1 available [ 5457.889160] Enter: dla_read_config [ 5457.901152] Exit: dla_read_config [ 5457.902145] Exit: dla_prepare_operation status=0 [ 5457.902755] Enter: dla_program_operation [ 5457.903299] Program SDP operation index 3 ROI 0 Group[1] [ 5457.905315] no desc get due to index==-1 [ 5457.909066] no desc get due to index==-1 [ 5457.912584] no desc get due to index==-1 [ 5457.913198] no desc get due to index==-1 [ 5457.916359] Enter: dla_op_programmed [ 5457.916993] Update dependency operation index 7 ROI 0 DEP_COUNT=2 [ 5457.920273] Exit: dla_op_programmed [ 5457.920883] Exit: dla_program_operation status=0 [ 5457.921485] Enter: dla_enable_operation [ 5457.924982] Enable SDP operation index 3 ROI 0 [ 5457.928034] Enter: dla_op_enabled [ 5457.928637] Update dependency operation index 2 ROI 0 DEP_COUNT=1 [ 5457.929388] enable Convolution in dla_update_dependency as depdency are resolved [ 5457.933380] Enter: dla_enable_operation [ 5457.936236] Enable Convolution operation index 2 ROI 0 [ 5457.937509] Enter: dla_op_enabled [ 5457.940545] Exit: dla_op_enabled [ 5457.941107] Exit: dla_enable_operation status=0 [ 5457.944219] Exit: dla_op_enabled [ 5457.944801] Exit: dla_enable_operation status=0 [ 5457.945388] Exit: dla_submit_operation [ 5457.948737] Exit: dla_dequeue_operation [ 5457.952917] Enter: dla_submit_operation [ 5457.955997] Prepare PDP operation index 5 ROI 0 dep_count 1 [ 5457.956816] Enter: dla_prepare_operation [ 5457.957378] processor:PDP group:0, rdma_group:0 available [ 5457.960770] Enter: dla_read_config [ 5457.972704] Exit: dla_read_config [ 5457.973287] Exit: dla_prepare_operation status=0 [ 5457.976161] Enter: dla_program_operation [ 5457.976718] Program PDP operation index 5 ROI 0 Group[0] [ 5457.977324] group id 0 rdma id 0 [ 5457.986402] no desc get due to index==-1 [ 5457.986950] no desc get due to index==-1 [ 5457.987822] no desc get due to index==-1 [ 5457.988265] no desc get due to index==-1 [ 5457.988704] no desc get due to index==-1 [ 5457.989140] Enter: dla_op_programmed [ 5457.992955] Update dependency operation index 11 ROI 0 DEP_COUNT=2 [ 5457.994100] Exit: dla_op_programmed [ 5457.994512] Exit: dla_program_operation status=0 [ 5457.994988] Exit: dla_submit_operation [ 5457.995423] Enter: dla_dequeue_operation [ 5457.995859] Dequeue op from PDP processor, index=11 ROI=0 [ 5457.996392] Enter: dla_submit_operation [ 5457.996849] Prepare PDP operation index 11 ROI 0 dep_count 1 [ 5457.997410] Enter: dla_prepare_operation [ 5458.003839] processor:PDP group:1, rdma_group:1 available [ 5458.004495] Enter: dla_read_config [ 5458.016291] Exit: dla_read_config [ 5458.016813] Exit: dla_prepare_operation status=0 [ 5458.017311] Enter: dla_program_operation [ 5458.020390] Program PDP operation index 11 ROI 0 Group[1] [ 5458.021053] group id 1 rdma id 1 [ 5458.028069] no desc get due to index==-1 [ 5458.029069] no desc get due to index==-1 [ 5458.032654] no desc get due to index==-1 [ 5458.033211] no desc get due to index==-1 [ 5458.036172] no desc get due to index==-1 [ 5458.036713] Enter: dla_op_programmed [ 5458.037147] Update dependency operation index 22 ROI 0 DEP_COUNT=2 [ 5458.040601] Exit: dla_op_programmed [ 5458.041106] Exit: dla_program_operation status=0 [ 5458.044131] Exit: dla_submit_operation [ 5458.044664] Exit: dla_dequeue_operation [ 5458.045104] Enter: dla_submit_operation [ 5458.045567] Prepare CDP operation index 4 ROI 0 dep_count 2 [ 5458.049282] Enter: dla_prepare_operation [ 5458.052534] processor:CDP group:0, rdma_group:0 available [ 5458.053185] Enter: dla_read_config [ 5458.065396] Exit: dla_read_config [ 5458.066359] Exit: dla_prepare_operation status=0 [ 5458.067060] Enter: dla_program_operation [ 5458.067519] Program CDP operation index 4 ROI 0 Group[0] [ 5458.068332] Enter: dla_cdp_program [ 5458.068610] Enter: processor_cdp_program [ 5458.099755] Exit: processor_cdp_program [ 5458.099892] Exit: dla_cdp_program [ 5458.100460] no desc get due to index==-1 [ 5458.101259] no desc get due to index==-1 [ 5458.104592] no desc get due to index==-1 [ 5458.107755] no desc get due to index==-1 [ 5458.108303] no desc get due to index==-1 [ 5458.108750] Enter: dla_op_programmed [ 5458.109172] Update dependency operation index 10 ROI 0 DEP_COUNT=3 [ 5458.112910] Exit: dla_op_programmed [ 5458.113413] Exit: dla_program_operation status=0 [ 5458.116449] Exit: dla_submit_operation [ 5458.116984] Enter: dla_dequeue_operation [ 5458.117440] Dequeue op from CDP processor, index=10 ROI=0 [ 5458.120843] Enter: dla_submit_operation [ 5458.121384] Prepare CDP operation index 10 ROI 0 dep_count 2 [ 5458.124507] Enter: dla_prepare_operation [ 5458.125187] processor:CDP group:1, rdma_group:1 available [ 5458.128296] Enter: dla_read_config [ 5458.139840] Exit: dla_read_config [ 5458.140333] Exit: dla_prepare_operation status=0 [ 5458.140872] Exit: dla_submit_operation [ 5458.141311] Exit: dla_dequeue_operation [ 5458.144717] Exit: dla_initiate_processors status=0 [ 5458.145573] Enter:dla_handle_events, processor:BDMA [ 5458.146347] Exit:dla_handle_events, ret:0 [ 5458.146891] Enter:dla_handle_events, processor:Convolution [ 5458.147512] Handle cdma weight done event, processor Convolution group 0 [ 5458.148322] Handle cdma data done event, processor Convolution group 0 [ 5458.149099] Handle op complete event, processor Convolution group 0 [ 5458.149849] Enter:dla_op_completion processor Convolution group0 [ 5458.150517] Completed Convolution operation index 0 ROI 0 [ 5458.151346] 1 HWLs done, totally 30 layers [ 5458.152012] Enter: dla_dequeue_operation [ 5458.152476] Dequeue op from Convolution processor, index=6 ROI=0 [ 5458.153087] Enter: dla_submit_operation [ 5458.153530] Prepare Convolution operation index 6 ROI 0 dep_count 2 [ 5458.154166] Enter: dla_prepare_operation [ 5458.154683] processor:Convolution group:0, rdma_group:0 available [ 5458.155292] Enter: dla_read_config [ 5458.163702] Exit: dla_read_config [ 5458.164119] Exit: dla_prepare_operation status=0 [ 5458.164622] Enter: dla_program_operation [ 5458.165073] Program Convolution operation index 6 ROI 0 Group[0] [ 5458.168956] no desc get due to index==-1 [ 5458.169818] no desc get due to index==-1 [ 5458.170257] no desc get due to index==-1 [ 5458.170691] no desc get due to index==-1 [ 5458.171121] no desc get due to index==-1 [ 5458.171564] Enter: dla_op_programmed [ 5458.171997] Update dependency operation index 7 ROI 0 DEP_COUNT=1 [ 5458.172610] enable SDP in dla_update_dependency as depdency are resolved [ 5458.173260] Enter: dla_enable_operation [ 5458.173689] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5458.174568] Exit: dla_enable_operation status=0 [ 5458.175041] Exit: dla_op_programmed [ 5458.175446] Exit: dla_program_operation status=0 [ 5458.175931] Exit: dla_submit_operation [ 5458.176356] Exit: dla_dequeue_operation [ 5458.176885] Exit:dla_op_completion processor Convolution group0 status=0 [ 5458.177658] Handle cdma weight done event, processor Convolution group 1 [ 5458.178339] Handle cdma data done event, processor Convolution group 1 [ 5458.178999] Handle op complete event, processor Convolution group 1 [ 5458.179628] Enter:dla_op_completion processor Convolution group1 [ 5458.180234] Completed Convolution operation index 2 ROI 0 [ 5458.180806] 2 HWLs done, totally 30 layers [ 5458.181265] Enter: dla_dequeue_operation [ 5458.181713] Dequeue op from Convolution processor, index=8 ROI=0 [ 5458.182321] Enter: dla_submit_operation [ 5458.182754] Prepare Convolution operation index 8 ROI 0 dep_count 2 [ 5458.183361] Enter: dla_prepare_operation [ 5458.183863] processor:Convolution group:1, rdma_group:0 available [ 5458.184559] Enter: dla_read_config [ 5458.192871] Exit: dla_read_config [ 5458.193281] Exit: dla_prepare_operation status=0 [ 5458.193773] Enter: dla_program_operation [ 5458.194228] Program Convolution operation index 8 ROI 0 Group[1] [ 5458.198058] no desc get due to index==-1 [ 5458.198931] no desc get due to index==-1 [ 5458.199376] no desc get due to index==-1 [ 5458.199815] no desc get due to index==-1 [ 5458.200241] no desc get due to index==-1 [ 5458.200693] Enter: dla_op_programmed [ 5458.201116] Update dependency operation index 12 ROI 0 DEP_COUNT=3 [ 5458.201738] Update dependency operation index 9 ROI 0 DEP_COUNT=2 [ 5458.202329] Exit: dla_op_programmed [ 5458.202727] Exit: dla_program_operation status=0 [ 5458.203207] Exit: dla_submit_operation [ 5458.203641] Exit: dla_dequeue_operation [ 5458.204084] Exit:dla_op_completion processor Convolution group1 status=0 [ 5458.204760] Exit:dla_handle_events, ret:0 [ 5458.205214] Enter:dla_handle_events, processor:SDP [ 5458.205732] Handle op complete event, processor SDP group 0 [ 5458.206297] Enter:dla_op_completion processor SDP group0 [ 5458.206842] Completed SDP operation index 1 ROI 0 [ 5458.207459] Update dependency operation index 4 ROI 0 DEP_COUNT=2 [ 5458.208083] 3 HWLs done, totally 30 layers [ 5458.208620] Enter: dla_free_op_desc op desc index 0 ROI 0 [ 5458.210027] Exit: dla_free_op_desc [ 5458.210492] Enter: dla_dequeue_operation [ 5458.210939] Dequeue op from SDP processor, index=7 ROI=0 [ 5458.211497] Enter: dla_submit_operation [ 5458.211928] Prepare SDP operation index 7 ROI 0 dep_count 0 [ 5458.212492] Enter: dla_prepare_operation [ 5458.213062] processor:SDP group:0, rdma_group:1 available [ 5458.213621] Enter: dla_read_config [ 5458.221937] Exit: dla_read_config [ 5458.222347] Exit: dla_prepare_operation status=0 [ 5458.222830] Enter: dla_program_operation [ 5458.223281] Program SDP operation index 7 ROI 0 Group[0] [ 5458.225409] no desc get due to index==-1 [ 5458.225853] no desc get due to index==-1 [ 5458.226283] no desc get due to index==-1 [ 5458.226707] no desc get due to index==-1 [ 5458.227144] Enter: dla_op_programmed [ 5458.227556] Update dependency operation index 9 ROI 0 DEP_COUNT=1 [ 5458.228150] enable SDP in dla_update_dependency as depdency are resolved [ 5458.228814] Enter: dla_enable_operation [ 5458.229236] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5458.230097] Exit: dla_enable_operation status=0 [ 5458.230577] Exit: dla_op_programmed [ 5458.230989] Exit: dla_program_operation status=0 [ 5458.231494] Enter: dla_enable_operation [ 5458.231937] Enable SDP operation index 7 ROI 0 [ 5458.232594] Enter: dla_op_enabled [ 5458.233008] Update dependency operation index 6 ROI 0 DEP_COUNT=2 [ 5458.233607] Exit: dla_op_enabled [ 5458.233986] Exit: dla_enable_operation status=0 [ 5458.234461] Exit: dla_submit_operation [ 5458.234888] Exit: dla_dequeue_operation [ 5458.235333] Enter: dla_free_op_desc op desc index 1 ROI 0 [ 5458.237221] Exit: dla_free_op_desc [ 5458.237650] Exit:dla_op_completion processor SDP group0 status=0 [ 5458.238264] Handle op complete event, processor SDP group 1 [ 5458.238838] Enter:dla_op_completion processor SDP group1 [ 5458.239398] Completed SDP operation index 3 ROI 0 [ 5458.239914] Update dependency operation index 4 ROI 0 DEP_COUNT=1 [ 5458.240514] enable CDP in dla_update_dependency as depdency are resolved [ 5458.241189] Enter: dla_enable_operation [ 5458.241619] Enable CDP operation index 4 ROI 0 [ 5458.242267] Enter: dla_cdp_enable [ 5458.242869] Exit: dla_cdp_enable [ 5458.243320] Enter: dla_op_enabled [ 5458.243730] Exit: dla_op_enabled [ 5458.244119] Exit: dla_enable_operation status=0 [ 5458.244622] 4 HWLs done, totally 30 layers [ 5458.245089] Enter: dla_free_op_desc op desc index 2 ROI 0 [ 5458.246971] Exit: dla_free_op_desc [ 5458.247379] Enter: dla_dequeue_operation [ 5458.247823] Dequeue op from SDP processor, index=9 ROI=0 [ 5458.248360] Enter: dla_submit_operation [ 5458.248823] Prepare SDP operation index 9 ROI 0 dep_count 0 [ 5458.249371] Enter: dla_prepare_operation [ 5458.249907] processor:SDP group:1, rdma_group:0 available [ 5458.250472] Enter: dla_read_config [ 5458.258810] Exit: dla_read_config [ 5458.259204] Exit: dla_prepare_operation status=0 [ 5458.259683] Enter: dla_program_operation [ 5458.260119] Program SDP operation index 9 ROI 0 Group[1] [ 5458.262251] no desc get due to index==-1 [ 5458.262711] no desc get due to index==-1 [ 5458.263553] no desc get due to index==-1 [ 5458.263994] no desc get due to index==-1 [ 5458.264418] Enter: dla_op_programmed [ 5458.264852] Update dependency operation index 13 ROI 0 DEP_COUNT=2 [ 5458.265465] Exit: dla_op_programmed [ 5458.265877] Exit: dla_program_operation status=0 [ 5458.266376] Enter: dla_enable_operation [ 5458.266809] Enable SDP operation index 9 ROI 0 [ 5458.267467] Enter: dla_op_enabled [ 5458.267872] Update dependency operation index 8 ROI 0 DEP_COUNT=2 [ 5458.268481] Exit: dla_op_enabled [ 5458.268878] Exit: dla_enable_operation status=0 [ 5458.269376] Exit: dla_submit_operation [ 5458.269815] Exit: dla_dequeue_operation [ 5458.270254] Enter: dla_free_op_desc op desc index 3 ROI 0 [ 5458.271203] Exit: dla_free_op_desc [ 5458.271617] Exit:dla_op_completion processor SDP group1 status=0 [ 5458.272233] Exit:dla_handle_events, ret:0 [ 5458.272719] Enter:dla_handle_events, processor:PDP [ 5458.273230] Exit:dla_handle_events, ret:0 [ 5458.273675] Enter:dla_handle_events, processor:CDP [ 5458.274194] Exit:dla_handle_events, ret:0 [ 5458.274640] Enter:dla_handle_events, processor:RUBIK [ 5458.275162] Exit:dla_handle_events, ret:0 [ 5458.282585] Enter:dla_handle_events, processor:BDMA [ 5458.283212] Exit:dla_handle_events, ret:0 [ 5458.283657] Enter:dla_handle_events, processor:Convolution [ 5458.284204] Exit:dla_handle_events, ret:0 [ 5458.284664] Enter:dla_handle_events, processor:SDP [ 5458.285169] Exit:dla_handle_events, ret:0 [ 5458.285627] Enter:dla_handle_events, processor:PDP [ 5458.286137] Exit:dla_handle_events, ret:0 [ 5458.286575] Enter:dla_handle_events, processor:CDP [ 5458.287080] Handle op complete event, processor CDP group 0 [ 5458.287666] Enter:dla_op_completion processor CDP group0 [ 5458.288215] Completed CDP operation index 4 ROI 0 [ 5458.288735] Update dependency operation index 5 ROI 0 DEP_COUNT=1 [ 5458.289341] enable PDP in dla_update_dependency as depdency are resolved [ 5458.290002] Enter: dla_enable_operation [ 5458.290439] Enable PDP operation index 5 ROI 0 [ 5458.290930] group id 0 rdma id 0 [ 5458.291539] rdma needed 1 [ 5458.292107] Enter: dla_op_enabled [ 5458.292501] Exit: dla_op_enabled [ 5458.292898] Exit: dla_enable_operation status=0 [ 5458.293388] 5 HWLs done, totally 30 layers [ 5458.293946] Enter: dla_program_operation [ 5458.294401] Program CDP operation index 10 ROI 0 Group[1] [ 5458.295061] Enter: dla_cdp_program [ 5458.295207] Enter: processor_cdp_program [ 5458.317664] Exit: processor_cdp_program [ 5458.317708] Exit: dla_cdp_program [ 5458.318142] no desc get due to index==-1 [ 5458.318902] no desc get due to index==-1 [ 5458.319315] no desc get due to index==-1 [ 5458.319740] no desc get due to index==-1 [ 5458.320163] no desc get due to index==-1 [ 5458.320598] no desc get due to index==-1 [ 5458.321022] Enter: dla_op_programmed [ 5458.321419] Exit: dla_op_programmed [ 5458.321818] Exit: dla_program_operation status=0 [ 5458.322348] Enter: dla_dequeue_operation [ 5458.322815] exit CDP as there's no further operation [ 5458.323341] Exit: dla_dequeue_operation [ 5458.323795] Enter: dla_free_op_desc op desc index 4 ROI 0 [ 5458.324754] Exit: dla_free_op_desc [ 5458.325179] Exit:dla_op_completion processor CDP group0 status=0 [ 5458.325794] Exit:dla_handle_events, ret:0 [ 5458.326241] Enter:dla_handle_events, processor:RUBIK [ 5458.326768] Exit:dla_handle_events, ret:0 [ 5458.420900] Enter:dla_handle_events, processor:BDMA [ 5458.421507] Exit:dla_handle_events, ret:0 [ 5458.421976] Enter:dla_handle_events, processor:Convolution [ 5458.422526] Exit:dla_handle_events, ret:0 [ 5458.422962] Enter:dla_handle_events, processor:SDP [ 5458.423470] Exit:dla_handle_events, ret:0 [ 5458.423917] Enter:dla_handle_events, processor:PDP [ 5458.424422] Handle op complete event, processor PDP group 0 [ 5458.425016] Enter:dla_op_completion processor PDP group0 [ 5458.425585] Completed PDP operation index 5 ROI 0 [ 5458.426092] Update dependency operation index 6 ROI 0 DEP_COUNT=1 [ 5458.426692] enable Convolution in dla_update_dependency as depdency are resolved [ 5458.427406] Enter: dla_enable_operation [ 5458.427833] Enable Convolution operation index 6 ROI 0 [ 5458.428878] Enter: dla_op_enabled [ 5458.429282] Update dependency operation index 8 ROI 0 DEP_COUNT=1 [ 5458.429883] enable Convolution in dla_update_dependency as depdency are resolved [ 5458.430608] Enter: dla_enable_operation [ 5458.431037] Enable Convolution operation index 8 ROI 0 [ 5458.432040] Enter: dla_op_enabled [ 5458.432436] Exit: dla_op_enabled [ 5458.432827] Exit: dla_enable_operation status=0 [ 5458.433309] Exit: dla_op_enabled [ 5458.433694] Exit: dla_enable_operation status=0 [ 5458.434195] 6 HWLs done, totally 30 layers [ 5458.434655] Enter: dla_dequeue_operation [ 5458.435098] Dequeue op from PDP processor, index=22 ROI=0 [ 5458.435651] Enter: dla_submit_operation [ 5458.436095] Prepare PDP operation index 22 ROI 0 dep_count 1 [ 5458.436689] Enter: dla_prepare_operation [ 5458.437231] processor:PDP group:0, rdma_group:0 available [ 5458.437782] Enter: dla_read_config [ 5458.446201] Exit: dla_read_config [ 5458.446606] Exit: dla_prepare_operation status=0 [ 5458.447094] Enter: dla_program_operation [ 5458.447548] Program PDP operation index 22 ROI 0 Group[0] [ 5458.448105] group id 0 rdma id 0 [ 5458.450404] no desc get due to index==-1 [ 5458.451267] no desc get due to index==-1 [ 5458.452186] no desc get due to index==-1 [ 5458.452630] no desc get due to index==-1 [ 5458.453060] no desc get due to index==-1 [ 5458.453490] Enter: dla_op_programmed [ 5458.453904] Update dependency operation index 23 ROI 0 DEP_COUNT=2 [ 5458.454512] Exit: dla_op_programmed [ 5458.454917] Exit: dla_program_operation status=0 [ 5458.455408] Exit: dla_submit_operation [ 5458.455827] Exit: dla_dequeue_operation [ 5458.456259] Enter: dla_free_op_desc op desc index 5 ROI 0 [ 5458.458150] Exit: dla_free_op_desc [ 5458.458561] Exit:dla_op_completion processor PDP group0 status=0 [ 5458.459162] Exit:dla_handle_events, ret:0 [ 5458.459603] Enter:dla_handle_events, processor:CDP [ 5458.460113] Exit:dla_handle_events, ret:0 [ 5458.460568] Enter:dla_handle_events, processor:RUBIK [ 5458.461085] Exit:dla_handle_events, ret:0 [ 5458.541301] Enter:dla_handle_events, processor:BDMA [ 5458.541976] Exit:dla_handle_events, ret:0 [ 5458.542429] Enter:dla_handle_events, processor:Convolution [ 5458.543005] Handle cdma data done event, processor Convolution group 0 [ 5458.543656] Exit:dla_handle_events, ret:0 [ 5458.544098] Enter:dla_handle_events, processor:SDP [ 5458.544622] Exit:dla_handle_events, ret:0 [ 5458.545068] Enter:dla_handle_events, processor:PDP [ 5458.545574] Exit:dla_handle_events, ret:0 [ 5458.546016] Enter:dla_handle_events, processor:CDP [ 5458.546520] Exit:dla_handle_events, ret:0 [ 5458.546953] Enter:dla_handle_events, processor:RUBIK [ 5458.547462] Exit:dla_handle_events, ret:0 [ 5458.555244] Enter:dla_handle_events, processor:BDMA [ 5458.555861] Exit:dla_handle_events, ret:0 [ 5458.556308] Enter:dla_handle_events, processor:Convolution [ 5458.556881] Exit:dla_handle_events, ret:0 [ 5458.557320] Enter:dla_handle_events, processor:SDP [ 5458.557851] Exit:dla_handle_events, ret:0 [ 5458.558297] Enter:dla_handle_events, processor:PDP [ 5458.558807] Exit:dla_handle_events, ret:0 [ 5458.559255] Enter:dla_handle_events, processor:CDP [ 5458.559760] Exit:dla_handle_events, ret:0 [ 5458.560198] Enter:dla_handle_events, processor:RUBIK [ 5458.560725] Exit:dla_handle_events, ret:0 [ 5458.568257] Enter:dla_handle_events, processor:BDMA [ 5458.568910] Exit:dla_handle_events, ret:0 [ 5458.569370] Enter:dla_handle_events, processor:Convolution [ 5458.569961] Exit:dla_handle_events, ret:0 [ 5458.570410] Enter:dla_handle_events, processor:SDP [ 5458.570914] Exit:dla_handle_events, ret:0 [ 5458.571353] Enter:dla_handle_events, processor:PDP [ 5458.571857] Exit:dla_handle_events, ret:0 [ 5458.572301] Enter:dla_handle_events, processor:CDP [ 5458.572825] Exit:dla_handle_events, ret:0 [ 5458.573355] Enter:dla_handle_events, processor:RUBIK [ 5458.573878] Exit:dla_handle_events, ret:0 [ 5458.580248] Enter:dla_handle_events, processor:BDMA [ 5458.580885] Exit:dla_handle_events, ret:0 [ 5458.581325] Enter:dla_handle_events, processor:Convolution [ 5458.581945] Handle cdma weight done event, processor Convolution group 0 [ 5458.582608] Handle op complete event, processor Convolution group 0 [ 5458.583234] Enter:dla_op_completion processor Convolution group0 [ 5458.583847] Completed Convolution operation index 6 ROI 0 [ 5458.584415] 7 HWLs done, totally 30 layers [ 5458.584881] Enter: dla_dequeue_operation [ 5458.585338] Dequeue op from Convolution processor, index=12 ROI=0 [ 5458.585950] Enter: dla_submit_operation [ 5458.586381] Prepare Convolution operation index 12 ROI 0 dep_count 2 [ 5458.587003] Enter: dla_prepare_operation [ 5458.587501] processor:Convolution group:0, rdma_group:0 available [ 5458.588099] Enter: dla_read_config [ 5458.596006] Exit: dla_read_config [ 5458.596404] Exit: dla_prepare_operation status=0 [ 5458.596902] Enter: dla_program_operation [ 5458.597345] Program Convolution operation index 12 ROI 0 Group[0] [ 5458.601035] no desc get due to index==-1 [ 5458.601877] no desc get due to index==-1 [ 5458.602308] no desc get due to index==-1 [ 5458.602743] no desc get due to index==-1 [ 5458.603160] no desc get due to index==-1 [ 5458.603580] Enter: dla_op_programmed [ 5458.603991] Update dependency operation index 14 ROI 0 DEP_COUNT=3 [ 5458.604615] Update dependency operation index 13 ROI 0 DEP_COUNT=1 [ 5458.605220] enable SDP in dla_update_dependency as depdency are resolved [ 5458.605851] Enter: dla_enable_operation [ 5458.606281] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5458.607142] Exit: dla_enable_operation status=0 [ 5458.607630] Exit: dla_op_programmed [ 5458.608027] Exit: dla_program_operation status=0 [ 5458.608514] Exit: dla_submit_operation [ 5458.608942] Exit: dla_dequeue_operation [ 5458.609384] Exit:dla_op_completion processor Convolution group0 status=0 [ 5458.610043] Handle cdma data done event, processor Convolution group 1 [ 5458.610684] Exit:dla_handle_events, ret:0 [ 5458.611124] Enter:dla_handle_events, processor:SDP [ 5458.611638] Handle op complete event, processor SDP group 0 [ 5458.612207] Enter:dla_op_completion processor SDP group0 [ 5458.612764] Completed SDP operation index 7 ROI 0 [ 5458.613273] Update dependency operation index 10 ROI 0 DEP_COUNT=2 [ 5458.613890] 8 HWLs done, totally 30 layers [ 5458.614353] Enter: dla_free_op_desc op desc index 6 ROI 0 [ 5458.615271] Exit: dla_free_op_desc [ 5458.615679] Enter: dla_dequeue_operation [ 5458.616115] Dequeue op from SDP processor, index=13 ROI=0 [ 5458.616678] Enter: dla_submit_operation [ 5458.617119] Prepare SDP operation index 13 ROI 0 dep_count 0 [ 5458.617684] Enter: dla_prepare_operation [ 5458.618216] processor:SDP group:0, rdma_group:1 available [ 5458.618761] Enter: dla_read_config [ 5458.626597] Exit: dla_read_config [ 5458.627006] Exit: dla_prepare_operation status=0 [ 5458.627493] Enter: dla_program_operation [ 5458.627934] Program SDP operation index 13 ROI 0 Group[0] [ 5458.629947] no desc get due to index==-1 [ 5458.630768] no desc get due to index==-1 [ 5458.631211] no desc get due to index==-1 [ 5458.631630] no desc get due to index==-1 [ 5458.632052] Enter: dla_op_programmed [ 5458.632468] Update dependency operation index 15 ROI 0 DEP_COUNT=2 [ 5458.633087] Exit: dla_op_programmed [ 5458.633484] Exit: dla_program_operation status=0 [ 5458.633966] Enter: dla_enable_operation [ 5458.634396] Enable SDP operation index 13 ROI 0 [ 5458.635047] Enter: dla_op_enabled [ 5458.635452] Update dependency operation index 12 ROI 0 DEP_COUNT=2 [ 5458.636061] Exit: dla_op_enabled [ 5458.636451] Exit: dla_enable_operation status=0 [ 5458.636952] Exit: dla_submit_operation [ 5458.637383] Exit: dla_dequeue_operation [ 5458.637825] Enter: dla_free_op_desc op desc index 7 ROI 0 [ 5458.639605] Exit: dla_free_op_desc [ 5458.640020] Exit:dla_op_completion processor SDP group0 status=0 [ 5458.640630] Exit:dla_handle_events, ret:0 [ 5458.641057] Enter:dla_handle_events, processor:PDP [ 5458.641568] Exit:dla_handle_events, ret:0 [ 5458.642007] Enter:dla_handle_events, processor:CDP [ 5458.642513] Exit:dla_handle_events, ret:0 [ 5458.642947] Enter:dla_handle_events, processor:RUBIK [ 5458.643469] Exit:dla_handle_events, ret:0 [ 5458.694678] Enter:dla_handle_events, processor:BDMA [ 5458.695310] Exit:dla_handle_events, ret:0 [ 5458.695751] Enter:dla_handle_events, processor:Convolution [ 5458.696308] Handle cdma weight done event, processor Convolution group 1 [ 5458.697000] Handle op complete event, processor Convolution group 1 [ 5458.697648] Enter:dla_op_completion processor Convolution group1 [ 5458.698265] Completed Convolution operation index 8 ROI 0 [ 5458.698827] 9 HWLs done, totally 30 layers [ 5458.699293] Enter: dla_dequeue_operation [ 5458.699739] Dequeue op from Convolution processor, index=14 ROI=0 [ 5458.700342] Enter: dla_submit_operation [ 5458.700794] Prepare Convolution operation index 14 ROI 0 dep_count 2 [ 5458.701415] Enter: dla_prepare_operation [ 5458.701932] processor:Convolution group:1, rdma_group:0 available [ 5458.702535] Enter: dla_read_config [ 5458.710904] Exit: dla_read_config [ 5458.711308] Exit: dla_prepare_operation status=0 [ 5458.711799] Enter: dla_program_operation [ 5458.712255] Program Convolution operation index 14 ROI 0 Group[1] [ 5458.716144] no desc get due to index==-1 [ 5458.717024] no desc get due to index==-1 [ 5458.717459] no desc get due to index==-1 [ 5458.717890] no desc get due to index==-1 [ 5458.718306] no desc get due to index==-1 [ 5458.718728] Enter: dla_op_programmed [ 5458.719140] Update dependency operation index 15 ROI 0 DEP_COUNT=1 [ 5458.719759] enable SDP in dla_update_dependency as depdency are resolved [ 5458.720491] Enter: dla_enable_operation [ 5458.721003] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5458.721861] Exit: dla_enable_operation status=0 [ 5458.722344] Exit: dla_op_programmed [ 5458.722756] Exit: dla_program_operation status=0 [ 5458.723233] Exit: dla_submit_operation [ 5458.723652] Exit: dla_dequeue_operation [ 5458.724088] Exit:dla_op_completion processor Convolution group1 status=0 [ 5458.724747] Exit:dla_handle_events, ret:0 [ 5458.725188] Enter:dla_handle_events, processor:SDP [ 5458.725701] Handle op complete event, processor SDP group 1 [ 5458.726273] Enter:dla_op_completion processor SDP group1 [ 5458.726827] Completed SDP operation index 9 ROI 0 [ 5458.727342] Update dependency operation index 10 ROI 0 DEP_COUNT=1 [ 5458.727936] enable CDP in dla_update_dependency as depdency are resolved [ 5458.728596] Enter: dla_enable_operation [ 5458.729027] Enable CDP operation index 10 ROI 0 [ 5458.729618] Enter: dla_cdp_enable [ 5458.730102] Exit: dla_cdp_enable [ 5458.730483] Enter: dla_op_enabled [ 5458.730880] Exit: dla_op_enabled [ 5458.731259] Exit: dla_enable_operation status=0 [ 5458.731746] 10 HWLs done, totally 30 layers [ 5458.732220] Enter: dla_free_op_desc op desc index 8 ROI 0 [ 5458.733167] Exit: dla_free_op_desc [ 5458.733566] Enter: dla_dequeue_operation [ 5458.734007] Dequeue op from SDP processor, index=15 ROI=0 [ 5458.734541] Enter: dla_submit_operation [ 5458.734979] Prepare SDP operation index 15 ROI 0 dep_count 0 [ 5458.735552] Enter: dla_prepare_operation [ 5458.736113] processor:SDP group:1, rdma_group:0 available [ 5458.736670] Enter: dla_read_config [ 5458.745030] Exit: dla_read_config [ 5458.745422] Exit: dla_prepare_operation status=0 [ 5458.745909] Enter: dla_program_operation [ 5458.746358] Program SDP operation index 15 ROI 0 Group[1] [ 5458.748510] no desc get due to index==-1 [ 5458.749760] no desc get due to index==-1 [ 5458.750190] no desc get due to index==-1 [ 5458.750611] no desc get due to index==-1 [ 5458.751046] Enter: dla_op_programmed [ 5458.751462] Update dependency operation index 17 ROI 0 DEP_COUNT=2 [ 5458.752077] Exit: dla_op_programmed [ 5458.752489] Exit: dla_program_operation status=0 [ 5458.752982] Enter: dla_enable_operation [ 5458.753414] Enable SDP operation index 15 ROI 0 [ 5458.754078] Enter: dla_op_enabled [ 5458.754483] Update dependency operation index 14 ROI 0 DEP_COUNT=2 [ 5458.755094] Exit: dla_op_enabled [ 5458.755473] Exit: dla_enable_operation status=0 [ 5458.755958] Exit: dla_submit_operation [ 5458.756389] Exit: dla_dequeue_operation [ 5458.756845] Enter: dla_free_op_desc op desc index 9 ROI 0 [ 5458.757814] Exit: dla_free_op_desc [ 5458.758224] Exit:dla_op_completion processor SDP group1 status=0 [ 5458.758822] Exit:dla_handle_events, ret:0 [ 5458.759267] Enter:dla_handle_events, processor:PDP [ 5458.759765] Exit:dla_handle_events, ret:0 [ 5458.760196] Enter:dla_handle_events, processor:CDP [ 5458.760712] Exit:dla_handle_events, ret:0 [ 5458.761149] Enter:dla_handle_events, processor:RUBIK [ 5458.761672] Exit:dla_handle_events, ret:0 [ 5458.768632] Enter:dla_handle_events, processor:BDMA [ 5458.769260] Exit:dla_handle_events, ret:0 [ 5458.769742] Enter:dla_handle_events, processor:Convolution [ 5458.770302] Exit:dla_handle_events, ret:0 [ 5458.770748] Enter:dla_handle_events, processor:SDP [ 5458.771264] Exit:dla_handle_events, ret:0 [ 5458.771716] Enter:dla_handle_events, processor:PDP [ 5458.772232] Exit:dla_handle_events, ret:0 [ 5458.772698] Enter:dla_handle_events, processor:CDP [ 5458.773212] Handle op complete event, processor CDP group 1 [ 5458.773867] Enter:dla_op_completion processor CDP group1 [ 5458.774426] Completed CDP operation index 10 ROI 0 [ 5458.774950] Update dependency operation index 11 ROI 0 DEP_COUNT=1 [ 5458.775555] enable PDP in dla_update_dependency as depdency are resolved [ 5458.776203] Enter: dla_enable_operation [ 5458.776658] Enable PDP operation index 11 ROI 0 [ 5458.777145] group id 1 rdma id 1 [ 5458.777650] rdma needed 1 [ 5458.778089] Enter: dla_op_enabled [ 5458.778488] Exit: dla_op_enabled [ 5458.778880] Exit: dla_enable_operation status=0 [ 5458.779371] 11 HWLs done, totally 30 layers [ 5458.779824] Enter: dla_dequeue_operation [ 5458.780266] exit CDP as there's no further operation [ 5458.780786] Exit: dla_dequeue_operation [ 5458.781221] Enter: dla_free_op_desc op desc index 10 ROI 0 [ 5458.783145] Exit: dla_free_op_desc [ 5458.783565] Exit:dla_op_completion processor CDP group1 status=0 [ 5458.784172] Exit:dla_handle_events, ret:0 [ 5458.784617] Enter:dla_handle_events, processor:RUBIK [ 5458.785151] Exit:dla_handle_events, ret:0 [ 5458.821459] Enter:dla_handle_events, processor:BDMA [ 5458.822106] Exit:dla_handle_events, ret:0 [ 5458.822558] Enter:dla_handle_events, processor:Convolution [ 5458.823126] Exit:dla_handle_events, ret:0 [ 5458.823579] Enter:dla_handle_events, processor:SDP [ 5458.824077] Exit:dla_handle_events, ret:0 [ 5458.824517] Enter:dla_handle_events, processor:PDP [ 5458.825036] Exit:dla_handle_events, ret:0 [ 5458.825480] Enter:dla_handle_events, processor:CDP [ 5458.825987] Exit:dla_handle_events, ret:0 [ 5458.826439] Enter:dla_handle_events, processor:RUBIK [ 5458.826948] Exit:dla_handle_events, ret:0 [ 5458.843765] Enter:dla_handle_events, processor:BDMA [ 5458.844400] Exit:dla_handle_events, ret:0 [ 5458.844850] Enter:dla_handle_events, processor:Convolution [ 5458.845407] Exit:dla_handle_events, ret:0 [ 5458.845956] Enter:dla_handle_events, processor:SDP [ 5458.846470] Exit:dla_handle_events, ret:0 [ 5458.846913] Enter:dla_handle_events, processor:PDP [ 5458.847417] Exit:dla_handle_events, ret:0 [ 5458.847856] Enter:dla_handle_events, processor:CDP [ 5458.848361] Exit:dla_handle_events, ret:0 [ 5458.848824] Enter:dla_handle_events, processor:RUBIK [ 5458.849345] Exit:dla_handle_events, ret:0 [ 5458.865147] Enter:dla_handle_events, processor:BDMA [ 5458.865815] Exit:dla_handle_events, ret:0 [ 5458.866266] Enter:dla_handle_events, processor:Convolution [ 5458.866822] Exit:dla_handle_events, ret:0 [ 5458.867273] Enter:dla_handle_events, processor:SDP [ 5458.867777] Exit:dla_handle_events, ret:0 [ 5458.868216] Enter:dla_handle_events, processor:PDP [ 5458.868745] Exit:dla_handle_events, ret:0 [ 5458.869180] Enter:dla_handle_events, processor:CDP [ 5458.869690] Exit:dla_handle_events, ret:0 [ 5458.870137] Enter:dla_handle_events, processor:RUBIK [ 5458.870650] Exit:dla_handle_events, ret:0 [ 5458.882134] Enter:dla_handle_events, processor:BDMA [ 5458.882748] Exit:dla_handle_events, ret:0 [ 5458.883198] Enter:dla_handle_events, processor:Convolution [ 5458.883768] Exit:dla_handle_events, ret:0 [ 5458.884198] Enter:dla_handle_events, processor:SDP [ 5458.884711] Exit:dla_handle_events, ret:0 [ 5458.885151] Enter:dla_handle_events, processor:PDP [ 5458.885682] Handle op complete event, processor PDP group 1 [ 5458.886270] Enter:dla_op_completion processor PDP group1 [ 5458.886810] Completed PDP operation index 11 ROI 0 [ 5458.887340] Update dependency operation index 12 ROI 0 DEP_COUNT=1 [ 5458.887941] enable Convolution in dla_update_dependency as depdency are resolved [ 5458.888685] Enter: dla_enable_operation [ 5458.889127] Enable Convolution operation index 12 ROI 0 [ 5458.890139] Enter: dla_op_enabled [ 5458.890549] Exit: dla_op_enabled [ 5458.890929] Exit: dla_enable_operation status=0 [ 5458.891426] 12 HWLs done, totally 30 layers [ 5458.891891] Enter: dla_dequeue_operation [ 5458.892328] Dequeue op from PDP processor, index=23 ROI=0 [ 5458.892900] Enter: dla_submit_operation [ 5458.893346] Prepare PDP operation index 23 ROI 0 dep_count 1 [ 5458.893920] Enter: dla_prepare_operation [ 5458.894479] processor:PDP group:1, rdma_group:1 available [ 5458.895028] Enter: dla_read_config [ 5458.903015] Exit: dla_read_config [ 5458.903421] Exit: dla_prepare_operation status=0 [ 5458.903907] Enter: dla_program_operation [ 5458.904364] Program PDP operation index 23 ROI 0 Group[1] [ 5458.904930] group id 1 rdma id 1 [ 5458.907129] no desc get due to index==-1 [ 5458.907581] no desc get due to index==-1 [ 5458.908008] no desc get due to index==-1 [ 5458.908439] no desc get due to index==-1 [ 5458.908887] no desc get due to index==-1 [ 5458.909314] no desc get due to index==-1 [ 5458.909750] Enter: dla_op_programmed [ 5458.910157] Exit: dla_op_programmed [ 5458.910566] Exit: dla_program_operation status=0 [ 5458.911057] Exit: dla_submit_operation [ 5458.911483] Exit: dla_dequeue_operation [ 5458.911920] Enter: dla_free_op_desc op desc index 11 ROI 0 [ 5458.912870] Exit: dla_free_op_desc [ 5458.913294] Exit:dla_op_completion processor PDP group1 status=0 [ 5458.913900] Exit:dla_handle_events, ret:0 [ 5458.914346] Enter:dla_handle_events, processor:CDP [ 5458.914851] Exit:dla_handle_events, ret:0 [ 5458.915283] Enter:dla_handle_events, processor:RUBIK [ 5458.915788] Exit:dla_handle_events, ret:0 [ 5458.970395] Enter:dla_handle_events, processor:BDMA [ 5458.971022] Exit:dla_handle_events, ret:0 [ 5458.971481] Enter:dla_handle_events, processor:Convolution [ 5458.972051] Handle cdma data done event, processor Convolution group 0 [ 5458.972705] Exit:dla_handle_events, ret:0 [ 5458.973146] Enter:dla_handle_events, processor:SDP [ 5458.973719] Exit:dla_handle_events, ret:0 [ 5458.974172] Enter:dla_handle_events, processor:PDP [ 5458.974688] Exit:dla_handle_events, ret:0 [ 5458.975139] Enter:dla_handle_events, processor:CDP [ 5458.975655] Exit:dla_handle_events, ret:0 [ 5458.976107] Enter:dla_handle_events, processor:RUBIK [ 5458.976646] Exit:dla_handle_events, ret:0 [ 5459.074363] Enter:dla_handle_events, processor:BDMA [ 5459.075116] Exit:dla_handle_events, ret:0 [ 5459.075659] Enter:dla_handle_events, processor:Convolution [ 5459.076346] Handle cdma weight done event, processor Convolution group 0 [ 5459.077190] Handle op complete event, processor Convolution group 0 [ 5459.078168] Enter:dla_op_completion processor Convolution group0 [ 5459.078911] Completed Convolution operation index 12 ROI 0 [ 5459.079611] 13 HWLs done, totally 30 layers [ 5459.080176] Enter: dla_dequeue_operation [ 5459.080733] Dequeue op from Convolution processor, index=16 ROI=0 [ 5459.081480] Enter: dla_submit_operation [ 5459.082013] Prepare Convolution operation index 16 ROI 0 dep_count 2 [ 5459.082780] Enter: dla_prepare_operation [ 5459.083377] processor:Convolution group:0, rdma_group:0 available [ 5459.084121] Enter: dla_read_config [ 5459.091850] Exit: dla_read_config [ 5459.092336] Exit: dla_prepare_operation status=0 [ 5459.092958] Enter: dla_program_operation [ 5459.093501] Program Convolution operation index 16 ROI 0 Group[0] [ 5459.097202] no desc get due to index==-1 [ 5459.097749] no desc get due to index==-1 [ 5459.098273] no desc get due to index==-1 [ 5459.098797] no desc get due to index==-1 [ 5459.099319] no desc get due to index==-1 [ 5459.099845] Enter: dla_op_programmed [ 5459.100352] Update dependency operation index 18 ROI 0 DEP_COUNT=3 [ 5459.101126] Update dependency operation index 17 ROI 0 DEP_COUNT=1 [ 5459.101881] enable SDP in dla_update_dependency as depdency are resolved [ 5459.102680] Enter: dla_enable_operation [ 5459.103200] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5459.104252] Exit: dla_enable_operation status=0 [ 5459.104854] Exit: dla_op_programmed [ 5459.105344] Exit: dla_program_operation status=0 [ 5459.105942] Exit: dla_submit_operation [ 5459.106458] Exit: dla_dequeue_operation [ 5459.106992] Exit:dla_op_completion processor Convolution group0 status=0 [ 5459.107801] Exit:dla_handle_events, ret:0 [ 5459.108336] Enter:dla_handle_events, processor:SDP [ 5459.108975] Handle op complete event, processor SDP group 0 [ 5459.109675] Enter:dla_op_completion processor SDP group0 [ 5459.110348] Completed SDP operation index 13 ROI 0 [ 5459.110976] Update dependency operation index 14 ROI 0 DEP_COUNT=1 [ 5459.111728] enable Convolution in dla_update_dependency as depdency are resolved [ 5459.112621] Enter: dla_enable_operation [ 5459.113152] Enable Convolution operation index 14 ROI 0 [ 5459.114263] Enter: dla_op_enabled [ 5459.114752] Update dependency operation index 16 ROI 0 DEP_COUNT=2 [ 5459.115506] Exit: dla_op_enabled [ 5459.115972] Exit: dla_enable_operation status=0 [ 5459.116581] 14 HWLs done, totally 30 layers [ 5459.117156] Enter: dla_free_op_desc op desc index 12 ROI 0 [ 5459.119039] Exit: dla_free_op_desc [ 5459.119526] Enter: dla_dequeue_operation [ 5459.120065] Dequeue op from SDP processor, index=17 ROI=0 [ 5459.120756] Enter: dla_submit_operation [ 5459.121291] Prepare SDP operation index 17 ROI 0 dep_count 0 [ 5459.121992] Enter: dla_prepare_operation [ 5459.122630] processor:SDP group:0, rdma_group:1 available [ 5459.123304] Enter: dla_read_config [ 5459.130999] Exit: dla_read_config [ 5459.131486] Exit: dla_prepare_operation status=0 [ 5459.132084] Enter: dla_program_operation [ 5459.132641] Program SDP operation index 17 ROI 0 Group[0] [ 5459.134762] no desc get due to index==-1 [ 5459.136043] no desc get due to index==-1 [ 5459.136587] no desc get due to index==-1 [ 5459.137114] no desc get due to index==-1 [ 5459.137643] Enter: dla_op_programmed [ 5459.138152] Update dependency operation index 19 ROI 0 DEP_COUNT=2 [ 5459.138909] Exit: dla_op_programmed [ 5459.139403] Exit: dla_program_operation status=0 [ 5459.140004] Enter: dla_enable_operation [ 5459.140547] Enable SDP operation index 17 ROI 0 [ 5459.141304] Enter: dla_op_enabled [ 5459.141794] Update dependency operation index 16 ROI 0 DEP_COUNT=1 [ 5459.142549] enable Convolution in dla_update_dependency as depdency are resolved [ 5459.143435] Enter: dla_enable_operation [ 5459.143969] Enable Convolution operation index 16 ROI 0 [ 5459.145078] Enter: dla_op_enabled [ 5459.145559] Exit: dla_op_enabled [ 5459.146022] Exit: dla_enable_operation status=0 [ 5459.146611] Exit: dla_op_enabled [ 5459.147074] Exit: dla_enable_operation status=0 [ 5459.147661] Exit: dla_submit_operation [ 5459.148180] Exit: dla_dequeue_operation [ 5459.148727] Enter: dla_free_op_desc op desc index 13 ROI 0 [ 5459.150583] Exit: dla_free_op_desc [ 5459.151080] Exit:dla_op_completion processor SDP group0 status=0 [ 5459.151823] Exit:dla_handle_events, ret:0 [ 5459.152362] Enter:dla_handle_events, processor:PDP [ 5459.153003] Exit:dla_handle_events, ret:0 [ 5459.153540] Enter:dla_handle_events, processor:CDP [ 5459.154157] Exit:dla_handle_events, ret:0 [ 5459.154694] Enter:dla_handle_events, processor:RUBIK [ 5459.155329] Exit:dla_handle_events, ret:0 [ 5459.162609] Enter:dla_handle_events, processor:BDMA [ 5459.163353] Exit:dla_handle_events, ret:0 [ 5459.163894] Enter:dla_handle_events, processor:Convolution [ 5459.164591] Handle cdma data done event, processor Convolution group 1 [ 5459.165392] Exit:dla_handle_events, ret:0 [ 5459.165967] Enter:dla_handle_events, processor:SDP [ 5459.166585] Exit:dla_handle_events, ret:0 [ 5459.167123] Enter:dla_handle_events, processor:PDP [ 5459.167740] Exit:dla_handle_events, ret:0 [ 5459.168278] Enter:dla_handle_events, processor:CDP [ 5459.168906] Exit:dla_handle_events, ret:0 [ 5459.169443] Enter:dla_handle_events, processor:RUBIK [ 5459.170076] Exit:dla_handle_events, ret:0 [ 5459.274656] Enter:dla_handle_events, processor:BDMA [ 5459.275424] Exit:dla_handle_events, ret:0 [ 5459.275977] Enter:dla_handle_events, processor:Convolution [ 5459.276688] Handle cdma weight done event, processor Convolution group 1 [ 5459.277505] Handle op complete event, processor Convolution group 1 [ 5459.278297] Enter:dla_op_completion processor Convolution group1 [ 5459.279043] Completed Convolution operation index 14 ROI 0 [ 5459.279743] 15 HWLs done, totally 30 layers [ 5459.280305] Enter: dla_dequeue_operation [ 5459.280861] Dequeue op from Convolution processor, index=18 ROI=0 [ 5459.281610] Enter: dla_submit_operation [ 5459.282144] Prepare Convolution operation index 18 ROI 0 dep_count 2 [ 5459.282912] Enter: dla_prepare_operation [ 5459.283512] processor:Convolution group:1, rdma_group:0 available [ 5459.284256] Enter: dla_read_config [ 5459.291995] Exit: dla_read_config [ 5459.292482] Exit: dla_prepare_operation status=0 [ 5459.293095] Enter: dla_program_operation [ 5459.293654] Program Convolution operation index 18 ROI 0 Group[1] [ 5459.297360] no desc get due to index==-1 [ 5459.297905] no desc get due to index==-1 [ 5459.298429] no desc get due to index==-1 [ 5459.298954] no desc get due to index==-1 [ 5459.299479] no desc get due to index==-1 [ 5459.300007] Enter: dla_op_programmed [ 5459.300517] Update dependency operation index 20 ROI 0 DEP_COUNT=3 [ 5459.301291] Update dependency operation index 19 ROI 0 DEP_COUNT=1 [ 5459.302044] enable SDP in dla_update_dependency as depdency are resolved [ 5459.302846] Enter: dla_enable_operation [ 5459.303364] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5459.304415] Exit: dla_enable_operation status=0 [ 5459.305023] Exit: dla_op_programmed [ 5459.305512] Exit: dla_program_operation status=0 [ 5459.306108] Exit: dla_submit_operation [ 5459.306622] Exit: dla_dequeue_operation [ 5459.307156] Exit:dla_op_completion processor Convolution group1 status=0 [ 5459.307960] Handle cdma weight done event, processor Convolution group 0 [ 5459.308784] Handle cdma data done event, processor Convolution group 0 [ 5459.309579] Handle op complete event, processor Convolution group 0 [ 5459.310342] Enter:dla_op_completion processor Convolution group0 [ 5459.311082] Completed Convolution operation index 16 ROI 0 [ 5459.311779] 16 HWLs done, totally 30 layers [ 5459.312335] Enter: dla_dequeue_operation [ 5459.312899] Dequeue op from Convolution processor, index=20 ROI=0 [ 5459.313637] Enter: dla_submit_operation [ 5459.314168] Prepare Convolution operation index 20 ROI 0 dep_count 2 [ 5459.314930] Enter: dla_prepare_operation [ 5459.315521] processor:Convolution group:0, rdma_group:0 available [ 5459.316260] Enter: dla_read_config [ 5459.323825] Exit: dla_read_config [ 5459.324309] Exit: dla_prepare_operation status=0 [ 5459.324921] Enter: dla_program_operation [ 5459.325463] Program Convolution operation index 20 ROI 0 Group[0] [ 5459.329252] no desc get due to index==-1 [ 5459.330192] no desc get due to index==-1 [ 5459.330724] no desc get due to index==-1 [ 5459.331247] no desc get due to index==-1 [ 5459.331775] no desc get due to index==-1 [ 5459.332302] Enter: dla_op_programmed [ 5459.332828] Update dependency operation index 24 ROI 0 DEP_COUNT=4 [ 5459.333593] Update dependency operation index 21 ROI 0 DEP_COUNT=2 [ 5459.334351] Exit: dla_op_programmed [ 5459.334844] Exit: dla_program_operation status=0 [ 5459.335442] Exit: dla_submit_operation [ 5459.335960] Exit: dla_dequeue_operation [ 5459.336495] Exit:dla_op_completion processor Convolution group0 status=0 [ 5459.337315] Exit:dla_handle_events, ret:0 [ 5459.337854] Enter:dla_handle_events, processor:SDP [ 5459.338473] Handle op complete event, processor SDP group 1 [ 5459.339170] Enter:dla_op_completion processor SDP group1 [ 5459.339845] Completed SDP operation index 15 ROI 0 [ 5459.340477] Update dependency operation index 18 ROI 0 DEP_COUNT=2 [ 5459.341250] 17 HWLs done, totally 30 layers [ 5459.341825] Enter: dla_free_op_desc op desc index 14 ROI 0 [ 5459.343773] Exit: dla_free_op_desc [ 5459.344262] Enter: dla_dequeue_operation [ 5459.344818] Dequeue op from SDP processor, index=19 ROI=0 [ 5459.345494] Enter: dla_submit_operation [ 5459.346028] Prepare SDP operation index 19 ROI 0 dep_count 0 [ 5459.346728] Enter: dla_prepare_operation [ 5459.347369] processor:SDP group:1, rdma_group:0 available [ 5459.348044] Enter: dla_read_config [ 5459.356061] Exit: dla_read_config [ 5459.356555] Exit: dla_prepare_operation status=0 [ 5459.357150] Enter: dla_program_operation [ 5459.357695] Program SDP operation index 19 ROI 0 Group[1] [ 5459.359873] no desc get due to index==-1 [ 5459.360413] no desc get due to index==-1 [ 5459.360953] no desc get due to index==-1 [ 5459.361479] no desc get due to index==-1 [ 5459.362007] Enter: dla_op_programmed [ 5459.362515] Update dependency operation index 21 ROI 0 DEP_COUNT=1 [ 5459.363265] enable SDP in dla_update_dependency as depdency are resolved [ 5459.364064] Enter: dla_enable_operation [ 5459.364593] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5459.365646] Exit: dla_enable_operation status=0 [ 5459.366235] Exit: dla_op_programmed [ 5459.366725] Exit: dla_program_operation status=0 [ 5459.367321] Enter: dla_enable_operation [ 5459.367851] Enable SDP operation index 19 ROI 0 [ 5459.368609] Enter: dla_op_enabled [ 5459.369099] Update dependency operation index 18 ROI 0 DEP_COUNT=1 [ 5459.369851] enable Convolution in dla_update_dependency as depdency are resolved [ 5459.370734] Enter: dla_enable_operation [ 5459.371264] Enable Convolution operation index 18 ROI 0 [ 5459.372383] Enter: dla_op_enabled [ 5459.372883] Exit: dla_op_enabled [ 5459.373346] Exit: dla_enable_operation status=0 [ 5459.373932] Exit: dla_op_enabled [ 5459.374572] Exit: dla_enable_operation status=0 [ 5459.375159] Exit: dla_submit_operation [ 5459.375675] Exit: dla_dequeue_operation [ 5459.376208] Enter: dla_free_op_desc op desc index 15 ROI 0 [ 5459.377244] Exit: dla_free_op_desc [ 5459.377741] Exit:dla_op_completion processor SDP group1 status=0 [ 5459.378476] Handle op complete event, processor SDP group 0 [ 5459.379172] Enter:dla_op_completion processor SDP group0 [ 5459.379846] Completed SDP operation index 17 ROI 0 [ 5459.380473] Update dependency operation index 20 ROI 0 DEP_COUNT=2 [ 5459.381250] 18 HWLs done, totally 30 layers [ 5459.381823] Enter: dla_free_op_desc op desc index 16 ROI 0 [ 5459.382888] Exit: dla_free_op_desc [ 5459.383372] Enter: dla_dequeue_operation [ 5459.383911] Dequeue op from SDP processor, index=21 ROI=0 [ 5459.384596] Enter: dla_submit_operation [ 5459.385129] Prepare SDP operation index 21 ROI 0 dep_count 0 [ 5459.385828] Enter: dla_prepare_operation [ 5459.386451] processor:SDP group:0, rdma_group:1 available [ 5459.387126] Enter: dla_read_config [ 5459.395084] Exit: dla_read_config [ 5459.395569] Exit: dla_prepare_operation status=0 [ 5459.396166] Enter: dla_program_operation [ 5459.396723] Program SDP operation index 21 ROI 0 Group[0] [ 5459.398867] no desc get due to index==-1 [ 5459.399405] no desc get due to index==-1 [ 5459.400326] no desc get due to index==-1 [ 5459.400873] no desc get due to index==-1 [ 5459.401405] Enter: dla_op_programmed [ 5459.401914] Update dependency operation index 25 ROI 0 DEP_COUNT=2 [ 5459.402669] Exit: dla_op_programmed [ 5459.403160] Exit: dla_program_operation status=0 [ 5459.403755] Enter: dla_enable_operation [ 5459.404287] Enable SDP operation index 21 ROI 0 [ 5459.405065] Enter: dla_op_enabled [ 5459.405554] Update dependency operation index 20 ROI 0 DEP_COUNT=1 [ 5459.406306] enable Convolution in dla_update_dependency as depdency are resolved [ 5459.407190] Enter: dla_enable_operation [ 5459.407720] Enable Convolution operation index 20 ROI 0 [ 5459.408862] Enter: dla_op_enabled [ 5459.409356] Exit: dla_op_enabled [ 5459.409831] Exit: dla_enable_operation status=0 [ 5459.410442] Exit: dla_op_enabled [ 5459.410917] Exit: dla_enable_operation status=0 [ 5459.411537] Exit: dla_submit_operation [ 5459.412075] Exit: dla_dequeue_operation [ 5459.412638] Enter: dla_free_op_desc op desc index 17 ROI 0 [ 5459.414603] Exit: dla_free_op_desc [ 5459.415117] Exit:dla_op_completion processor SDP group0 status=0 [ 5459.415888] Exit:dla_handle_events, ret:0 [ 5459.416449] Enter:dla_handle_events, processor:PDP [ 5459.417106] Exit:dla_handle_events, ret:0 [ 5459.417668] Enter:dla_handle_events, processor:CDP [ 5459.418309] Exit:dla_handle_events, ret:0 [ 5459.418875] Enter:dla_handle_events, processor:RUBIK [ 5459.419544] Exit:dla_handle_events, ret:0 [ 5459.426382] Enter:dla_handle_events, processor:BDMA [ 5459.427179] Exit:dla_handle_events, ret:0 [ 5459.427754] Enter:dla_handle_events, processor:Convolution [ 5459.428483] Handle cdma data done event, processor Convolution group 1 [ 5459.429329] Exit:dla_handle_events, ret:0 [ 5459.429921] Enter:dla_handle_events, processor:SDP [ 5459.430563] Exit:dla_handle_events, ret:0 [ 5459.431121] Enter:dla_handle_events, processor:PDP [ 5459.431773] Exit:dla_handle_events, ret:0 [ 5459.432335] Enter:dla_handle_events, processor:CDP [ 5459.433004] Exit:dla_handle_events, ret:0 [ 5459.433567] Enter:dla_handle_events, processor:RUBIK [ 5459.434244] Exit:dla_handle_events, ret:0 [ 5459.475164] Enter:dla_handle_events, processor:BDMA [ 5459.475938] Exit:dla_handle_events, ret:0 [ 5459.476493] Enter:dla_handle_events, processor:Convolution [ 5459.477212] Handle cdma weight done event, processor Convolution group 1 [ 5459.478275] Handle op complete event, processor Convolution group 1 [ 5459.479076] Enter:dla_op_completion processor Convolution group1 [ 5459.479848] Completed Convolution operation index 18 ROI 0 [ 5459.480586] 19 HWLs done, totally 30 layers [ 5459.481163] Enter: dla_dequeue_operation [ 5459.481717] Dequeue op from Convolution processor, index=24 ROI=0 [ 5459.482489] Enter: dla_submit_operation [ 5459.483039] Prepare Convolution operation index 24 ROI 0 dep_count 3 [ 5459.483830] Enter: dla_prepare_operation [ 5459.484446] processor:Convolution group:1, rdma_group:0 available [ 5459.485227] Enter: dla_read_config [ 5459.493364] Exit: dla_read_config [ 5459.493872] Exit: dla_prepare_operation status=0 [ 5459.494491] Enter: dla_program_operation [ 5459.495049] Program Convolution operation index 24 ROI 0 Group[1] [ 5459.498986] no desc get due to index==-1 [ 5459.499942] no desc get due to index==-1 [ 5459.500492] no desc get due to index==-1 [ 5459.501040] no desc get due to index==-1 [ 5459.501579] no desc get due to index==-1 [ 5459.502124] Enter: dla_op_programmed [ 5459.502644] Update dependency operation index 26 ROI 0 DEP_COUNT=3 [ 5459.503427] Update dependency operation index 25 ROI 0 DEP_COUNT=1 [ 5459.504204] enable SDP in dla_update_dependency as depdency are resolved [ 5459.505044] Enter: dla_enable_operation [ 5459.505576] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5459.506661] Exit: dla_enable_operation status=0 [ 5459.507267] Exit: dla_op_programmed [ 5459.507770] Exit: dla_program_operation status=0 [ 5459.508386] Exit: dla_submit_operation [ 5459.508924] Exit: dla_dequeue_operation [ 5459.509467] Exit:dla_op_completion processor Convolution group1 status=0 [ 5459.510292] Handle cdma weight done event, processor Convolution group 0 [ 5459.511118] Handle cdma data done event, processor Convolution group 0 [ 5459.511936] Handle op complete event, processor Convolution group 0 [ 5459.512733] Enter:dla_op_completion processor Convolution group0 [ 5459.513502] Completed Convolution operation index 20 ROI 0 [ 5459.514218] 20 HWLs done, totally 30 layers [ 5459.514795] Enter: dla_dequeue_operation [ 5459.515350] Dequeue op from Convolution processor, index=26 ROI=0 [ 5459.516115] Enter: dla_submit_operation [ 5459.516675] Prepare Convolution operation index 26 ROI 0 dep_count 2 [ 5459.517467] Enter: dla_prepare_operation [ 5459.518072] processor:Convolution group:0, rdma_group:0 available [ 5459.518840] Enter: dla_read_config [ 5459.527054] Exit: dla_read_config [ 5459.527561] Exit: dla_prepare_operation status=0 [ 5459.528199] Enter: dla_program_operation [ 5459.528812] Program Convolution operation index 26 ROI 0 Group[0] [ 5459.532774] no desc get due to index==-1 [ 5459.534105] no desc get due to index==-1 [ 5459.534651] no desc get due to index==-1 [ 5459.535191] no desc get due to index==-1 [ 5459.535728] no desc get due to index==-1 [ 5459.536269] Enter: dla_op_programmed [ 5459.536800] Update dependency operation index 28 ROI 0 DEP_COUNT=3 [ 5459.537581] Update dependency operation index 27 ROI 0 DEP_COUNT=2 [ 5459.538357] Exit: dla_op_programmed [ 5459.538863] Exit: dla_program_operation status=0 [ 5459.539484] Exit: dla_submit_operation [ 5459.540015] Exit: dla_dequeue_operation [ 5459.540581] Exit:dla_op_completion processor Convolution group0 status=0 [ 5459.541412] Exit:dla_handle_events, ret:0 [ 5459.541962] Enter:dla_handle_events, processor:SDP [ 5459.542637] Handle op complete event, processor SDP group 1 [ 5459.543356] Enter:dla_op_completion processor SDP group1 [ 5459.544049] Completed SDP operation index 19 ROI 0 [ 5459.544718] Update dependency operation index 22 ROI 0 DEP_COUNT=1 [ 5459.545486] enable PDP in dla_update_dependency as depdency are resolved [ 5459.546284] Enter: dla_enable_operation [ 5459.546815] Enable PDP operation index 22 ROI 0 [ 5459.547410] group id 0 rdma id 0 [ 5459.547975] rdma needed 1 [ 5459.548469] Enter: dla_op_enabled [ 5459.548967] Exit: dla_op_enabled [ 5459.549430] Exit: dla_enable_operation status=0 [ 5459.550031] 21 HWLs done, totally 30 layers [ 5459.550605] Enter: dla_free_op_desc op desc index 18 ROI 0 [ 5459.551673] Exit: dla_free_op_desc [ 5459.552162] Enter: dla_dequeue_operation [ 5459.552713] Dequeue op from SDP processor, index=25 ROI=0 [ 5459.553386] Enter: dla_submit_operation [ 5459.553918] Prepare SDP operation index 25 ROI 0 dep_count 0 [ 5459.554614] Enter: dla_prepare_operation [ 5459.555251] processor:SDP group:1, rdma_group:0 available [ 5459.555917] Enter: dla_read_config [ 5459.563798] Exit: dla_read_config [ 5459.564299] Exit: dla_prepare_operation status=0 [ 5459.564928] Enter: dla_program_operation [ 5459.565479] Program SDP operation index 25 ROI 0 Group[1] [ 5459.567594] no desc get due to index==-1 [ 5459.568135] no desc get due to index==-1 [ 5459.568667] no desc get due to index==-1 [ 5459.569191] no desc get due to index==-1 [ 5459.569717] Enter: dla_op_programmed [ 5459.570223] Update dependency operation index 27 ROI 0 DEP_COUNT=1 [ 5459.570971] enable SDP in dla_update_dependency as depdency are resolved [ 5459.571773] Enter: dla_enable_operation [ 5459.572290] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5459.573351] Exit: dla_enable_operation status=0 [ 5459.573937] Exit: dla_op_programmed [ 5459.574426] Exit: dla_program_operation status=0 [ 5459.575188] Enter: dla_enable_operation [ 5459.575716] Enable SDP operation index 25 ROI 0 [ 5459.576461] Enter: dla_op_enabled [ 5459.576963] Update dependency operation index 24 ROI 0 DEP_COUNT=3 [ 5459.577708] Exit: dla_op_enabled [ 5459.578171] Exit: dla_enable_operation status=0 [ 5459.578754] Exit: dla_submit_operation [ 5459.579268] Exit: dla_dequeue_operation [ 5459.579799] Enter: dla_free_op_desc op desc index 19 ROI 0 [ 5459.580829] Exit: dla_free_op_desc [ 5459.581325] Exit:dla_op_completion processor SDP group1 status=0 [ 5459.582064] Handle op complete event, processor SDP group 0 [ 5459.582760] Enter:dla_op_completion processor SDP group0 [ 5459.583432] Completed SDP operation index 21 ROI 0 [ 5459.584060] Update dependency operation index 23 ROI 0 DEP_COUNT=1 [ 5459.584825] enable PDP in dla_update_dependency as depdency are resolved [ 5459.585623] Enter: dla_enable_operation [ 5459.586151] Enable PDP operation index 23 ROI 0 [ 5459.586745] group id 1 rdma id 1 [ 5459.587295] rdma needed 1 [ 5459.587785] Enter: dla_op_enabled [ 5459.588261] Exit: dla_op_enabled [ 5459.588739] Exit: dla_enable_operation status=0 [ 5459.589335] 22 HWLs done, totally 30 layers [ 5459.589902] Enter: dla_free_op_desc op desc index 20 ROI 0 [ 5459.591767] Exit: dla_free_op_desc [ 5459.592252] Enter: dla_dequeue_operation [ 5459.592802] Dequeue op from SDP processor, index=27 ROI=0 [ 5459.593472] Enter: dla_submit_operation [ 5459.594004] Prepare SDP operation index 27 ROI 0 dep_count 0 [ 5459.594701] Enter: dla_prepare_operation [ 5459.595325] processor:SDP group:0, rdma_group:1 available [ 5459.595996] Enter: dla_read_config [ 5459.603673] Exit: dla_read_config [ 5459.604155] Exit: dla_prepare_operation status=0 [ 5459.604764] Enter: dla_program_operation [ 5459.605305] Program SDP operation index 27 ROI 0 Group[0] [ 5459.607397] no desc get due to index==-1 [ 5459.608320] no desc get due to index==-1 [ 5459.608866] no desc get due to index==-1 [ 5459.609388] no desc get due to index==-1 [ 5459.609916] Enter: dla_op_programmed [ 5459.610425] Update dependency operation index 29 ROI 0 DEP_COUNT=2 [ 5459.611179] Exit: dla_op_programmed [ 5459.611670] Exit: dla_program_operation status=0 [ 5459.612264] Enter: dla_enable_operation [ 5459.612806] Enable SDP operation index 27 ROI 0 [ 5459.613560] Enter: dla_op_enabled [ 5459.614046] Update dependency operation index 26 ROI 0 DEP_COUNT=2 [ 5459.614792] Exit: dla_op_enabled [ 5459.615257] Exit: dla_enable_operation status=0 [ 5459.615847] Exit: dla_submit_operation [ 5459.616361] Exit: dla_dequeue_operation [ 5459.616910] Enter: dla_free_op_desc op desc index 21 ROI 0 [ 5459.618791] Exit: dla_free_op_desc [ 5459.619288] Exit:dla_op_completion processor SDP group0 status=0 [ 5459.620023] Exit:dla_handle_events, ret:0 [ 5459.620570] Enter:dla_handle_events, processor:PDP [ 5459.621185] Exit:dla_handle_events, ret:0 [ 5459.621726] Enter:dla_handle_events, processor:CDP [ 5459.622343] Exit:dla_handle_events, ret:0 [ 5459.622883] Enter:dla_handle_events, processor:RUBIK [ 5459.623515] Exit:dla_handle_events, ret:0 [ 5459.851633] Enter:dla_handle_events, processor:BDMA [ 5459.852406] Exit:dla_handle_events, ret:0 [ 5459.852976] Enter:dla_handle_events, processor:Convolution [ 5459.853698] Exit:dla_handle_events, ret:0 [ 5459.854254] Enter:dla_handle_events, processor:SDP [ 5459.854889] Exit:dla_handle_events, ret:0 [ 5459.855445] Enter:dla_handle_events, processor:PDP [ 5459.856083] Handle op complete event, processor PDP group 0 [ 5459.856821] Enter:dla_op_completion processor PDP group0 [ 5459.857516] Completed PDP operation index 22 ROI 0 [ 5459.858162] Update dependency operation index 24 ROI 0 DEP_COUNT=2 [ 5459.858944] 23 HWLs done, totally 30 layers [ 5459.859520] Enter: dla_dequeue_operation [ 5459.860059] exit PDP as there's no further operation [ 5459.860722] Exit: dla_dequeue_operation [ 5459.861273] Enter: dla_free_op_desc op desc index 22 ROI 0 [ 5459.862382] Exit: dla_free_op_desc [ 5459.862900] Exit:dla_op_completion processor PDP group0 status=0 [ 5459.863655] Handle op complete event, processor PDP group 1 [ 5459.864372] Enter:dla_op_completion processor PDP group1 [ 5459.865083] Completed PDP operation index 23 ROI 0 [ 5459.865724] Update dependency operation index 24 ROI 0 DEP_COUNT=1 [ 5459.866478] enable Convolution in dla_update_dependency as depdency are resolved [ 5459.867359] Enter: dla_enable_operation [ 5459.867889] Enable Convolution operation index 24 ROI 0 [ 5459.869010] Enter: dla_op_enabled [ 5459.869491] Exit: dla_op_enabled [ 5459.869955] Exit: dla_enable_operation status=0 [ 5459.870552] 24 HWLs done, totally 30 layers [ 5459.871111] Enter: dla_dequeue_operation [ 5459.871643] exit PDP as there's no further operation [ 5459.872272] Exit: dla_dequeue_operation [ 5459.872817] Enter: dla_free_op_desc op desc index 23 ROI 0 [ 5459.873879] Exit: dla_free_op_desc [ 5459.874376] Exit:dla_op_completion processor PDP group1 status=0 [ 5459.875114] Exit:dla_handle_events, ret:0 [ 5459.875846] Enter:dla_handle_events, processor:CDP [ 5459.876464] Exit:dla_handle_events, ret:0 [ 5459.877019] Enter:dla_handle_events, processor:RUBIK [ 5459.877653] Exit:dla_handle_events, ret:0 [ 5459.884331] Enter:dla_handle_events, processor:BDMA [ 5459.885094] Exit:dla_handle_events, ret:0 [ 5459.885653] Enter:dla_handle_events, processor:Convolution [ 5459.886343] Handle cdma data done event, processor Convolution group 1 [ 5459.887147] Exit:dla_handle_events, ret:0 [ 5459.887688] Enter:dla_handle_events, processor:SDP [ 5459.888305] Exit:dla_handle_events, ret:0 [ 5459.888859] Enter:dla_handle_events, processor:PDP [ 5459.889473] Exit:dla_handle_events, ret:0 [ 5459.890010] Enter:dla_handle_events, processor:CDP [ 5459.890624] Exit:dla_handle_events, ret:0 [ 5459.891162] Enter:dla_handle_events, processor:RUBIK [ 5459.891798] Exit:dla_handle_events, ret:0 [ 5461.179226] Enter:dla_handle_events, processor:BDMA [ 5461.180008] Exit:dla_handle_events, ret:0 [ 5461.180591] Enter:dla_handle_events, processor:Convolution [ 5461.181297] Handle cdma weight done event, processor Convolution group 1 [ 5461.182462] Handle op complete event, processor Convolution group 1 [ 5461.183251] Enter:dla_op_completion processor Convolution group1 [ 5461.184004] Completed Convolution operation index 24 ROI 0 [ 5461.184721] 25 HWLs done, totally 30 layers [ 5461.185286] Enter: dla_dequeue_operation [ 5461.185827] Dequeue op from Convolution processor, index=28 ROI=0 [ 5461.186576] Enter: dla_submit_operation [ 5461.187110] Prepare Convolution operation index 28 ROI 0 dep_count 2 [ 5461.187879] Enter: dla_prepare_operation [ 5461.188480] processor:Convolution group:1, rdma_group:0 available [ 5461.189249] Enter: dla_read_config [ 5461.197397] Exit: dla_read_config [ 5461.197884] Exit: dla_prepare_operation status=0 [ 5461.198484] Enter: dla_program_operation [ 5461.199027] Program Convolution operation index 28 ROI 0 Group[1] [ 5461.202885] no desc get due to index==-1 [ 5461.203425] no desc get due to index==-1 [ 5461.203952] no desc get due to index==-1 [ 5461.204476] no desc get due to index==-1 [ 5461.205010] no desc get due to index==-1 [ 5461.205533] no desc get due to index==-1 [ 5461.206064] Enter: dla_op_programmed [ 5461.206573] Update dependency operation index 29 ROI 0 DEP_COUNT=1 [ 5461.207319] enable SDP in dla_update_dependency as depdency are resolved [ 5461.208118] Enter: dla_enable_operation [ 5461.208649] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5461.209700] Exit: dla_enable_operation status=0 [ 5461.210290] Exit: dla_op_programmed [ 5461.210779] Exit: dla_program_operation status=0 [ 5461.211376] Exit: dla_submit_operation [ 5461.211889] Exit: dla_dequeue_operation [ 5461.212422] Exit:dla_op_completion processor Convolution group1 status=0 [ 5461.213242] Exit:dla_handle_events, ret:0 [ 5461.213778] Enter:dla_handle_events, processor:SDP [ 5461.214397] Handle op complete event, processor SDP group 1 [ 5461.215095] Enter:dla_op_completion processor SDP group1 [ 5461.215767] Completed SDP operation index 25 ROI 0 [ 5461.216393] Update dependency operation index 26 ROI 0 DEP_COUNT=1 [ 5461.217158] enable Convolution in dla_update_dependency as depdency are resolved [ 5461.218040] Enter: dla_enable_operation [ 5461.218571] Enable Convolution operation index 26 ROI 0 [ 5461.219697] Enter: dla_op_enabled [ 5461.220178] Exit: dla_op_enabled [ 5461.220652] Exit: dla_enable_operation status=0 [ 5461.221249] 26 HWLs done, totally 30 layers [ 5461.221825] Enter: dla_free_op_desc op desc index 24 ROI 0 [ 5461.222905] Exit: dla_free_op_desc [ 5461.223392] Enter: dla_dequeue_operation [ 5461.223928] Dequeue op from SDP processor, index=29 ROI=0 [ 5461.224611] Enter: dla_submit_operation [ 5461.225143] Prepare SDP operation index 29 ROI 0 dep_count 0 [ 5461.225839] Enter: dla_prepare_operation [ 5461.226479] processor:SDP group:1, rdma_group:0 available [ 5461.227150] Enter: dla_read_config [ 5461.235251] Exit: dla_read_config [ 5461.235735] Exit: dla_prepare_operation status=0 [ 5461.236331] Enter: dla_program_operation [ 5461.236891] Program SDP operation index 29 ROI 0 Group[1] [ 5461.239076] no desc get due to index==-1 [ 5461.239614] no desc get due to index==-1 [ 5461.240137] no desc get due to index==-1 [ 5461.240669] no desc get due to index==-1 [ 5461.241193] no desc get due to index==-1 [ 5461.241719] no desc get due to index==-1 [ 5461.242246] Enter: dla_op_programmed [ 5461.242746] Exit: dla_op_programmed [ 5461.243237] Exit: dla_program_operation status=0 [ 5461.243829] Enter: dla_enable_operation [ 5461.244362] Enable SDP operation index 29 ROI 0 [ 5461.245133] Enter: dla_op_enabled [ 5461.245623] Update dependency operation index 28 ROI 0 DEP_COUNT=2 [ 5461.246367] Exit: dla_op_enabled [ 5461.246832] Exit: dla_enable_operation status=0 [ 5461.247417] Exit: dla_submit_operation [ 5461.247931] Exit: dla_dequeue_operation [ 5461.248463] Enter: dla_free_op_desc op desc index 25 ROI 0 [ 5461.249530] Exit: dla_free_op_desc [ 5461.250027] Exit:dla_op_completion processor SDP group1 status=0 [ 5461.250761] Exit:dla_handle_events, ret:0 [ 5461.251297] Enter:dla_handle_events, processor:PDP [ 5461.251917] Exit:dla_handle_events, ret:0 [ 5461.252458] Enter:dla_handle_events, processor:CDP [ 5461.253086] Exit:dla_handle_events, ret:0 [ 5461.253622] Enter:dla_handle_events, processor:RUBIK [ 5461.254253] Exit:dla_handle_events, ret:0 [ 5461.266398] Enter:dla_handle_events, processor:BDMA [ 5461.267140] Exit:dla_handle_events, ret:0 [ 5461.267681] Enter:dla_handle_events, processor:Convolution [ 5461.268367] Handle cdma data done event, processor Convolution group 0 [ 5461.269182] Exit:dla_handle_events, ret:0 [ 5461.269757] Enter:dla_handle_events, processor:SDP [ 5461.270374] Exit:dla_handle_events, ret:0 [ 5461.270909] Enter:dla_handle_events, processor:PDP [ 5461.271526] Exit:dla_handle_events, ret:0 [ 5461.272062] Enter:dla_handle_events, processor:CDP [ 5461.272688] Exit:dla_handle_events, ret:0 [ 5461.273224] Enter:dla_handle_events, processor:RUBIK [ 5461.273857] Exit:dla_handle_events, ret:0 [ 5461.680005] Enter:dla_handle_events, processor:BDMA [ 5461.680776] Exit:dla_handle_events, ret:0 [ 5461.681335] Enter:dla_handle_events, processor:Convolution [ 5461.682309] Handle cdma weight done event, processor Convolution group 0 [ 5461.683155] Handle op complete event, processor Convolution group 0 [ 5461.683931] Enter:dla_op_completion processor Convolution group0 [ 5461.684690] Completed Convolution operation index 26 ROI 0 [ 5461.685394] 27 HWLs done, totally 30 layers [ 5461.685956] Enter: dla_dequeue_operation [ 5461.686485] exit Convolution as there's no further operation [ 5461.687179] Exit: dla_dequeue_operation [ 5461.687713] Exit:dla_op_completion processor Convolution group0 status=0 [ 5461.688519] Exit:dla_handle_events, ret:0 [ 5461.689070] Enter:dla_handle_events, processor:SDP [ 5461.689686] Handle op complete event, processor SDP group 0 [ 5461.690383] Enter:dla_op_completion processor SDP group0 [ 5461.691055] Completed SDP operation index 27 ROI 0 [ 5461.691688] Update dependency operation index 28 ROI 0 DEP_COUNT=1 [ 5461.692439] enable Convolution in dla_update_dependency as depdency are resolved [ 5461.693338] Enter: dla_enable_operation [ 5461.693869] Enable Convolution operation index 28 ROI 0 [ 5461.695000] Enter: dla_op_enabled [ 5461.695482] Exit: dla_op_enabled [ 5461.695947] Exit: dla_enable_operation status=0 [ 5461.696556] 28 HWLs done, totally 30 layers [ 5461.697130] Enter: dla_free_op_desc op desc index 26 ROI 0 [ 5461.699132] Exit: dla_free_op_desc [ 5461.699622] Enter: dla_dequeue_operation [ 5461.700148] exit SDP as there's no further operation [ 5461.700788] Exit: dla_dequeue_operation [ 5461.701322] Enter: dla_free_op_desc op desc index 27 ROI 0 [ 5461.703258] Exit: dla_free_op_desc [ 5461.703756] Exit:dla_op_completion processor SDP group0 status=0 [ 5461.704494] Exit:dla_handle_events, ret:0 [ 5461.705045] Enter:dla_handle_events, processor:PDP [ 5461.705661] Exit:dla_handle_events, ret:0 [ 5461.706201] Enter:dla_handle_events, processor:CDP [ 5461.706817] Exit:dla_handle_events, ret:0 [ 5461.707355] Enter:dla_handle_events, processor:RUBIK [ 5461.707989] Exit:dla_handle_events, ret:0 [ 5461.714385] Enter:dla_handle_events, processor:BDMA [ 5461.715208] Exit:dla_handle_events, ret:0 [ 5461.715823] Enter:dla_handle_events, processor:Convolution [ 5461.716527] Handle cdma data done event, processor Convolution group 1 [ 5461.717362] Exit:dla_handle_events, ret:0 [ 5461.717989] Enter:dla_handle_events, processor:SDP [ 5461.718606] Exit:dla_handle_events, ret:0 [ 5461.719145] Enter:dla_handle_events, processor:PDP [ 5461.719761] Exit:dla_handle_events, ret:0 [ 5461.720299] Enter:dla_handle_events, processor:CDP [ 5461.720934] Exit:dla_handle_events, ret:0 [ 5461.721475] Enter:dla_handle_events, processor:RUBIK [ 5461.722108] Exit:dla_handle_events, ret:0 [ 5461.880328] Enter:dla_handle_events, processor:BDMA [ 5461.881104] Exit:dla_handle_events, ret:0 [ 5461.881668] Enter:dla_handle_events, processor:Convolution [ 5461.882359] Handle cdma weight done event, processor Convolution group 1 [ 5461.883182] Handle op complete event, processor Convolution group 1 [ 5461.883953] Enter:dla_op_completion processor Convolution group1 [ 5461.884713] Completed Convolution operation index 28 ROI 0 [ 5461.885417] 29 HWLs done, totally 30 layers [ 5461.885980] Enter: dla_dequeue_operation [ 5461.886512] exit Convolution as there's no further operation [ 5461.887210] Exit: dla_dequeue_operation [ 5461.887746] Exit:dla_op_completion processor Convolution group1 status=0 [ 5461.888563] Exit:dla_handle_events, ret:0 [ 5461.889104] Enter:dla_handle_events, processor:SDP [ 5461.889722] Handle op complete event, processor SDP group 1 [ 5461.890422] Enter:dla_op_completion processor SDP group1 [ 5461.891096] Completed SDP operation index 29 ROI 0 [ 5461.891730] 30 HWLs done, totally 30 layers [ 5461.892302] Enter: dla_free_op_desc op desc index 28 ROI 0 [ 5461.893422] Exit: dla_free_op_desc [ 5461.893974] Enter: dla_free_op_desc op desc index 29 ROI 0 [ 5461.895028] Exit: dla_free_op_desc [ 5461.895555] Exit:dla_op_completion processor SDP group1 status=0 [ 5461.896293] Exit:dla_handle_events, ret:0 [ 5461.896846] Enter:dla_handle_events, processor:PDP [ 5461.897464] Exit:dla_handle_events, ret:0 [ 5461.898001] Enter:dla_handle_events, processor:CDP [ 5461.898618] Exit:dla_handle_events, ret:0 [ 5461.899157] Enter:dla_handle_events, processor:RUBIK [ 5461.899793] Exit:dla_handle_events, ret:0 [ 5461.907996] reset engine done Test pass
Thanks.
ghost
commented
6 years ago Thanks for logs. I will try to track down why the assertion fails. Let me know if you could give me a clue where to start.
giusecesa4
commented
6 years ago @smsharif1991 which FPGA are you using? At which frequency are you running the test?
@mmaciag I was thinking that maybe it is possible that the "reserved" memory used to run bigger networks is not big enough. I will try this. Did you managed this point?
ghost
commented
6 years ago @giusecesa4 Ok... That was :man_facepalming: kind of issue. Device tree node obviously needs to be set to nvdla,nvdla_2, not nvidia,nvdla_os_initial. Not tested yet but I am 100% sure it will fix the AlexNet problem ;)
![https://assets-cdn.github.com/images/email/message_cards/header.png","avatar_image_url":"https://assets-cdn.github.com/images/email/message_cards/avatar.png","action":{"name":"Open](https://assets-cdn.github.com/images/email/message_cards/header.png","avatar_image_url":"https://assets-cdn.github.com/images/email/message_cards/avatar.png","action":{"name":"Open){kind=link}
static struct nvdla_config nvdla_config_os_initial = {
.atom_size = 32, /// <--- ASSERTION CAUSE
.bdma_enable = true,
.rubik_enable = true,
.weight_compress_support = true,
};
static struct nvdla_config nvdla_config_small = {
.atom_size = 8, /// <--- this is ok
.bdma_enable = false,
.rubik_enable = false,
.weight_compress_support = false,
};
[...]
/* driver probe and init */
static const struct of_device_id nvdla_of_match[] = {
{
.compatible = "nvidia,nvdla_os_initial",
.data = &nvdla_config_os_initial,
},
{
.compatible = "nvidia,nvdla_2",
.data = &nvdla_config_small,
},
{ },
};I was just writing you the same thing. The problem is that I tried to run the AlexNet, the problem of assertion has been solved but it still does not work.
And I also found that if I run all flatbufs tests a lot of times, at a certain point the process stalls in the same way as it does for the AlexNet.
I was wondering if this is related to the amount of memory allocated during the
dma_declare_coherent_memory function, that is taking the reserved memory I am considering. Maybe this memory is too small?
Another issue could be related to the clock of the FPGA. I considered 50MHz, but maybe I should change also the Memory Interface Device Frequency (in the Zynq IP), because the transfer of data maybe is too fast. Did you leave the options about the other clocks as they are?
ghost
commented
6 years ago Tested with 1GB reserved memory. I have disabled traces, and left only that line before assertion.
root@zynq:~# insmod /opt/lib/modules/opendla.ko
[ 21.006490] opendla: loading out-of-tree module taints kernel.
root@zynq:~# ls
drive-test.sh mac_eeprom_config.sh network-test.sh output.dimg run.sh webserver
root@zynq:~# ./run.sh
== FLATBUF tests for nv_small ==
================================
= Run NN/NN_L0_1_small_fbuf
creating new runtime context...
Emulator starting
submitting tasks...
[ 26.622221] conv_surface: line_stride = 8, width = 1, atom_size = 8
[ 26.633989] conv_surface: line_stride = 8, width = 1, atom_size = 8
[ 26.835926] conv_surface: line_stride = 8, width = 1, atom_size = 8
Test pass
root@zynq:~#Unfortunately, even changing the quantity of reserved memory the process still stalls. The problem could be related to the convolution engine, which is the engine stalling (this happens When I run more than one convolution test). Do you have some ideas about this? The memory I reserved is from 0x40000000 and it is wide 0x40000000
ghost
commented
6 years ago @giusecesa4 No idea. I have changed DTSI and worked like a charm. I am also using the same memory region.
@smsharif1991 How can I verify that NN_L0_1_small_fbuf output is correct? I see there are golden data sets, like NN_L0_0_9521de/dla and NN_L0_1_9521df/dla, but is the latter one compatible to _nvsmall? If not could you update the repository with golden data for _nvsmall?
giusecesa4
commented
6 years ago Hi @mmaciag, I have another question about the Vivado design. Did you reserve more than 64K for the CSB part of the NVDLA or did you leave the configurations as they are by considering the default ones?
ghost
commented
6 years ago I reserved 64K. NVDLA engines are aligned to 0x1000 boundary but all fit within those 64K.
giusecesa4
commented
6 years ago @mmaciag I think that the problem is related to the fact that the ISR is not called When running the second convolution test. Which kind of interrupt of the FPGA did you connect to the NVDLA? I used the pl_ps_irq0 , just to be sure it is the same as yours. Thank you
ghost
commented
6 years ago I don't have design opened right now, but I am sure it was irq0. I don't have a clue why it does not work for you but you could quite easily verify if interrupts are working at all:
1) First verify the interrupt handler is correctly registered at all (e.g. cat /proc/interrupts - you should see something related to NVDLA).
2) The NVDLA has module called GLB. It has few registers to control interrupts, something like INTR_MASK, INTR_SET and INTR_STATUS.
3) You can manipulate them using 'devmem'. Just keep in mind that INTR_MASK is reversed (0 - interrupt enabled, 1 - interrupt disabled (or masked)). INTR_SET allows you to force IRQ without actual engine processing. INTR_STATUS obviously keeps the IRQ request, should any bit set to have valid interrupt request. All definitions you can find in KMD source code.
4) You should see counter increase in /proc/interrupts. Such orphaned IRQ might have some side effects to the opendla.ko driver, but at least you will see something is working.
EDIT: 5) If IRQ is correctly handled opendla.ko should by itself clear INTR_STATUS. If not you can do that manually by writing ones to this register.
giusecesa4
commented
6 years ago Hi @mmaciag, thanks for your explanation. In my project I observed that the interrupt is not raised When running the second convolution, that is, the convolution running at GROUP 1. I think the problem could be related to the clock I used for this project. When changing the frequency, I just changed this value:
I changed the divisors of the PL0 in order to obtain a frequency of 33MHz (this is just an example, I also tried with 10, 20 and 50). PL0 is the only clock connected to all the elements of the block diagram. When you changed the frequency of the zynq, did you change ONLY this parameter or also other parameters? In my project ALL the other frequencies are left unchanged.
Then, did you use some clock buffers?
I am sorry, but I am not an expert in Vivado, so a help will be really appreciated.
Thank you
ghost
commented
6 years ago If you think this is a problem with timing, just check the timing report in "Open Implemented Design". WNS should have some good margin and definitely cannot be negative. My rule of thumb is to keep it above 1ns. For 10 MHz clock it's actually hard not to meet timing closure.
I did not use global clock buffers manually, since Vivado infers it pretty well. Unless you forget to disable clock gating in NVDLA. In this case the design is completely unroutable.
The clock frequency you choose in the IP configurator does not need to match any other clock in the system, because Zynq AXI4 ports support clock domain crossing. On larger -2 grade devices I managed to synthesize with 150 MHz and still had WNS around ~2ns . For ZU3EG-1 device it should go up to 90 MHz, but you need to disable CPD or PDP in order to fit the logic.
BTW. Did you try the latest nvdla/hw master?
giusecesa4
commented
6 years ago Without disabling the clock gating I have only a problem of WORST HOLD SLACK, that in any case is very small.
Disabling the clock gating by setting to 1 the VLIB_BYPASS_POWER_CG macro I don't have absolutely any problem with timing closure, even considering a frequency like 100 MHz. The problem is that, while without the VLIB_BYPASS_POWER_CG variable at least all tests run except convolution, by adding this macro I have the same problem of interrupts for ALL tests, even if the timing is met.
I don't have any idea of why this is happening, maybe There is something wrong in the way I created the IPs or the final block diagram.
I tried the last hw master
anakin1028
commented
5 years ago @smsharif1991 @prasshantg @giusecesa4 : is NN_L0_1_small_fbuf alexNet? After running the following command ./nvdla_runtime --loadable NN_L01_small_fbuf --rawdump --normalize 1 --image speedboat.jpg I get an length of output array: 142560 which is not equal to 1000 as the imagenet output?
The image speedboat is referenced in this thread: #16
Also should I have to pre-process the image such that:
ddkkevin
commented
5 years ago I can run all nv_small flatbufs tests successfully on FPGA/zc706 using 32-bit systems and use the rawdump output.dimg got from VP test environment to verify the correctness of FPGA test running.
anakin1028
commented
5 years ago @ddkevin
ddkkevin
commented
5 years ago @anakin1028 I think NN_L0_1_small_fbuf is alexnet like network. DTB file must be modified to reflect your hw info like compatible field and address range etc. Please reference to [thread] (https://github.com/nvdla/hw/issues/110). I implement nv_small on zc706 and run sw on ARM Cortex-A9 which communicate to NVDLA through AXI interface (Data path) and AXI-to-APB bridge (Register path).
anakin1028
commented
5 years ago @ddkevin thanks a lot. Your comment is really helpful. I will take a look about that thread.
robbietoo
commented
5 years ago @smsharif1991 Is NN_L0_1_small_fbuf sanity test ? Changes to --image --normalize --mean values have no effect on the output.dimg. Only --rawdump option always output the same one-dimensional array (length 142560). How to analysis .dimg format file. Is it image file or report? How to read correctly?
ddkkevin
commented
5 years ago For NN_L0_1_small_fbuf sanity test, option --image --normalize --mean have no effect at all because the input tensor is zero.
anakin1028
commented
5 years ago @ddkevin do you mean --image argument has no effect? Since the test is hard coded to zero input tensor?
robbietoo
commented
5 years ago @ddkkevin Thanks for your answer, so it's compiler's problem, which can be solved until nv release nv_small's compiler. NN_L0_1_small_fbuf is just a sanity test?
ddkkevin
commented
5 years ago @anakin1028 I think the input image data is hard coded internally and there is no need to input image data from outside. @robbietoo The problem is not the input tensor being zero but the missing of input image data. Please refer to this thread #84 . Since input tensor is zero, it is the responsibility of the compiler to provide the input image data. However, the compiler just allocates the corresponding memory region while not setting this memory region which is different to NN_L0_1_fbuf in nv_full test.
nookfoo
commented
5 years ago Hi again @mmaciag,
I am running different configurations of nv_small on a Zyng FPGA and am trying to compare runtime performance. In your comment you mentioned that you turned off traces for nvdla kernel module. Do you remember how you turned them off?
I'm interested in this because I believe the flatbuf tests runtime is influenced by debug messages ( around 6s) and would like to reduce them to make runtime performance more comparable.
ghost
commented
5 years ago Hi @nookfoo,
As I remember I just added some #ifdefs around dla_debug/dla_info/dla_warn/dla_error functions in nvdla_core_callbacks.c which I could control easily from Makefile. As I also remember it influenced the driver performance significantly.
nookfoo
commented
5 years ago Thanks, I was able to implement your tip and also experienced significant improvement to run time of the flatbuf tests
honorpeter
commented
5 years ago @giusecesa4 @JunningWu @@nookfoo@ddkkevin
I am trying to run the NN_L0_1_small_fbuf test on the NVDLA small on fpga ZCU102 can't run NN_L0_1_small_fbuf? Has anyone had the same problem? == Tests for nv_small ==
= Run PDP/PDP_L0_0_small_fbuf creating new runtime context... Emulator starting submitting tasks... Shutdown signal received, exiting Test pass = Run CONV/CONV_D_L0_0_small_fbuf creating new runtime context... Emulator starting submitting tasks... Shutdown signal received, exiting Test pass = Run SDP/SDP_X1_L0_0_small_fbuf creating new runtime context... Emulator starting submitting tasks... Shutdown signal received, exiting Test pass = Run CDP/CDP_L0_0_small_fbuf creating new runtime context... Emulator starting submitting tasks... Shutdown signal received, exiting Test pass = Run NN/NN_L0_1_small_fbuf creating new runtime context... Emulator starting submitting tasks
can't continue to run， Did you have the same problem?
honorpeter
commented
5 years ago @HaiqingSun
Hi,
The Alexnet test has a bit long run time, please try to wait for enough time, such as ~6000s. We are working on improve the performance now. If still meet the hang issue, could you please send the test log? thanks a lot!
Best Regards, Haiqing
~6000s? but I wait for 12000s? The process stalls at a certain point and the FPGA stops working.
I am trying to run the NN_L0_1_small_fbuf test on the NVDLA small on fpga ZCU102 can't run NN_L0_1_small_fbuf? Has anyone had the same problem? == Tests for nv_small ==
= Run PDP/PDP_L0_0_small_fbuf creating new runtime context... Emulator starting submitting tasks... Shutdown signal received, exiting Test pass = Run CONV/CONV_D_L0_0_small_fbuf creating new runtime context... Emulator starting submitting tasks... Shutdown signal received, exiting Test pass = Run SDP/SDP_X1_L0_0_small_fbuf creating new runtime context... Emulator starting submitting tasks... Shutdown signal received, exiting Test pass = Run CDP/CDP_L0_0_small_fbuf creating new runtime context... Emulator starting submitting tasks... Shutdown signal received, exiting Test pass = Run NN/NN_L0_1_small_fbuf creating new runtime context... Emulator starting submitting tasks
can't continue to run， Did you have the same problem? What may be the problem?
NicolasWu97
commented
3 years ago 我现在没有打开设计，但我确定它是 irq0。我不知道为什么它对你不起作用，但你可以很容易地验证中断是否正常工作：
- 首先验证中断处理程序是否正确注册（例如
cat /proc/interrupts- 您应该看到与 NVDLA 相关的内容）。- NVDLA 具有称为 GLB 的模块。它很少有寄存器来控制中断，比如 INTR_MASK、INTR_SET 和 INTR_STATUS。
- 您可以使用“devmem”来操作它们。请记住，INTR_MASK 是反向的（0 - 中断启用，1 - 中断禁用（或屏蔽））。INTR_SET 允许您在没有实际引擎处理的情况下强制 IRQ。INTR_STATUS 显然会保留 IRQ 请求，如果任何位设置为具有有效的中断请求。您可以在 KMD 源代码中找到的所有定义。
- 您应该会看到 /proc/interrupts 中的计数器增加。这种孤立的 IRQ 可能会对 opendla.ko 驱动程序产生一些副作用，但至少您会看到某些东西在起作用。
编辑： 5）如果正确处理了 IRQ，opendla.ko 应该自己清除 INTR_STATUS。如果没有，您可以通过将它们写入此寄存器来手动执行此操作。
Can you give the test code for the interruption you mentioned? In addition, I want to know how do you know what each bit segment of each register represents? Did you do it by carefully reading the source code in KMD such as opendla_initial(small).h? Thanks.
nagendra7890
commented
2 years ago Hi @giusecesa4 ,
I ran NN_L0_1_small_fbuf on FPGA and platform and it run successfully. Make sure that your configuration is proper.
Here is the output:
insmod drm.ko
insmod opendla_small.ko
[ 70.747544] opendla: loading out-of-tree module taints kernel. [ 70.767928] reset engine done [ 70.782568] [drm] Initialized nvdla 0.0.0 20171017 for 10200000.nvdla on minor 0
./nvdla_runtime --loadable ../../../NN_L0_1_small_fbuf
creating new runtime context... [ 86.717877] random: crng init done Emulator starting submitting tasks... [ 5457.654370] Enter:dla_read_network_config [ 5457.660334] Exit:dla_read_network_config status=0 [ 5457.661169] Enter: dla_initiate_processors [ 5457.666951] Enter: dla_submit_operation [ 5457.667661] Prepare Convolution operation index 0 ROI 0 dep_count 1 [ 5457.668576] Enter: dla_prepare_operation [ 5457.672678] processor:Convolution group:0, rdma_group:0 available [ 5457.675999] Enter: dla_read_config [ 5457.688025] Exit: dla_read_config [ 5457.688759] Exit: dla_prepare_operation status=0 [ 5457.691837] Enter: dla_program_operation [ 5457.692580] Program Convolution operation index 0 ROI 0 Group[0] [ 5457.704308] no desc get due to index==-1 [ 5457.708056] no desc get due to index==-1 [ 5457.708710] no desc get due to index==-1 [ 5457.709239] no desc get due to index==-1 [ 5457.712651] no desc get due to index==-1 [ 5457.713330] Enter: dla_op_programmed [ 5457.716816] Update dependency operation index 2 ROI 0 DEP_COUNT=2 [ 5457.720138] Update dependency operation index 1 ROI 0 DEP_COUNT=1 [ 5457.721064] enable SDP in dla_update_dependency as depdency are resolved [ 5457.724548] Enter: dla_enable_operation [ 5457.725270] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5457.728937] Exit: dla_enable_operation status=0 [ 5457.732043] Exit: dla_op_programmed [ 5457.732683] Exit: dla_program_operation status=0 [ 5457.733408] Exit: dla_submit_operation [ 5457.737216] Enter: dla_dequeue_operation [ 5457.740263] Dequeue op from Convolution processor, index=2 ROI=0 [ 5457.741352] Enter: dla_submit_operation [ 5457.744447] Prepare Convolution operation index 2 ROI 0 dep_count 1 [ 5457.745315] Enter: dla_prepare_operation [ 5457.748532] processor:Convolution group:1, rdma_group:0 available [ 5457.749424] Enter: dla_read_config [ 5457.762097] Exit: dla_read_config [ 5457.762683] Exit: dla_prepare_operation status=0 [ 5457.763286] Enter: dla_program_operation [ 5457.763835] Program Convolution operation index 2 ROI 0 Group[1] [ 5457.771456] no desc get due to index==-1 [ 5457.772900] no desc get due to index==-1 [ 5457.773436] no desc get due to index==-1 [ 5457.776795] no desc get due to index==-1 [ 5457.777414] no desc get due to index==-1 [ 5457.780475] Enter: dla_op_programmed [ 5457.781096] Update dependency operation index 6 ROI 0 DEP_COUNT=3 [ 5457.784383] Update dependency operation index 3 ROI 0 DEP_COUNT=2 [ 5457.785239] Exit: dla_op_programmed [ 5457.788264] Exit: dla_program_operation status=0 [ 5457.788975] Exit: dla_submit_operation [ 5457.792065] Exit: dla_dequeue_operation [ 5457.792807] Enter: dla_submit_operation [ 5457.793353] Prepare SDP operation index 1 ROI 0 dep_count 0 [ 5457.796871] Enter: dla_prepare_operation [ 5457.799842] processor:SDP group:0, rdma_group:0 available [ 5457.800651] Enter: dla_read_config [ 5457.812217] Exit: dla_read_config [ 5457.813016] Exit: dla_prepare_operation status=0 [ 5457.816045] Enter: dla_program_operation [ 5457.816704] Program SDP operation index 1 ROI 0 Group[0] [ 5457.824702] no desc get due to index==-1 [ 5457.825341] no desc get due to index==-1 [ 5457.828410] no desc get due to index==-1 [ 5457.829482] no desc get due to index==-1 [ 5457.832844] Enter: dla_op_programmed [ 5457.833451] Update dependency operation index 3 ROI 0 DEP_COUNT=1 [ 5457.836757] enable SDP in dla_update_dependency as depdency are resolved [ 5457.839843] Enter: dla_enable_operation [ 5457.840541] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5457.844139] Exit: dla_enable_operation status=0 [ 5457.844847] Exit: dla_op_programmed [ 5457.845343] Exit: dla_program_operation status=0 [ 5457.848803] Enter: dla_enable_operation [ 5457.851760] Enable SDP operation index 1 ROI 0 [ 5457.852935] Enter: dla_op_enabled [ 5457.853467] Update dependency operation index 0 ROI 0 DEP_COUNT=1 [ 5457.857572] enable Convolution in dla_update_dependency as depdency are resolved [ 5457.860927] Enter: dla_enable_operation [ 5457.861479] Enable Convolution operation index 0 ROI 0 [ 5457.865407] Enter: dla_op_enabled [ 5457.868236] Exit: dla_op_enabled [ 5457.868841] Exit: dla_enable_operation status=0 [ 5457.869438] Exit: dla_op_enabled [ 5457.872747] Exit: dla_enable_operation status=0 [ 5457.873454] Exit: dla_submit_operation [ 5457.876543] Enter: dla_dequeue_operation [ 5457.877183] Dequeue op from SDP processor, index=3 ROI=0 [ 5457.880393] Enter: dla_submit_operation [ 5457.881040] Prepare SDP operation index 3 ROI 0 dep_count 0 [ 5457.884260] Enter: dla_prepare_operation [ 5457.888341] processor:SDP group:1, rdma_group:1 available [ 5457.889160] Enter: dla_read_config [ 5457.901152] Exit: dla_read_config [ 5457.902145] Exit: dla_prepare_operation status=0 [ 5457.902755] Enter: dla_program_operation [ 5457.903299] Program SDP operation index 3 ROI 0 Group[1] [ 5457.905315] no desc get due to index==-1 [ 5457.909066] no desc get due to index==-1 [ 5457.912584] no desc get due to index==-1 [ 5457.913198] no desc get due to index==-1 [ 5457.916359] Enter: dla_op_programmed [ 5457.916993] Update dependency operation index 7 ROI 0 DEP_COUNT=2 [ 5457.920273] Exit: dla_op_programmed [ 5457.920883] Exit: dla_program_operation status=0 [ 5457.921485] Enter: dla_enable_operation [ 5457.924982] Enable SDP operation index 3 ROI 0 [ 5457.928034] Enter: dla_op_enabled [ 5457.928637] Update dependency operation index 2 ROI 0 DEP_COUNT=1 [ 5457.929388] enable Convolution in dla_update_dependency as depdency are resolved [ 5457.933380] Enter: dla_enable_operation [ 5457.936236] Enable Convolution operation index 2 ROI 0 [ 5457.937509] Enter: dla_op_enabled [ 5457.940545] Exit: dla_op_enabled [ 5457.941107] Exit: dla_enable_operation status=0 [ 5457.944219] Exit: dla_op_enabled [ 5457.944801] Exit: dla_enable_operation status=0 [ 5457.945388] Exit: dla_submit_operation [ 5457.948737] Exit: dla_dequeue_operation [ 5457.952917] Enter: dla_submit_operation [ 5457.955997] Prepare PDP operation index 5 ROI 0 dep_count 1 [ 5457.956816] Enter: dla_prepare_operation [ 5457.957378] processor:PDP group:0, rdma_group:0 available [ 5457.960770] Enter: dla_read_config [ 5457.972704] Exit: dla_read_config [ 5457.973287] Exit: dla_prepare_operation status=0 [ 5457.976161] Enter: dla_program_operation [ 5457.976718] Program PDP operation index 5 ROI 0 Group[0] [ 5457.977324] group id 0 rdma id 0 [ 5457.986402] no desc get due to index==-1 [ 5457.986950] no desc get due to index==-1 [ 5457.987822] no desc get due to index==-1 [ 5457.988265] no desc get due to index==-1 [ 5457.988704] no desc get due to index==-1 [ 5457.989140] Enter: dla_op_programmed [ 5457.992955] Update dependency operation index 11 ROI 0 DEP_COUNT=2 [ 5457.994100] Exit: dla_op_programmed [ 5457.994512] Exit: dla_program_operation status=0 [ 5457.994988] Exit: dla_submit_operation [ 5457.995423] Enter: dla_dequeue_operation [ 5457.995859] Dequeue op from PDP processor, index=11 ROI=0 [ 5457.996392] Enter: dla_submit_operation [ 5457.996849] Prepare PDP operation index 11 ROI 0 dep_count 1 [ 5457.997410] Enter: dla_prepare_operation [ 5458.003839] processor:PDP group:1, rdma_group:1 available [ 5458.004495] Enter: dla_read_config [ 5458.016291] Exit: dla_read_config [ 5458.016813] Exit: dla_prepare_operation status=0 [ 5458.017311] Enter: dla_program_operation [ 5458.020390] Program PDP operation index 11 ROI 0 Group[1] [ 5458.021053] group id 1 rdma id 1 [ 5458.028069] no desc get due to index==-1 [ 5458.029069] no desc get due to index==-1 [ 5458.032654] no desc get due to index==-1 [ 5458.033211] no desc get due to index==-1 [ 5458.036172] no desc get due to index==-1 [ 5458.036713] Enter: dla_op_programmed [ 5458.037147] Update dependency operation index 22 ROI 0 DEP_COUNT=2 [ 5458.040601] Exit: dla_op_programmed [ 5458.041106] Exit: dla_program_operation status=0 [ 5458.044131] Exit: dla_submit_operation [ 5458.044664] Exit: dla_dequeue_operation [ 5458.045104] Enter: dla_submit_operation [ 5458.045567] Prepare CDP operation index 4 ROI 0 dep_count 2 [ 5458.049282] Enter: dla_prepare_operation [ 5458.052534] processor:CDP group:0, rdma_group:0 available [ 5458.053185] Enter: dla_read_config [ 5458.065396] Exit: dla_read_config [ 5458.066359] Exit: dla_prepare_operation status=0 [ 5458.067060] Enter: dla_program_operation [ 5458.067519] Program CDP operation index 4 ROI 0 Group[0] [ 5458.068332] Enter: dla_cdp_program [ 5458.068610] Enter: processor_cdp_program [ 5458.099755] Exit: processor_cdp_program [ 5458.099892] Exit: dla_cdp_program [ 5458.100460] no desc get due to index==-1 [ 5458.101259] no desc get due to index==-1 [ 5458.104592] no desc get due to index==-1 [ 5458.107755] no desc get due to index==-1 [ 5458.108303] no desc get due to index==-1 [ 5458.108750] Enter: dla_op_programmed [ 5458.109172] Update dependency operation index 10 ROI 0 DEP_COUNT=3 [ 5458.112910] Exit: dla_op_programmed [ 5458.113413] Exit: dla_program_operation status=0 [ 5458.116449] Exit: dla_submit_operation [ 5458.116984] Enter: dla_dequeue_operation [ 5458.117440] Dequeue op from CDP processor, index=10 ROI=0 [ 5458.120843] Enter: dla_submit_operation [ 5458.121384] Prepare CDP operation index 10 ROI 0 dep_count 2 [ 5458.124507] Enter: dla_prepare_operation [ 5458.125187] processor:CDP group:1, rdma_group:1 available [ 5458.128296] Enter: dla_read_config [ 5458.139840] Exit: dla_read_config [ 5458.140333] Exit: dla_prepare_operation status=0 [ 5458.140872] Exit: dla_submit_operation [ 5458.141311] Exit: dla_dequeue_operation [ 5458.144717] Exit: dla_initiate_processors status=0 [ 5458.145573] Enter:dla_handle_events, processor:BDMA [ 5458.146347] Exit:dla_handle_events, ret:0 [ 5458.146891] Enter:dla_handle_events, processor:Convolution [ 5458.147512] Handle cdma weight done event, processor Convolution group 0 [ 5458.148322] Handle cdma data done event, processor Convolution group 0 [ 5458.149099] Handle op complete event, processor Convolution group 0 [ 5458.149849] Enter:dla_op_completion processor Convolution group0 [ 5458.150517] Completed Convolution operation index 0 ROI 0 [ 5458.151346] 1 HWLs done, totally 30 layers [ 5458.152012] Enter: dla_dequeue_operation [ 5458.152476] Dequeue op from Convolution processor, index=6 ROI=0 [ 5458.153087] Enter: dla_submit_operation [ 5458.153530] Prepare Convolution operation index 6 ROI 0 dep_count 2 [ 5458.154166] Enter: dla_prepare_operation [ 5458.154683] processor:Convolution group:0, rdma_group:0 available [ 5458.155292] Enter: dla_read_config [ 5458.163702] Exit: dla_read_config [ 5458.164119] Exit: dla_prepare_operation status=0 [ 5458.164622] Enter: dla_program_operation [ 5458.165073] Program Convolution operation index 6 ROI 0 Group[0] [ 5458.168956] no desc get due to index==-1 [ 5458.169818] no desc get due to index==-1 [ 5458.170257] no desc get due to index==-1 [ 5458.170691] no desc get due to index==-1 [ 5458.171121] no desc get due to index==-1 [ 5458.171564] Enter: dla_op_programmed [ 5458.171997] Update dependency operation index 7 ROI 0 DEP_COUNT=1 [ 5458.172610] enable SDP in dla_update_dependency as depdency are resolved [ 5458.173260] Enter: dla_enable_operation [ 5458.173689] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5458.174568] Exit: dla_enable_operation status=0 [ 5458.175041] Exit: dla_op_programmed [ 5458.175446] Exit: dla_program_operation status=0 [ 5458.175931] Exit: dla_submit_operation [ 5458.176356] Exit: dla_dequeue_operation [ 5458.176885] Exit:dla_op_completion processor Convolution group0 status=0 [ 5458.177658] Handle cdma weight done event, processor Convolution group 1 [ 5458.178339] Handle cdma data done event, processor Convolution group 1 [ 5458.178999] Handle op complete event, processor Convolution group 1 [ 5458.179628] Enter:dla_op_completion processor Convolution group1 [ 5458.180234] Completed Convolution operation index 2 ROI 0 [ 5458.180806] 2 HWLs done, totally 30 layers [ 5458.181265] Enter: dla_dequeue_operation [ 5458.181713] Dequeue op from Convolution processor, index=8 ROI=0 [ 5458.182321] Enter: dla_submit_operation [ 5458.182754] Prepare Convolution operation index 8 ROI 0 dep_count 2 [ 5458.183361] Enter: dla_prepare_operation [ 5458.183863] processor:Convolution group:1, rdma_group:0 available [ 5458.184559] Enter: dla_read_config [ 5458.192871] Exit: dla_read_config [ 5458.193281] Exit: dla_prepare_operation status=0 [ 5458.193773] Enter: dla_program_operation [ 5458.194228] Program Convolution operation index 8 ROI 0 Group[1] [ 5458.198058] no desc get due to index==-1 [ 5458.198931] no desc get due to index==-1 [ 5458.199376] no desc get due to index==-1 [ 5458.199815] no desc get due to index==-1 [ 5458.200241] no desc get due to index==-1 [ 5458.200693] Enter: dla_op_programmed [ 5458.201116] Update dependency operation index 12 ROI 0 DEP_COUNT=3 [ 5458.201738] Update dependency operation index 9 ROI 0 DEP_COUNT=2 [ 5458.202329] Exit: dla_op_programmed [ 5458.202727] Exit: dla_program_operation status=0 [ 5458.203207] Exit: dla_submit_operation [ 5458.203641] Exit: dla_dequeue_operation [ 5458.204084] Exit:dla_op_completion processor Convolution group1 status=0 [ 5458.204760] Exit:dla_handle_events, ret:0 [ 5458.205214] Enter:dla_handle_events, processor:SDP [ 5458.205732] Handle op complete event, processor SDP group 0 [ 5458.206297] Enter:dla_op_completion processor SDP group0 [ 5458.206842] Completed SDP operation index 1 ROI 0 [ 5458.207459] Update dependency operation index 4 ROI 0 DEP_COUNT=2 [ 5458.208083] 3 HWLs done, totally 30 layers [ 5458.208620] Enter: dla_free_op_desc op desc index 0 ROI 0 [ 5458.210027] Exit: dla_free_op_desc [ 5458.210492] Enter: dla_dequeue_operation [ 5458.210939] Dequeue op from SDP processor, index=7 ROI=0 [ 5458.211497] Enter: dla_submit_operation [ 5458.211928] Prepare SDP operation index 7 ROI 0 dep_count 0 [ 5458.212492] Enter: dla_prepare_operation [ 5458.213062] processor:SDP group:0, rdma_group:1 available [ 5458.213621] Enter: dla_read_config [ 5458.221937] Exit: dla_read_config [ 5458.222347] Exit: dla_prepare_operation status=0 [ 5458.222830] Enter: dla_program_operation [ 5458.223281] Program SDP operation index 7 ROI 0 Group[0] [ 5458.225409] no desc get due to index==-1 [ 5458.225853] no desc get due to index==-1 [ 5458.226283] no desc get due to index==-1 [ 5458.226707] no desc get due to index==-1 [ 5458.227144] Enter: dla_op_programmed [ 5458.227556] Update dependency operation index 9 ROI 0 DEP_COUNT=1 [ 5458.228150] enable SDP in dla_update_dependency as depdency are resolved [ 5458.228814] Enter: dla_enable_operation [ 5458.229236] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5458.230097] Exit: dla_enable_operation status=0 [ 5458.230577] Exit: dla_op_programmed [ 5458.230989] Exit: dla_program_operation status=0 [ 5458.231494] Enter: dla_enable_operation [ 5458.231937] Enable SDP operation index 7 ROI 0 [ 5458.232594] Enter: dla_op_enabled [ 5458.233008] Update dependency operation index 6 ROI 0 DEP_COUNT=2 [ 5458.233607] Exit: dla_op_enabled [ 5458.233986] Exit: dla_enable_operation status=0 [ 5458.234461] Exit: dla_submit_operation [ 5458.234888] Exit: dla_dequeue_operation [ 5458.235333] Enter: dla_free_op_desc op desc index 1 ROI 0 [ 5458.237221] Exit: dla_free_op_desc [ 5458.237650] Exit:dla_op_completion processor SDP group0 status=0 [ 5458.238264] Handle op complete event, processor SDP group 1 [ 5458.238838] Enter:dla_op_completion processor SDP group1 [ 5458.239398] Completed SDP operation index 3 ROI 0 [ 5458.239914] Update dependency operation index 4 ROI 0 DEP_COUNT=1 [ 5458.240514] enable CDP in dla_update_dependency as depdency are resolved [ 5458.241189] Enter: dla_enable_operation [ 5458.241619] Enable CDP operation index 4 ROI 0 [ 5458.242267] Enter: dla_cdp_enable [ 5458.242869] Exit: dla_cdp_enable [ 5458.243320] Enter: dla_op_enabled [ 5458.243730] Exit: dla_op_enabled [ 5458.244119] Exit: dla_enable_operation status=0 [ 5458.244622] 4 HWLs done, totally 30 layers [ 5458.245089] Enter: dla_free_op_desc op desc index 2 ROI 0 [ 5458.246971] Exit: dla_free_op_desc [ 5458.247379] Enter: dla_dequeue_operation [ 5458.247823] Dequeue op from SDP processor, index=9 ROI=0 [ 5458.248360] Enter: dla_submit_operation [ 5458.248823] Prepare SDP operation index 9 ROI 0 dep_count 0 [ 5458.249371] Enter: dla_prepare_operation [ 5458.249907] processor:SDP group:1, rdma_group:0 available [ 5458.250472] Enter: dla_read_config [ 5458.258810] Exit: dla_read_config [ 5458.259204] Exit: dla_prepare_operation status=0 [ 5458.259683] Enter: dla_program_operation [ 5458.260119] Program SDP operation index 9 ROI 0 Group[1] [ 5458.262251] no desc get due to index==-1 [ 5458.262711] no desc get due to index==-1 [ 5458.263553] no desc get due to index==-1 [ 5458.263994] no desc get due to index==-1 [ 5458.264418] Enter: dla_op_programmed [ 5458.264852] Update dependency operation index 13 ROI 0 DEP_COUNT=2 [ 5458.265465] Exit: dla_op_programmed [ 5458.265877] Exit: dla_program_operation status=0 [ 5458.266376] Enter: dla_enable_operation [ 5458.266809] Enable SDP operation index 9 ROI 0 [ 5458.267467] Enter: dla_op_enabled [ 5458.267872] Update dependency operation index 8 ROI 0 DEP_COUNT=2 [ 5458.268481] Exit: dla_op_enabled [ 5458.268878] Exit: dla_enable_operation status=0 [ 5458.269376] Exit: dla_submit_operation [ 5458.269815] Exit: dla_dequeue_operation [ 5458.270254] Enter: dla_free_op_desc op desc index 3 ROI 0 [ 5458.271203] Exit: dla_free_op_desc [ 5458.271617] Exit:dla_op_completion processor SDP group1 status=0 [ 5458.272233] Exit:dla_handle_events, ret:0 [ 5458.272719] Enter:dla_handle_events, processor:PDP [ 5458.273230] Exit:dla_handle_events, ret:0 [ 5458.273675] Enter:dla_handle_events, processor:CDP [ 5458.274194] Exit:dla_handle_events, ret:0 [ 5458.274640] Enter:dla_handle_events, processor:RUBIK [ 5458.275162] Exit:dla_handle_events, ret:0 [ 5458.282585] Enter:dla_handle_events, processor:BDMA [ 5458.283212] Exit:dla_handle_events, ret:0 [ 5458.283657] Enter:dla_handle_events, processor:Convolution [ 5458.284204] Exit:dla_handle_events, ret:0 [ 5458.284664] Enter:dla_handle_events, processor:SDP [ 5458.285169] Exit:dla_handle_events, ret:0 [ 5458.285627] Enter:dla_handle_events, processor:PDP [ 5458.286137] Exit:dla_handle_events, ret:0 [ 5458.286575] Enter:dla_handle_events, processor:CDP [ 5458.287080] Handle op complete event, processor CDP group 0 [ 5458.287666] Enter:dla_op_completion processor CDP group0 [ 5458.288215] Completed CDP operation index 4 ROI 0 [ 5458.288735] Update dependency operation index 5 ROI 0 DEP_COUNT=1 [ 5458.289341] enable PDP in dla_update_dependency as depdency are resolved [ 5458.290002] Enter: dla_enable_operation [ 5458.290439] Enable PDP operation index 5 ROI 0 [ 5458.290930] group id 0 rdma id 0 [ 5458.291539] rdma needed 1 [ 5458.292107] Enter: dla_op_enabled [ 5458.292501] Exit: dla_op_enabled [ 5458.292898] Exit: dla_enable_operation status=0 [ 5458.293388] 5 HWLs done, totally 30 layers [ 5458.293946] Enter: dla_program_operation [ 5458.294401] Program CDP operation index 10 ROI 0 Group[1] [ 5458.295061] Enter: dla_cdp_program [ 5458.295207] Enter: processor_cdp_program [ 5458.317664] Exit: processor_cdp_program [ 5458.317708] Exit: dla_cdp_program [ 5458.318142] no desc get due to index==-1 [ 5458.318902] no desc get due to index==-1 [ 5458.319315] no desc get due to index==-1 [ 5458.319740] no desc get due to index==-1 [ 5458.320163] no desc get due to index==-1 [ 5458.320598] no desc get due to index==-1 [ 5458.321022] Enter: dla_op_programmed [ 5458.321419] Exit: dla_op_programmed [ 5458.321818] Exit: dla_program_operation status=0 [ 5458.322348] Enter: dla_dequeue_operation [ 5458.322815] exit CDP as there's no further operation [ 5458.323341] Exit: dla_dequeue_operation [ 5458.323795] Enter: dla_free_op_desc op desc index 4 ROI 0 [ 5458.324754] Exit: dla_free_op_desc [ 5458.325179] Exit:dla_op_completion processor CDP group0 status=0 [ 5458.325794] Exit:dla_handle_events, ret:0 [ 5458.326241] Enter:dla_handle_events, processor:RUBIK [ 5458.326768] Exit:dla_handle_events, ret:0 [ 5458.420900] Enter:dla_handle_events, processor:BDMA [ 5458.421507] Exit:dla_handle_events, ret:0 [ 5458.421976] Enter:dla_handle_events, processor:Convolution [ 5458.422526] Exit:dla_handle_events, ret:0 [ 5458.422962] Enter:dla_handle_events, processor:SDP [ 5458.423470] Exit:dla_handle_events, ret:0 [ 5458.423917] Enter:dla_handle_events, processor:PDP [ 5458.424422] Handle op complete event, processor PDP group 0 [ 5458.425016] Enter:dla_op_completion processor PDP group0 [ 5458.425585] Completed PDP operation index 5 ROI 0 [ 5458.426092] Update dependency operation index 6 ROI 0 DEP_COUNT=1 [ 5458.426692] enable Convolution in dla_update_dependency as depdency are resolved [ 5458.427406] Enter: dla_enable_operation [ 5458.427833] Enable Convolution operation index 6 ROI 0 [ 5458.428878] Enter: dla_op_enabled [ 5458.429282] Update dependency operation index 8 ROI 0 DEP_COUNT=1 [ 5458.429883] enable Convolution in dla_update_dependency as depdency are resolved [ 5458.430608] Enter: dla_enable_operation [ 5458.431037] Enable Convolution operation index 8 ROI 0 [ 5458.432040] Enter: dla_op_enabled [ 5458.432436] Exit: dla_op_enabled [ 5458.432827] Exit: dla_enable_operation status=0 [ 5458.433309] Exit: dla_op_enabled [ 5458.433694] Exit: dla_enable_operation status=0 [ 5458.434195] 6 HWLs done, totally 30 layers [ 5458.434655] Enter: dla_dequeue_operation [ 5458.435098] Dequeue op from PDP processor, index=22 ROI=0 [ 5458.435651] Enter: dla_submit_operation [ 5458.436095] Prepare PDP operation index 22 ROI 0 dep_count 1 [ 5458.436689] Enter: dla_prepare_operation [ 5458.437231] processor:PDP group:0, rdma_group:0 available [ 5458.437782] Enter: dla_read_config [ 5458.446201] Exit: dla_read_config [ 5458.446606] Exit: dla_prepare_operation status=0 [ 5458.447094] Enter: dla_program_operation [ 5458.447548] Program PDP operation index 22 ROI 0 Group[0] [ 5458.448105] group id 0 rdma id 0 [ 5458.450404] no desc get due to index==-1 [ 5458.451267] no desc get due to index==-1 [ 5458.452186] no desc get due to index==-1 [ 5458.452630] no desc get due to index==-1 [ 5458.453060] no desc get due to index==-1 [ 5458.453490] Enter: dla_op_programmed [ 5458.453904] Update dependency operation index 23 ROI 0 DEP_COUNT=2 [ 5458.454512] Exit: dla_op_programmed [ 5458.454917] Exit: dla_program_operation status=0 [ 5458.455408] Exit: dla_submit_operation [ 5458.455827] Exit: dla_dequeue_operation [ 5458.456259] Enter: dla_free_op_desc op desc index 5 ROI 0 [ 5458.458150] Exit: dla_free_op_desc [ 5458.458561] Exit:dla_op_completion processor PDP group0 status=0 [ 5458.459162] Exit:dla_handle_events, ret:0 [ 5458.459603] Enter:dla_handle_events, processor:CDP [ 5458.460113] Exit:dla_handle_events, ret:0 [ 5458.460568] Enter:dla_handle_events, processor:RUBIK [ 5458.461085] Exit:dla_handle_events, ret:0 [ 5458.541301] Enter:dla_handle_events, processor:BDMA [ 5458.541976] Exit:dla_handle_events, ret:0 [ 5458.542429] Enter:dla_handle_events, processor:Convolution [ 5458.543005] Handle cdma data done event, processor Convolution group 0 [ 5458.543656] Exit:dla_handle_events, ret:0 [ 5458.544098] Enter:dla_handle_events, processor:SDP [ 5458.544622] Exit:dla_handle_events, ret:0 [ 5458.545068] Enter:dla_handle_events, processor:PDP [ 5458.545574] Exit:dla_handle_events, ret:0 [ 5458.546016] Enter:dla_handle_events, processor:CDP [ 5458.546520] Exit:dla_handle_events, ret:0 [ 5458.546953] Enter:dla_handle_events, processor:RUBIK [ 5458.547462] Exit:dla_handle_events, ret:0 [ 5458.555244] Enter:dla_handle_events, processor:BDMA [ 5458.555861] Exit:dla_handle_events, ret:0 [ 5458.556308] Enter:dla_handle_events, processor:Convolution [ 5458.556881] Exit:dla_handle_events, ret:0 [ 5458.557320] Enter:dla_handle_events, processor:SDP [ 5458.557851] Exit:dla_handle_events, ret:0 [ 5458.558297] Enter:dla_handle_events, processor:PDP [ 5458.558807] Exit:dla_handle_events, ret:0 [ 5458.559255] Enter:dla_handle_events, processor:CDP [ 5458.559760] Exit:dla_handle_events, ret:0 [ 5458.560198] Enter:dla_handle_events, processor:RUBIK [ 5458.560725] Exit:dla_handle_events, ret:0 [ 5458.568257] Enter:dla_handle_events, processor:BDMA [ 5458.568910] Exit:dla_handle_events, ret:0 [ 5458.569370] Enter:dla_handle_events, processor:Convolution [ 5458.569961] Exit:dla_handle_events, ret:0 [ 5458.570410] Enter:dla_handle_events, processor:SDP [ 5458.570914] Exit:dla_handle_events, ret:0 [ 5458.571353] Enter:dla_handle_events, processor:PDP [ 5458.571857] Exit:dla_handle_events, ret:0 [ 5458.572301] Enter:dla_handle_events, processor:CDP [ 5458.572825] Exit:dla_handle_events, ret:0 [ 5458.573355] Enter:dla_handle_events, processor:RUBIK [ 5458.573878] Exit:dla_handle_events, ret:0 [ 5458.580248] Enter:dla_handle_events, processor:BDMA [ 5458.580885] Exit:dla_handle_events, ret:0 [ 5458.581325] Enter:dla_handle_events, processor:Convolution [ 5458.581945] Handle cdma weight done event, processor Convolution group 0 [ 5458.582608] Handle op complete event, processor Convolution group 0 [ 5458.583234] Enter:dla_op_completion processor Convolution group0 [ 5458.583847] Completed Convolution operation index 6 ROI 0 [ 5458.584415] 7 HWLs done, totally 30 layers [ 5458.584881] Enter: dla_dequeue_operation [ 5458.585338] Dequeue op from Convolution processor, index=12 ROI=0 [ 5458.585950] Enter: dla_submit_operation [ 5458.586381] Prepare Convolution operation index 12 ROI 0 dep_count 2 [ 5458.587003] Enter: dla_prepare_operation [ 5458.587501] processor:Convolution group:0, rdma_group:0 available [ 5458.588099] Enter: dla_read_config [ 5458.596006] Exit: dla_read_config [ 5458.596404] Exit: dla_prepare_operation status=0 [ 5458.596902] Enter: dla_program_operation [ 5458.597345] Program Convolution operation index 12 ROI 0 Group[0] [ 5458.601035] no desc get due to index==-1 [ 5458.601877] no desc get due to index==-1 [ 5458.602308] no desc get due to index==-1 [ 5458.602743] no desc get due to index==-1 [ 5458.603160] no desc get due to index==-1 [ 5458.603580] Enter: dla_op_programmed [ 5458.603991] Update dependency operation index 14 ROI 0 DEP_COUNT=3 [ 5458.604615] Update dependency operation index 13 ROI 0 DEP_COUNT=1 [ 5458.605220] enable SDP in dla_update_dependency as depdency are resolved [ 5458.605851] Enter: dla_enable_operation [ 5458.606281] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5458.607142] Exit: dla_enable_operation status=0 [ 5458.607630] Exit: dla_op_programmed [ 5458.608027] Exit: dla_program_operation status=0 [ 5458.608514] Exit: dla_submit_operation [ 5458.608942] Exit: dla_dequeue_operation [ 5458.609384] Exit:dla_op_completion processor Convolution group0 status=0 [ 5458.610043] Handle cdma data done event, processor Convolution group 1 [ 5458.610684] Exit:dla_handle_events, ret:0 [ 5458.611124] Enter:dla_handle_events, processor:SDP [ 5458.611638] Handle op complete event, processor SDP group 0 [ 5458.612207] Enter:dla_op_completion processor SDP group0 [ 5458.612764] Completed SDP operation index 7 ROI 0 [ 5458.613273] Update dependency operation index 10 ROI 0 DEP_COUNT=2 [ 5458.613890] 8 HWLs done, totally 30 layers [ 5458.614353] Enter: dla_free_op_desc op desc index 6 ROI 0 [ 5458.615271] Exit: dla_free_op_desc [ 5458.615679] Enter: dla_dequeue_operation [ 5458.616115] Dequeue op from SDP processor, index=13 ROI=0 [ 5458.616678] Enter: dla_submit_operation [ 5458.617119] Prepare SDP operation index 13 ROI 0 dep_count 0 [ 5458.617684] Enter: dla_prepare_operation [ 5458.618216] processor:SDP group:0, rdma_group:1 available [ 5458.618761] Enter: dla_read_config [ 5458.626597] Exit: dla_read_config [ 5458.627006] Exit: dla_prepare_operation status=0 [ 5458.627493] Enter: dla_program_operation [ 5458.627934] Program SDP operation index 13 ROI 0 Group[0] [ 5458.629947] no desc get due to index==-1 [ 5458.630768] no desc get due to index==-1 [ 5458.631211] no desc get due to index==-1 [ 5458.631630] no desc get due to index==-1 [ 5458.632052] Enter: dla_op_programmed [ 5458.632468] Update dependency operation index 15 ROI 0 DEP_COUNT=2 [ 5458.633087] Exit: dla_op_programmed [ 5458.633484] Exit: dla_program_operation status=0 [ 5458.633966] Enter: dla_enable_operation [ 5458.634396] Enable SDP operation index 13 ROI 0 [ 5458.635047] Enter: dla_op_enabled [ 5458.635452] Update dependency operation index 12 ROI 0 DEP_COUNT=2 [ 5458.636061] Exit: dla_op_enabled [ 5458.636451] Exit: dla_enable_operation status=0 [ 5458.636952] Exit: dla_submit_operation [ 5458.637383] Exit: dla_dequeue_operation [ 5458.637825] Enter: dla_free_op_desc op desc index 7 ROI 0 [ 5458.639605] Exit: dla_free_op_desc [ 5458.640020] Exit:dla_op_completion processor SDP group0 status=0 [ 5458.640630] Exit:dla_handle_events, ret:0 [ 5458.641057] Enter:dla_handle_events, processor:PDP [ 5458.641568] Exit:dla_handle_events, ret:0 [ 5458.642007] Enter:dla_handle_events, processor:CDP [ 5458.642513] Exit:dla_handle_events, ret:0 [ 5458.642947] Enter:dla_handle_events, processor:RUBIK [ 5458.643469] Exit:dla_handle_events, ret:0 [ 5458.694678] Enter:dla_handle_events, processor:BDMA [ 5458.695310] Exit:dla_handle_events, ret:0 [ 5458.695751] Enter:dla_handle_events, processor:Convolution [ 5458.696308] Handle cdma weight done event, processor Convolution group 1 [ 5458.697000] Handle op complete event, processor Convolution group 1 [ 5458.697648] Enter:dla_op_completion processor Convolution group1 [ 5458.698265] Completed Convolution operation index 8 ROI 0 [ 5458.698827] 9 HWLs done, totally 30 layers [ 5458.699293] Enter: dla_dequeue_operation [ 5458.699739] Dequeue op from Convolution processor, index=14 ROI=0 [ 5458.700342] Enter: dla_submit_operation [ 5458.700794] Prepare Convolution operation index 14 ROI 0 dep_count 2 [ 5458.701415] Enter: dla_prepare_operation [ 5458.701932] processor:Convolution group:1, rdma_group:0 available [ 5458.702535] Enter: dla_read_config [ 5458.710904] Exit: dla_read_config [ 5458.711308] Exit: dla_prepare_operation status=0 [ 5458.711799] Enter: dla_program_operation [ 5458.712255] Program Convolution operation index 14 ROI 0 Group[1] [ 5458.716144] no desc get due to index==-1 [ 5458.717024] no desc get due to index==-1 [ 5458.717459] no desc get due to index==-1 [ 5458.717890] no desc get due to index==-1 [ 5458.718306] no desc get due to index==-1 [ 5458.718728] Enter: dla_op_programmed [ 5458.719140] Update dependency operation index 15 ROI 0 DEP_COUNT=1 [ 5458.719759] enable SDP in dla_update_dependency as depdency are resolved [ 5458.720491] Enter: dla_enable_operation [ 5458.721003] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5458.721861] Exit: dla_enable_operation status=0 [ 5458.722344] Exit: dla_op_programmed [ 5458.722756] Exit: dla_program_operation status=0 [ 5458.723233] Exit: dla_submit_operation [ 5458.723652] Exit: dla_dequeue_operation [ 5458.724088] Exit:dla_op_completion processor Convolution group1 status=0 [ 5458.724747] Exit:dla_handle_events, ret:0 [ 5458.725188] Enter:dla_handle_events, processor:SDP [ 5458.725701] Handle op complete event, processor SDP group 1 [ 5458.726273] Enter:dla_op_completion processor SDP group1 [ 5458.726827] Completed SDP operation index 9 ROI 0 [ 5458.727342] Update dependency operation index 10 ROI 0 DEP_COUNT=1 [ 5458.727936] enable CDP in dla_update_dependency as depdency are resolved [ 5458.728596] Enter: dla_enable_operation [ 5458.729027] Enable CDP operation index 10 ROI 0 [ 5458.729618] Enter: dla_cdp_enable [ 5458.730102] Exit: dla_cdp_enable [ 5458.730483] Enter: dla_op_enabled [ 5458.730880] Exit: dla_op_enabled [ 5458.731259] Exit: dla_enable_operation status=0 [ 5458.731746] 10 HWLs done, totally 30 layers [ 5458.732220] Enter: dla_free_op_desc op desc index 8 ROI 0 [ 5458.733167] Exit: dla_free_op_desc [ 5458.733566] Enter: dla_dequeue_operation [ 5458.734007] Dequeue op from SDP processor, index=15 ROI=0 [ 5458.734541] Enter: dla_submit_operation [ 5458.734979] Prepare SDP operation index 15 ROI 0 dep_count 0 [ 5458.735552] Enter: dla_prepare_operation [ 5458.736113] processor:SDP group:1, rdma_group:0 available [ 5458.736670] Enter: dla_read_config [ 5458.745030] Exit: dla_read_config [ 5458.745422] Exit: dla_prepare_operation status=0 [ 5458.745909] Enter: dla_program_operation [ 5458.746358] Program SDP operation index 15 ROI 0 Group[1] [ 5458.748510] no desc get due to index==-1 [ 5458.749760] no desc get due to index==-1 [ 5458.750190] no desc get due to index==-1 [ 5458.750611] no desc get due to index==-1 [ 5458.751046] Enter: dla_op_programmed [ 5458.751462] Update dependency operation index 17 ROI 0 DEP_COUNT=2 [ 5458.752077] Exit: dla_op_programmed [ 5458.752489] Exit: dla_program_operation status=0 [ 5458.752982] Enter: dla_enable_operation [ 5458.753414] Enable SDP operation index 15 ROI 0 [ 5458.754078] Enter: dla_op_enabled [ 5458.754483] Update dependency operation index 14 ROI 0 DEP_COUNT=2 [ 5458.755094] Exit: dla_op_enabled [ 5458.755473] Exit: dla_enable_operation status=0 [ 5458.755958] Exit: dla_submit_operation [ 5458.756389] Exit: dla_dequeue_operation [ 5458.756845] Enter: dla_free_op_desc op desc index 9 ROI 0 [ 5458.757814] Exit: dla_free_op_desc [ 5458.758224] Exit:dla_op_completion processor SDP group1 status=0 [ 5458.758822] Exit:dla_handle_events, ret:0 [ 5458.759267] Enter:dla_handle_events, processor:PDP [ 5458.759765] Exit:dla_handle_events, ret:0 [ 5458.760196] Enter:dla_handle_events, processor:CDP [ 5458.760712] Exit:dla_handle_events, ret:0 [ 5458.761149] Enter:dla_handle_events, processor:RUBIK [ 5458.761672] Exit:dla_handle_events, ret:0 [ 5458.768632] Enter:dla_handle_events, processor:BDMA [ 5458.769260] Exit:dla_handle_events, ret:0 [ 5458.769742] Enter:dla_handle_events, processor:Convolution [ 5458.770302] Exit:dla_handle_events, ret:0 [ 5458.770748] Enter:dla_handle_events, processor:SDP [ 5458.771264] Exit:dla_handle_events, ret:0 [ 5458.771716] Enter:dla_handle_events, processor:PDP [ 5458.772232] Exit:dla_handle_events, ret:0 [ 5458.772698] Enter:dla_handle_events, processor:CDP [ 5458.773212] Handle op complete event, processor CDP group 1 [ 5458.773867] Enter:dla_op_completion processor CDP group1 [ 5458.774426] Completed CDP operation index 10 ROI 0 [ 5458.774950] Update dependency operation index 11 ROI 0 DEP_COUNT=1 [ 5458.775555] enable PDP in dla_update_dependency as depdency are resolved [ 5458.776203] Enter: dla_enable_operation [ 5458.776658] Enable PDP operation index 11 ROI 0 [ 5458.777145] group id 1 rdma id 1 [ 5458.777650] rdma needed 1 [ 5458.778089] Enter: dla_op_enabled [ 5458.778488] Exit: dla_op_enabled [ 5458.778880] Exit: dla_enable_operation status=0 [ 5458.779371] 11 HWLs done, totally 30 layers [ 5458.779824] Enter: dla_dequeue_operation [ 5458.780266] exit CDP as there's no further operation [ 5458.780786] Exit: dla_dequeue_operation [ 5458.781221] Enter: dla_free_op_desc op desc index 10 ROI 0 [ 5458.783145] Exit: dla_free_op_desc [ 5458.783565] Exit:dla_op_completion processor CDP group1 status=0 [ 5458.784172] Exit:dla_handle_events, ret:0 [ 5458.784617] Enter:dla_handle_events, processor:RUBIK [ 5458.785151] Exit:dla_handle_events, ret:0 [ 5458.821459] Enter:dla_handle_events, processor:BDMA [ 5458.822106] Exit:dla_handle_events, ret:0 [ 5458.822558] Enter:dla_handle_events, processor:Convolution [ 5458.823126] Exit:dla_handle_events, ret:0 [ 5458.823579] Enter:dla_handle_events, processor:SDP [ 5458.824077] Exit:dla_handle_events, ret:0 [ 5458.824517] Enter:dla_handle_events, processor:PDP [ 5458.825036] Exit:dla_handle_events, ret:0 [ 5458.825480] Enter:dla_handle_events, processor:CDP [ 5458.825987] Exit:dla_handle_events, ret:0 [ 5458.826439] Enter:dla_handle_events, processor:RUBIK [ 5458.826948] Exit:dla_handle_events, ret:0 [ 5458.843765] Enter:dla_handle_events, processor:BDMA [ 5458.844400] Exit:dla_handle_events, ret:0 [ 5458.844850] Enter:dla_handle_events, processor:Convolution [ 5458.845407] Exit:dla_handle_events, ret:0 [ 5458.845956] Enter:dla_handle_events, processor:SDP [ 5458.846470] Exit:dla_handle_events, ret:0 [ 5458.846913] Enter:dla_handle_events, processor:PDP [ 5458.847417] Exit:dla_handle_events, ret:0 [ 5458.847856] Enter:dla_handle_events, processor:CDP [ 5458.848361] Exit:dla_handle_events, ret:0 [ 5458.848824] Enter:dla_handle_events, processor:RUBIK [ 5458.849345] Exit:dla_handle_events, ret:0 [ 5458.865147] Enter:dla_handle_events, processor:BDMA [ 5458.865815] Exit:dla_handle_events, ret:0 [ 5458.866266] Enter:dla_handle_events, processor:Convolution [ 5458.866822] Exit:dla_handle_events, ret:0 [ 5458.867273] Enter:dla_handle_events, processor:SDP [ 5458.867777] Exit:dla_handle_events, ret:0 [ 5458.868216] Enter:dla_handle_events, processor:PDP [ 5458.868745] Exit:dla_handle_events, ret:0 [ 5458.869180] Enter:dla_handle_events, processor:CDP [ 5458.869690] Exit:dla_handle_events, ret:0 [ 5458.870137] Enter:dla_handle_events, processor:RUBIK [ 5458.870650] Exit:dla_handle_events, ret:0 [ 5458.882134] Enter:dla_handle_events, processor:BDMA [ 5458.882748] Exit:dla_handle_events, ret:0 [ 5458.883198] Enter:dla_handle_events, processor:Convolution [ 5458.883768] Exit:dla_handle_events, ret:0 [ 5458.884198] Enter:dla_handle_events, processor:SDP [ 5458.884711] Exit:dla_handle_events, ret:0 [ 5458.885151] Enter:dla_handle_events, processor:PDP [ 5458.885682] Handle op complete event, processor PDP group 1 [ 5458.886270] Enter:dla_op_completion processor PDP group1 [ 5458.886810] Completed PDP operation index 11 ROI 0 [ 5458.887340] Update dependency operation index 12 ROI 0 DEP_COUNT=1 [ 5458.887941] enable Convolution in dla_update_dependency as depdency are resolved [ 5458.888685] Enter: dla_enable_operation [ 5458.889127] Enable Convolution operation index 12 ROI 0 [ 5458.890139] Enter: dla_op_enabled [ 5458.890549] Exit: dla_op_enabled [ 5458.890929] Exit: dla_enable_operation status=0 [ 5458.891426] 12 HWLs done, totally 30 layers [ 5458.891891] Enter: dla_dequeue_operation [ 5458.892328] Dequeue op from PDP processor, index=23 ROI=0 [ 5458.892900] Enter: dla_submit_operation [ 5458.893346] Prepare PDP operation index 23 ROI 0 dep_count 1 [ 5458.893920] Enter: dla_prepare_operation [ 5458.894479] processor:PDP group:1, rdma_group:1 available [ 5458.895028] Enter: dla_read_config [ 5458.903015] Exit: dla_read_config [ 5458.903421] Exit: dla_prepare_operation status=0 [ 5458.903907] Enter: dla_program_operation [ 5458.904364] Program PDP operation index 23 ROI 0 Group[1] [ 5458.904930] group id 1 rdma id 1 [ 5458.907129] no desc get due to index==-1 [ 5458.907581] no desc get due to index==-1 [ 5458.908008] no desc get due to index==-1 [ 5458.908439] no desc get due to index==-1 [ 5458.908887] no desc get due to index==-1 [ 5458.909314] no desc get due to index==-1 [ 5458.909750] Enter: dla_op_programmed [ 5458.910157] Exit: dla_op_programmed [ 5458.910566] Exit: dla_program_operation status=0 [ 5458.911057] Exit: dla_submit_operation [ 5458.911483] Exit: dla_dequeue_operation [ 5458.911920] Enter: dla_free_op_desc op desc index 11 ROI 0 [ 5458.912870] Exit: dla_free_op_desc [ 5458.913294] Exit:dla_op_completion processor PDP group1 status=0 [ 5458.913900] Exit:dla_handle_events, ret:0 [ 5458.914346] Enter:dla_handle_events, processor:CDP [ 5458.914851] Exit:dla_handle_events, ret:0 [ 5458.915283] Enter:dla_handle_events, processor:RUBIK [ 5458.915788] Exit:dla_handle_events, ret:0 [ 5458.970395] Enter:dla_handle_events, processor:BDMA [ 5458.971022] Exit:dla_handle_events, ret:0 [ 5458.971481] Enter:dla_handle_events, processor:Convolution [ 5458.972051] Handle cdma data done event, processor Convolution group 0 [ 5458.972705] Exit:dla_handle_events, ret:0 [ 5458.973146] Enter:dla_handle_events, processor:SDP [ 5458.973719] Exit:dla_handle_events, ret:0 [ 5458.974172] Enter:dla_handle_events, processor:PDP [ 5458.974688] Exit:dla_handle_events, ret:0 [ 5458.975139] Enter:dla_handle_events, processor:CDP [ 5458.975655] Exit:dla_handle_events, ret:0 [ 5458.976107] Enter:dla_handle_events, processor:RUBIK [ 5458.976646] Exit:dla_handle_events, ret:0 [ 5459.074363] Enter:dla_handle_events, processor:BDMA [ 5459.075116] Exit:dla_handle_events, ret:0 [ 5459.075659] Enter:dla_handle_events, processor:Convolution [ 5459.076346] Handle cdma weight done event, processor Convolution group 0 [ 5459.077190] Handle op complete event, processor Convolution group 0 [ 5459.078168] Enter:dla_op_completion processor Convolution group0 [ 5459.078911] Completed Convolution operation index 12 ROI 0 [ 5459.079611] 13 HWLs done, totally 30 layers [ 5459.080176] Enter: dla_dequeue_operation [ 5459.080733] Dequeue op from Convolution processor, index=16 ROI=0 [ 5459.081480] Enter: dla_submit_operation [ 5459.082013] Prepare Convolution operation index 16 ROI 0 dep_count 2 [ 5459.082780] Enter: dla_prepare_operation [ 5459.083377] processor:Convolution group:0, rdma_group:0 available [ 5459.084121] Enter: dla_read_config [ 5459.091850] Exit: dla_read_config [ 5459.092336] Exit: dla_prepare_operation status=0 [ 5459.092958] Enter: dla_program_operation [ 5459.093501] Program Convolution operation index 16 ROI 0 Group[0] [ 5459.097202] no desc get due to index==-1 [ 5459.097749] no desc get due to index==-1 [ 5459.098273] no desc get due to index==-1 [ 5459.098797] no desc get due to index==-1 [ 5459.099319] no desc get due to index==-1 [ 5459.099845] Enter: dla_op_programmed [ 5459.100352] Update dependency operation index 18 ROI 0 DEP_COUNT=3 [ 5459.101126] Update dependency operation index 17 ROI 0 DEP_COUNT=1 [ 5459.101881] enable SDP in dla_update_dependency as depdency are resolved [ 5459.102680] Enter: dla_enable_operation [ 5459.103200] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5459.104252] Exit: dla_enable_operation status=0 [ 5459.104854] Exit: dla_op_programmed [ 5459.105344] Exit: dla_program_operation status=0 [ 5459.105942] Exit: dla_submit_operation [ 5459.106458] Exit: dla_dequeue_operation [ 5459.106992] Exit:dla_op_completion processor Convolution group0 status=0 [ 5459.107801] Exit:dla_handle_events, ret:0 [ 5459.108336] Enter:dla_handle_events, processor:SDP [ 5459.108975] Handle op complete event, processor SDP group 0 [ 5459.109675] Enter:dla_op_completion processor SDP group0 [ 5459.110348] Completed SDP operation index 13 ROI 0 [ 5459.110976] Update dependency operation index 14 ROI 0 DEP_COUNT=1 [ 5459.111728] enable Convolution in dla_update_dependency as depdency are resolved [ 5459.112621] Enter: dla_enable_operation [ 5459.113152] Enable Convolution operation index 14 ROI 0 [ 5459.114263] Enter: dla_op_enabled [ 5459.114752] Update dependency operation index 16 ROI 0 DEP_COUNT=2 [ 5459.115506] Exit: dla_op_enabled [ 5459.115972] Exit: dla_enable_operation status=0 [ 5459.116581] 14 HWLs done, totally 30 layers [ 5459.117156] Enter: dla_free_op_desc op desc index 12 ROI 0 [ 5459.119039] Exit: dla_free_op_desc [ 5459.119526] Enter: dla_dequeue_operation [ 5459.120065] Dequeue op from SDP processor, index=17 ROI=0 [ 5459.120756] Enter: dla_submit_operation [ 5459.121291] Prepare SDP operation index 17 ROI 0 dep_count 0 [ 5459.121992] Enter: dla_prepare_operation [ 5459.122630] processor:SDP group:0, rdma_group:1 available [ 5459.123304] Enter: dla_read_config [ 5459.130999] Exit: dla_read_config [ 5459.131486] Exit: dla_prepare_operation status=0 [ 5459.132084] Enter: dla_program_operation [ 5459.132641] Program SDP operation index 17 ROI 0 Group[0] [ 5459.134762] no desc get due to index==-1 [ 5459.136043] no desc get due to index==-1 [ 5459.136587] no desc get due to index==-1 [ 5459.137114] no desc get due to index==-1 [ 5459.137643] Enter: dla_op_programmed [ 5459.138152] Update dependency operation index 19 ROI 0 DEP_COUNT=2 [ 5459.138909] Exit: dla_op_programmed [ 5459.139403] Exit: dla_program_operation status=0 [ 5459.140004] Enter: dla_enable_operation [ 5459.140547] Enable SDP operation index 17 ROI 0 [ 5459.141304] Enter: dla_op_enabled [ 5459.141794] Update dependency operation index 16 ROI 0 DEP_COUNT=1 [ 5459.142549] enable Convolution in dla_update_dependency as depdency are resolved [ 5459.143435] Enter: dla_enable_operation [ 5459.143969] Enable Convolution operation index 16 ROI 0 [ 5459.145078] Enter: dla_op_enabled [ 5459.145559] Exit: dla_op_enabled [ 5459.146022] Exit: dla_enable_operation status=0 [ 5459.146611] Exit: dla_op_enabled [ 5459.147074] Exit: dla_enable_operation status=0 [ 5459.147661] Exit: dla_submit_operation [ 5459.148180] Exit: dla_dequeue_operation [ 5459.148727] Enter: dla_free_op_desc op desc index 13 ROI 0 [ 5459.150583] Exit: dla_free_op_desc [ 5459.151080] Exit:dla_op_completion processor SDP group0 status=0 [ 5459.151823] Exit:dla_handle_events, ret:0 [ 5459.152362] Enter:dla_handle_events, processor:PDP [ 5459.153003] Exit:dla_handle_events, ret:0 [ 5459.153540] Enter:dla_handle_events, processor:CDP [ 5459.154157] Exit:dla_handle_events, ret:0 [ 5459.154694] Enter:dla_handle_events, processor:RUBIK [ 5459.155329] Exit:dla_handle_events, ret:0 [ 5459.162609] Enter:dla_handle_events, processor:BDMA [ 5459.163353] Exit:dla_handle_events, ret:0 [ 5459.163894] Enter:dla_handle_events, processor:Convolution [ 5459.164591] Handle cdma data done event, processor Convolution group 1 [ 5459.165392] Exit:dla_handle_events, ret:0 [ 5459.165967] Enter:dla_handle_events, processor:SDP [ 5459.166585] Exit:dla_handle_events, ret:0 [ 5459.167123] Enter:dla_handle_events, processor:PDP [ 5459.167740] Exit:dla_handle_events, ret:0 [ 5459.168278] Enter:dla_handle_events, processor:CDP [ 5459.168906] Exit:dla_handle_events, ret:0 [ 5459.169443] Enter:dla_handle_events, processor:RUBIK [ 5459.170076] Exit:dla_handle_events, ret:0 [ 5459.274656] Enter:dla_handle_events, processor:BDMA [ 5459.275424] Exit:dla_handle_events, ret:0 [ 5459.275977] Enter:dla_handle_events, processor:Convolution [ 5459.276688] Handle cdma weight done event, processor Convolution group 1 [ 5459.277505] Handle op complete event, processor Convolution group 1 [ 5459.278297] Enter:dla_op_completion processor Convolution group1 [ 5459.279043] Completed Convolution operation index 14 ROI 0 [ 5459.279743] 15 HWLs done, totally 30 layers [ 5459.280305] Enter: dla_dequeue_operation [ 5459.280861] Dequeue op from Convolution processor, index=18 ROI=0 [ 5459.281610] Enter: dla_submit_operation [ 5459.282144] Prepare Convolution operation index 18 ROI 0 dep_count 2 [ 5459.282912] Enter: dla_prepare_operation [ 5459.283512] processor:Convolution group:1, rdma_group:0 available [ 5459.284256] Enter: dla_read_config [ 5459.291995] Exit: dla_read_config [ 5459.292482] Exit: dla_prepare_operation status=0 [ 5459.293095] Enter: dla_program_operation [ 5459.293654] Program Convolution operation index 18 ROI 0 Group[1] [ 5459.297360] no desc get due to index==-1 [ 5459.297905] no desc get due to index==-1 [ 5459.298429] no desc get due to index==-1 [ 5459.298954] no desc get due to index==-1 [ 5459.299479] no desc get due to index==-1 [ 5459.300007] Enter: dla_op_programmed [ 5459.300517] Update dependency operation index 20 ROI 0 DEP_COUNT=3 [ 5459.301291] Update dependency operation index 19 ROI 0 DEP_COUNT=1 [ 5459.302044] enable SDP in dla_update_dependency as depdency are resolved [ 5459.302846] Enter: dla_enable_operation [ 5459.303364] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5459.304415] Exit: dla_enable_operation status=0 [ 5459.305023] Exit: dla_op_programmed [ 5459.305512] Exit: dla_program_operation status=0 [ 5459.306108] Exit: dla_submit_operation [ 5459.306622] Exit: dla_dequeue_operation [ 5459.307156] Exit:dla_op_completion processor Convolution group1 status=0 [ 5459.307960] Handle cdma weight done event, processor Convolution group 0 [ 5459.308784] Handle cdma data done event, processor Convolution group 0 [ 5459.309579] Handle op complete event, processor Convolution group 0 [ 5459.310342] Enter:dla_op_completion processor Convolution group0 [ 5459.311082] Completed Convolution operation index 16 ROI 0 [ 5459.311779] 16 HWLs done, totally 30 layers [ 5459.312335] Enter: dla_dequeue_operation [ 5459.312899] Dequeue op from Convolution processor, index=20 ROI=0 [ 5459.313637] Enter: dla_submit_operation [ 5459.314168] Prepare Convolution operation index 20 ROI 0 dep_count 2 [ 5459.314930] Enter: dla_prepare_operation [ 5459.315521] processor:Convolution group:0, rdma_group:0 available [ 5459.316260] Enter: dla_read_config [ 5459.323825] Exit: dla_read_config [ 5459.324309] Exit: dla_prepare_operation status=0 [ 5459.324921] Enter: dla_program_operation [ 5459.325463] Program Convolution operation index 20 ROI 0 Group[0] [ 5459.329252] no desc get due to index==-1 [ 5459.330192] no desc get due to index==-1 [ 5459.330724] no desc get due to index==-1 [ 5459.331247] no desc get due to index==-1 [ 5459.331775] no desc get due to index==-1 [ 5459.332302] Enter: dla_op_programmed [ 5459.332828] Update dependency operation index 24 ROI 0 DEP_COUNT=4 [ 5459.333593] Update dependency operation index 21 ROI 0 DEP_COUNT=2 [ 5459.334351] Exit: dla_op_programmed [ 5459.334844] Exit: dla_program_operation status=0 [ 5459.335442] Exit: dla_submit_operation [ 5459.335960] Exit: dla_dequeue_operation [ 5459.336495] Exit:dla_op_completion processor Convolution group0 status=0 [ 5459.337315] Exit:dla_handle_events, ret:0 [ 5459.337854] Enter:dla_handle_events, processor:SDP [ 5459.338473] Handle op complete event, processor SDP group 1 [ 5459.339170] Enter:dla_op_completion processor SDP group1 [ 5459.339845] Completed SDP operation index 15 ROI 0 [ 5459.340477] Update dependency operation index 18 ROI 0 DEP_COUNT=2 [ 5459.341250] 17 HWLs done, totally 30 layers [ 5459.341825] Enter: dla_free_op_desc op desc index 14 ROI 0 [ 5459.343773] Exit: dla_free_op_desc [ 5459.344262] Enter: dla_dequeue_operation [ 5459.344818] Dequeue op from SDP processor, index=19 ROI=0 [ 5459.345494] Enter: dla_submit_operation [ 5459.346028] Prepare SDP operation index 19 ROI 0 dep_count 0 [ 5459.346728] Enter: dla_prepare_operation [ 5459.347369] processor:SDP group:1, rdma_group:0 available [ 5459.348044] Enter: dla_read_config [ 5459.356061] Exit: dla_read_config [ 5459.356555] Exit: dla_prepare_operation status=0 [ 5459.357150] Enter: dla_program_operation [ 5459.357695] Program SDP operation index 19 ROI 0 Group[1] [ 5459.359873] no desc get due to index==-1 [ 5459.360413] no desc get due to index==-1 [ 5459.360953] no desc get due to index==-1 [ 5459.361479] no desc get due to index==-1 [ 5459.362007] Enter: dla_op_programmed [ 5459.362515] Update dependency operation index 21 ROI 0 DEP_COUNT=1 [ 5459.363265] enable SDP in dla_update_dependency as depdency are resolved [ 5459.364064] Enter: dla_enable_operation [ 5459.364593] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5459.365646] Exit: dla_enable_operation status=0 [ 5459.366235] Exit: dla_op_programmed [ 5459.366725] Exit: dla_program_operation status=0 [ 5459.367321] Enter: dla_enable_operation [ 5459.367851] Enable SDP operation index 19 ROI 0 [ 5459.368609] Enter: dla_op_enabled [ 5459.369099] Update dependency operation index 18 ROI 0 DEP_COUNT=1 [ 5459.369851] enable Convolution in dla_update_dependency as depdency are resolved [ 5459.370734] Enter: dla_enable_operation [ 5459.371264] Enable Convolution operation index 18 ROI 0 [ 5459.372383] Enter: dla_op_enabled [ 5459.372883] Exit: dla_op_enabled [ 5459.373346] Exit: dla_enable_operation status=0 [ 5459.373932] Exit: dla_op_enabled [ 5459.374572] Exit: dla_enable_operation status=0 [ 5459.375159] Exit: dla_submit_operation [ 5459.375675] Exit: dla_dequeue_operation [ 5459.376208] Enter: dla_free_op_desc op desc index 15 ROI 0 [ 5459.377244] Exit: dla_free_op_desc [ 5459.377741] Exit:dla_op_completion processor SDP group1 status=0 [ 5459.378476] Handle op complete event, processor SDP group 0 [ 5459.379172] Enter:dla_op_completion processor SDP group0 [ 5459.379846] Completed SDP operation index 17 ROI 0 [ 5459.380473] Update dependency operation index 20 ROI 0 DEP_COUNT=2 [ 5459.381250] 18 HWLs done, totally 30 layers [ 5459.381823] Enter: dla_free_op_desc op desc index 16 ROI 0 [ 5459.382888] Exit: dla_free_op_desc [ 5459.383372] Enter: dla_dequeue_operation [ 5459.383911] Dequeue op from SDP processor, index=21 ROI=0 [ 5459.384596] Enter: dla_submit_operation [ 5459.385129] Prepare SDP operation index 21 ROI 0 dep_count 0 [ 5459.385828] Enter: dla_prepare_operation [ 5459.386451] processor:SDP group:0, rdma_group:1 available [ 5459.387126] Enter: dla_read_config [ 5459.395084] Exit: dla_read_config [ 5459.395569] Exit: dla_prepare_operation status=0 [ 5459.396166] Enter: dla_program_operation [ 5459.396723] Program SDP operation index 21 ROI 0 Group[0] [ 5459.398867] no desc get due to index==-1 [ 5459.399405] no desc get due to index==-1 [ 5459.400326] no desc get due to index==-1 [ 5459.400873] no desc get due to index==-1 [ 5459.401405] Enter: dla_op_programmed [ 5459.401914] Update dependency operation index 25 ROI 0 DEP_COUNT=2 [ 5459.402669] Exit: dla_op_programmed [ 5459.403160] Exit: dla_program_operation status=0 [ 5459.403755] Enter: dla_enable_operation [ 5459.404287] Enable SDP operation index 21 ROI 0 [ 5459.405065] Enter: dla_op_enabled [ 5459.405554] Update dependency operation index 20 ROI 0 DEP_COUNT=1 [ 5459.406306] enable Convolution in dla_update_dependency as depdency are resolved [ 5459.407190] Enter: dla_enable_operation [ 5459.407720] Enable Convolution operation index 20 ROI 0 [ 5459.408862] Enter: dla_op_enabled [ 5459.409356] Exit: dla_op_enabled [ 5459.409831] Exit: dla_enable_operation status=0 [ 5459.410442] Exit: dla_op_enabled [ 5459.410917] Exit: dla_enable_operation status=0 [ 5459.411537] Exit: dla_submit_operation [ 5459.412075] Exit: dla_dequeue_operation [ 5459.412638] Enter: dla_free_op_desc op desc index 17 ROI 0 [ 5459.414603] Exit: dla_free_op_desc [ 5459.415117] Exit:dla_op_completion processor SDP group0 status=0 [ 5459.415888] Exit:dla_handle_events, ret:0 [ 5459.416449] Enter:dla_handle_events, processor:PDP [ 5459.417106] Exit:dla_handle_events, ret:0 [ 5459.417668] Enter:dla_handle_events, processor:CDP [ 5459.418309] Exit:dla_handle_events, ret:0 [ 5459.418875] Enter:dla_handle_events, processor:RUBIK [ 5459.419544] Exit:dla_handle_events, ret:0 [ 5459.426382] Enter:dla_handle_events, processor:BDMA [ 5459.427179] Exit:dla_handle_events, ret:0 [ 5459.427754] Enter:dla_handle_events, processor:Convolution [ 5459.428483] Handle cdma data done event, processor Convolution group 1 [ 5459.429329] Exit:dla_handle_events, ret:0 [ 5459.429921] Enter:dla_handle_events, processor:SDP [ 5459.430563] Exit:dla_handle_events, ret:0 [ 5459.431121] Enter:dla_handle_events, processor:PDP [ 5459.431773] Exit:dla_handle_events, ret:0 [ 5459.432335] Enter:dla_handle_events, processor:CDP [ 5459.433004] Exit:dla_handle_events, ret:0 [ 5459.433567] Enter:dla_handle_events, processor:RUBIK [ 5459.434244] Exit:dla_handle_events, ret:0 [ 5459.475164] Enter:dla_handle_events, processor:BDMA [ 5459.475938] Exit:dla_handle_events, ret:0 [ 5459.476493] Enter:dla_handle_events, processor:Convolution [ 5459.477212] Handle cdma weight done event, processor Convolution group 1 [ 5459.478275] Handle op complete event, processor Convolution group 1 [ 5459.479076] Enter:dla_op_completion processor Convolution group1 [ 5459.479848] Completed Convolution operation index 18 ROI 0 [ 5459.480586] 19 HWLs done, totally 30 layers [ 5459.481163] Enter: dla_dequeue_operation [ 5459.481717] Dequeue op from Convolution processor, index=24 ROI=0 [ 5459.482489] Enter: dla_submit_operation [ 5459.483039] Prepare Convolution operation index 24 ROI 0 dep_count 3 [ 5459.483830] Enter: dla_prepare_operation [ 5459.484446] processor:Convolution group:1, rdma_group:0 available [ 5459.485227] Enter: dla_read_config [ 5459.493364] Exit: dla_read_config [ 5459.493872] Exit: dla_prepare_operation status=0 [ 5459.494491] Enter: dla_program_operation [ 5459.495049] Program Convolution operation index 24 ROI 0 Group[1] [ 5459.498986] no desc get due to index==-1 [ 5459.499942] no desc get due to index==-1 [ 5459.500492] no desc get due to index==-1 [ 5459.501040] no desc get due to index==-1 [ 5459.501579] no desc get due to index==-1 [ 5459.502124] Enter: dla_op_programmed [ 5459.502644] Update dependency operation index 26 ROI 0 DEP_COUNT=3 [ 5459.503427] Update dependency operation index 25 ROI 0 DEP_COUNT=1 [ 5459.504204] enable SDP in dla_update_dependency as depdency are resolved [ 5459.505044] Enter: dla_enable_operation [ 5459.505576] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5459.506661] Exit: dla_enable_operation status=0 [ 5459.507267] Exit: dla_op_programmed [ 5459.507770] Exit: dla_program_operation status=0 [ 5459.508386] Exit: dla_submit_operation [ 5459.508924] Exit: dla_dequeue_operation [ 5459.509467] Exit:dla_op_completion processor Convolution group1 status=0 [ 5459.510292] Handle cdma weight done event, processor Convolution group 0 [ 5459.511118] Handle cdma data done event, processor Convolution group 0 [ 5459.511936] Handle op complete event, processor Convolution group 0 [ 5459.512733] Enter:dla_op_completion processor Convolution group0 [ 5459.513502] Completed Convolution operation index 20 ROI 0 [ 5459.514218] 20 HWLs done, totally 30 layers [ 5459.514795] Enter: dla_dequeue_operation [ 5459.515350] Dequeue op from Convolution processor, index=26 ROI=0 [ 5459.516115] Enter: dla_submit_operation [ 5459.516675] Prepare Convolution operation index 26 ROI 0 dep_count 2 [ 5459.517467] Enter: dla_prepare_operation [ 5459.518072] processor:Convolution group:0, rdma_group:0 available [ 5459.518840] Enter: dla_read_config [ 5459.527054] Exit: dla_read_config [ 5459.527561] Exit: dla_prepare_operation status=0 [ 5459.528199] Enter: dla_program_operation [ 5459.528812] Program Convolution operation index 26 ROI 0 Group[0] [ 5459.532774] no desc get due to index==-1 [ 5459.534105] no desc get due to index==-1 [ 5459.534651] no desc get due to index==-1 [ 5459.535191] no desc get due to index==-1 [ 5459.535728] no desc get due to index==-1 [ 5459.536269] Enter: dla_op_programmed [ 5459.536800] Update dependency operation index 28 ROI 0 DEP_COUNT=3 [ 5459.537581] Update dependency operation index 27 ROI 0 DEP_COUNT=2 [ 5459.538357] Exit: dla_op_programmed [ 5459.538863] Exit: dla_program_operation status=0 [ 5459.539484] Exit: dla_submit_operation [ 5459.540015] Exit: dla_dequeue_operation [ 5459.540581] Exit:dla_op_completion processor Convolution group0 status=0 [ 5459.541412] Exit:dla_handle_events, ret:0 [ 5459.541962] Enter:dla_handle_events, processor:SDP [ 5459.542637] Handle op complete event, processor SDP group 1 [ 5459.543356] Enter:dla_op_completion processor SDP group1 [ 5459.544049] Completed SDP operation index 19 ROI 0 [ 5459.544718] Update dependency operation index 22 ROI 0 DEP_COUNT=1 [ 5459.545486] enable PDP in dla_update_dependency as depdency are resolved [ 5459.546284] Enter: dla_enable_operation [ 5459.546815] Enable PDP operation index 22 ROI 0 [ 5459.547410] group id 0 rdma id 0 [ 5459.547975] rdma needed 1 [ 5459.548469] Enter: dla_op_enabled [ 5459.548967] Exit: dla_op_enabled [ 5459.549430] Exit: dla_enable_operation status=0 [ 5459.550031] 21 HWLs done, totally 30 layers [ 5459.550605] Enter: dla_free_op_desc op desc index 18 ROI 0 [ 5459.551673] Exit: dla_free_op_desc [ 5459.552162] Enter: dla_dequeue_operation [ 5459.552713] Dequeue op from SDP processor, index=25 ROI=0 [ 5459.553386] Enter: dla_submit_operation [ 5459.553918] Prepare SDP operation index 25 ROI 0 dep_count 0 [ 5459.554614] Enter: dla_prepare_operation [ 5459.555251] processor:SDP group:1, rdma_group:0 available [ 5459.555917] Enter: dla_read_config [ 5459.563798] Exit: dla_read_config [ 5459.564299] Exit: dla_prepare_operation status=0 [ 5459.564928] Enter: dla_program_operation [ 5459.565479] Program SDP operation index 25 ROI 0 Group[1] [ 5459.567594] no desc get due to index==-1 [ 5459.568135] no desc get due to index==-1 [ 5459.568667] no desc get due to index==-1 [ 5459.569191] no desc get due to index==-1 [ 5459.569717] Enter: dla_op_programmed [ 5459.570223] Update dependency operation index 27 ROI 0 DEP_COUNT=1 [ 5459.570971] enable SDP in dla_update_dependency as depdency are resolved [ 5459.571773] Enter: dla_enable_operation [ 5459.572290] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5459.573351] Exit: dla_enable_operation status=0 [ 5459.573937] Exit: dla_op_programmed [ 5459.574426] Exit: dla_program_operation status=0 [ 5459.575188] Enter: dla_enable_operation [ 5459.575716] Enable SDP operation index 25 ROI 0 [ 5459.576461] Enter: dla_op_enabled [ 5459.576963] Update dependency operation index 24 ROI 0 DEP_COUNT=3 [ 5459.577708] Exit: dla_op_enabled [ 5459.578171] Exit: dla_enable_operation status=0 [ 5459.578754] Exit: dla_submit_operation [ 5459.579268] Exit: dla_dequeue_operation [ 5459.579799] Enter: dla_free_op_desc op desc index 19 ROI 0 [ 5459.580829] Exit: dla_free_op_desc [ 5459.581325] Exit:dla_op_completion processor SDP group1 status=0 [ 5459.582064] Handle op complete event, processor SDP group 0 [ 5459.582760] Enter:dla_op_completion processor SDP group0 [ 5459.583432] Completed SDP operation index 21 ROI 0 [ 5459.584060] Update dependency operation index 23 ROI 0 DEP_COUNT=1 [ 5459.584825] enable PDP in dla_update_dependency as depdency are resolved [ 5459.585623] Enter: dla_enable_operation [ 5459.586151] Enable PDP operation index 23 ROI 0 [ 5459.586745] group id 1 rdma id 1 [ 5459.587295] rdma needed 1 [ 5459.587785] Enter: dla_op_enabled [ 5459.588261] Exit: dla_op_enabled [ 5459.588739] Exit: dla_enable_operation status=0 [ 5459.589335] 22 HWLs done, totally 30 layers [ 5459.589902] Enter: dla_free_op_desc op desc index 20 ROI 0 [ 5459.591767] Exit: dla_free_op_desc [ 5459.592252] Enter: dla_dequeue_operation [ 5459.592802] Dequeue op from SDP processor, index=27 ROI=0 [ 5459.593472] Enter: dla_submit_operation [ 5459.594004] Prepare SDP operation index 27 ROI 0 dep_count 0 [ 5459.594701] Enter: dla_prepare_operation [ 5459.595325] processor:SDP group:0, rdma_group:1 available [ 5459.595996] Enter: dla_read_config [ 5459.603673] Exit: dla_read_config [ 5459.604155] Exit: dla_prepare_operation status=0 [ 5459.604764] Enter: dla_program_operation [ 5459.605305] Program SDP operation index 27 ROI 0 Group[0] [ 5459.607397] no desc get due to index==-1 [ 5459.608320] no desc get due to index==-1 [ 5459.608866] no desc get due to index==-1 [ 5459.609388] no desc get due to index==-1 [ 5459.609916] Enter: dla_op_programmed [ 5459.610425] Update dependency operation index 29 ROI 0 DEP_COUNT=2 [ 5459.611179] Exit: dla_op_programmed [ 5459.611670] Exit: dla_program_operation status=0 [ 5459.612264] Enter: dla_enable_operation [ 5459.612806] Enable SDP operation index 27 ROI 0 [ 5459.613560] Enter: dla_op_enabled [ 5459.614046] Update dependency operation index 26 ROI 0 DEP_COUNT=2 [ 5459.614792] Exit: dla_op_enabled [ 5459.615257] Exit: dla_enable_operation status=0 [ 5459.615847] Exit: dla_submit_operation [ 5459.616361] Exit: dla_dequeue_operation [ 5459.616910] Enter: dla_free_op_desc op desc index 21 ROI 0 [ 5459.618791] Exit: dla_free_op_desc [ 5459.619288] Exit:dla_op_completion processor SDP group0 status=0 [ 5459.620023] Exit:dla_handle_events, ret:0 [ 5459.620570] Enter:dla_handle_events, processor:PDP [ 5459.621185] Exit:dla_handle_events, ret:0 [ 5459.621726] Enter:dla_handle_events, processor:CDP [ 5459.622343] Exit:dla_handle_events, ret:0 [ 5459.622883] Enter:dla_handle_events, processor:RUBIK [ 5459.623515] Exit:dla_handle_events, ret:0 [ 5459.851633] Enter:dla_handle_events, processor:BDMA [ 5459.852406] Exit:dla_handle_events, ret:0 [ 5459.852976] Enter:dla_handle_events, processor:Convolution [ 5459.853698] Exit:dla_handle_events, ret:0 [ 5459.854254] Enter:dla_handle_events, processor:SDP [ 5459.854889] Exit:dla_handle_events, ret:0 [ 5459.855445] Enter:dla_handle_events, processor:PDP [ 5459.856083] Handle op complete event, processor PDP group 0 [ 5459.856821] Enter:dla_op_completion processor PDP group0 [ 5459.857516] Completed PDP operation index 22 ROI 0 [ 5459.858162] Update dependency operation index 24 ROI 0 DEP_COUNT=2 [ 5459.858944] 23 HWLs done, totally 30 layers [ 5459.859520] Enter: dla_dequeue_operation [ 5459.860059] exit PDP as there's no further operation [ 5459.860722] Exit: dla_dequeue_operation [ 5459.861273] Enter: dla_free_op_desc op desc index 22 ROI 0 [ 5459.862382] Exit: dla_free_op_desc [ 5459.862900] Exit:dla_op_completion processor PDP group0 status=0 [ 5459.863655] Handle op complete event, processor PDP group 1 [ 5459.864372] Enter:dla_op_completion processor PDP group1 [ 5459.865083] Completed PDP operation index 23 ROI 0 [ 5459.865724] Update dependency operation index 24 ROI 0 DEP_COUNT=1 [ 5459.866478] enable Convolution in dla_update_dependency as depdency are resolved [ 5459.867359] Enter: dla_enable_operation [ 5459.867889] Enable Convolution operation index 24 ROI 0 [ 5459.869010] Enter: dla_op_enabled [ 5459.869491] Exit: dla_op_enabled [ 5459.869955] Exit: dla_enable_operation status=0 [ 5459.870552] 24 HWLs done, totally 30 layers [ 5459.871111] Enter: dla_dequeue_operation [ 5459.871643] exit PDP as there's no further operation [ 5459.872272] Exit: dla_dequeue_operation [ 5459.872817] Enter: dla_free_op_desc op desc index 23 ROI 0 [ 5459.873879] Exit: dla_free_op_desc [ 5459.874376] Exit:dla_op_completion processor PDP group1 status=0 [ 5459.875114] Exit:dla_handle_events, ret:0 [ 5459.875846] Enter:dla_handle_events, processor:CDP [ 5459.876464] Exit:dla_handle_events, ret:0 [ 5459.877019] Enter:dla_handle_events, processor:RUBIK [ 5459.877653] Exit:dla_handle_events, ret:0 [ 5459.884331] Enter:dla_handle_events, processor:BDMA [ 5459.885094] Exit:dla_handle_events, ret:0 [ 5459.885653] Enter:dla_handle_events, processor:Convolution [ 5459.886343] Handle cdma data done event, processor Convolution group 1 [ 5459.887147] Exit:dla_handle_events, ret:0 [ 5459.887688] Enter:dla_handle_events, processor:SDP [ 5459.888305] Exit:dla_handle_events, ret:0 [ 5459.888859] Enter:dla_handle_events, processor:PDP [ 5459.889473] Exit:dla_handle_events, ret:0 [ 5459.890010] Enter:dla_handle_events, processor:CDP [ 5459.890624] Exit:dla_handle_events, ret:0 [ 5459.891162] Enter:dla_handle_events, processor:RUBIK [ 5459.891798] Exit:dla_handle_events, ret:0 [ 5461.179226] Enter:dla_handle_events, processor:BDMA [ 5461.180008] Exit:dla_handle_events, ret:0 [ 5461.180591] Enter:dla_handle_events, processor:Convolution [ 5461.181297] Handle cdma weight done event, processor Convolution group 1 [ 5461.182462] Handle op complete event, processor Convolution group 1 [ 5461.183251] Enter:dla_op_completion processor Convolution group1 [ 5461.184004] Completed Convolution operation index 24 ROI 0 [ 5461.184721] 25 HWLs done, totally 30 layers [ 5461.185286] Enter: dla_dequeue_operation [ 5461.185827] Dequeue op from Convolution processor, index=28 ROI=0 [ 5461.186576] Enter: dla_submit_operation [ 5461.187110] Prepare Convolution operation index 28 ROI 0 dep_count 2 [ 5461.187879] Enter: dla_prepare_operation [ 5461.188480] processor:Convolution group:1, rdma_group:0 available [ 5461.189249] Enter: dla_read_config [ 5461.197397] Exit: dla_read_config [ 5461.197884] Exit: dla_prepare_operation status=0 [ 5461.198484] Enter: dla_program_operation [ 5461.199027] Program Convolution operation index 28 ROI 0 Group[1] [ 5461.202885] no desc get due to index==-1 [ 5461.203425] no desc get due to index==-1 [ 5461.203952] no desc get due to index==-1 [ 5461.204476] no desc get due to index==-1 [ 5461.205010] no desc get due to index==-1 [ 5461.205533] no desc get due to index==-1 [ 5461.206064] Enter: dla_op_programmed [ 5461.206573] Update dependency operation index 29 ROI 0 DEP_COUNT=1 [ 5461.207319] enable SDP in dla_update_dependency as depdency are resolved [ 5461.208118] Enter: dla_enable_operation [ 5461.208649] exit dla_enable_operation without actual enable due to processor hasn't been programmed [ 5461.209700] Exit: dla_enable_operation status=0 [ 5461.210290] Exit: dla_op_programmed [ 5461.210779] Exit: dla_program_operation status=0 [ 5461.211376] Exit: dla_submit_operation [ 5461.211889] Exit: dla_dequeue_operation [ 5461.212422] Exit:dla_op_completion processor Convolution group1 status=0 [ 5461.213242] Exit:dla_handle_events, ret:0 [ 5461.213778] Enter:dla_handle_events, processor:SDP [ 5461.214397] Handle op complete event, processor SDP group 1 [ 5461.215095] Enter:dla_op_completion processor SDP group1 [ 5461.215767] Completed SDP operation index 25 ROI 0 [ 5461.216393] Update dependency operation index 26 ROI 0 DEP_COUNT=1 [ 5461.217158] enable Convolution in dla_update_dependency as depdency are resolved [ 5461.218040] Enter: dla_enable_operation [ 5461.218571] Enable Convolution operation index 26 ROI 0 [ 5461.219697] Enter: dla_op_enabled [ 5461.220178] Exit: dla_op_enabled [ 5461.220652] Exit: dla_enable_operation status=0 [ 5461.221249] 26 HWLs done, totally 30 layers [ 5461.221825] Enter: dla_free_op_desc op desc index 24 ROI 0 [ 5461.222905] Exit: dla_free_op_desc [ 5461.223392] Enter: dla_dequeue_operation [ 5461.223928] Dequeue op from SDP processor, index=29 ROI=0 [ 5461.224611] Enter: dla_submit_operation [ 5461.225143] Prepare SDP operation index 29 ROI 0 dep_count 0 [ 5461.225839] Enter: dla_prepare_operation [ 5461.226479] processor:SDP group:1, rdma_group:0 available [ 5461.227150] Enter: dla_read_config [ 5461.235251] Exit: dla_read_config [ 5461.235735] Exit: dla_prepare_operation status=0 [ 5461.236331] Enter: dla_program_operation [ 5461.236891] Program SDP operation index 29 ROI 0 Group[1] [ 5461.239076] no desc get due to index==-1 [ 5461.239614] no desc get due to index==-1 [ 5461.240137] no desc get due to index==-1 [ 5461.240669] no desc get due to index==-1 [ 5461.241193] no desc get due to index==-1 [ 5461.241719] no desc get due to index==-1 [ 5461.242246] Enter: dla_op_programmed [ 5461.242746] Exit: dla_op_programmed [ 5461.243237] Exit: dla_program_operation status=0 [ 5461.243829] Enter: dla_enable_operation [ 5461.244362] Enable SDP operation index 29 ROI 0 [ 5461.245133] Enter: dla_op_enabled [ 5461.245623] Update dependency operation index 28 ROI 0 DEP_COUNT=2 [ 5461.246367] Exit: dla_op_enabled [ 5461.246832] Exit: dla_enable_operation status=0 [ 5461.247417] Exit: dla_submit_operation [ 5461.247931] Exit: dla_dequeue_operation [ 5461.248463] Enter: dla_free_op_desc op desc index 25 ROI 0 [ 5461.249530] Exit: dla_free_op_desc [ 5461.250027] Exit:dla_op_completion processor SDP group1 status=0 [ 5461.250761] Exit:dla_handle_events, ret:0 [ 5461.251297] Enter:dla_handle_events, processor:PDP [ 5461.251917] Exit:dla_handle_events, ret:0 [ 5461.252458] Enter:dla_handle_events, processor:CDP [ 5461.253086] Exit:dla_handle_events, ret:0 [ 5461.253622] Enter:dla_handle_events, processor:RUBIK [ 5461.254253] Exit:dla_handle_events, ret:0 [ 5461.266398] Enter:dla_handle_events, processor:BDMA [ 5461.267140] Exit:dla_handle_events, ret:0 [ 5461.267681] Enter:dla_handle_events, processor:Convolution [ 5461.268367] Handle cdma data done event, processor Convolution group 0 [ 5461.269182] Exit:dla_handle_events, ret:0 [ 5461.269757] Enter:dla_handle_events, processor:SDP [ 5461.270374] Exit:dla_handle_events, ret:0 [ 5461.270909] Enter:dla_handle_events, processor:PDP [ 5461.271526] Exit:dla_handle_events, ret:0 [ 5461.272062] Enter:dla_handle_events, processor:CDP [ 5461.272688] Exit:dla_handle_events, ret:0 [ 5461.273224] Enter:dla_handle_events, processor:RUBIK [ 5461.273857] Exit:dla_handle_events, ret:0 [ 5461.680005] Enter:dla_handle_events, processor:BDMA [ 5461.680776] Exit:dla_handle_events, ret:0 [ 5461.681335] Enter:dla_handle_events, processor:Convolution [ 5461.682309] Handle cdma weight done event, processor Convolution group 0 [ 5461.683155] Handle op complete event, processor Convolution group 0 [ 5461.683931] Enter:dla_op_completion processor Convolution group0 [ 5461.684690] Completed Convolution operation index 26 ROI 0 [ 5461.685394] 27 HWLs done, totally 30 layers [ 5461.685956] Enter: dla_dequeue_operation [ 5461.686485] exit Convolution as there's no further operation [ 5461.687179] Exit: dla_dequeue_operation [ 5461.687713] Exit:dla_op_completion processor Convolution group0 status=0 [ 5461.688519] Exit:dla_handle_events, ret:0 [ 5461.689070] Enter:dla_handle_events, processor:SDP [ 5461.689686] Handle op complete event, processor SDP group 0 [ 5461.690383] Enter:dla_op_completion processor SDP group0 [ 5461.691055] Completed SDP operation index 27 ROI 0 [ 5461.691688] Update dependency operation index 28 ROI 0 DEP_COUNT=1 [ 5461.692439] enable Convolution in dla_update_dependency as depdency are resolved [ 5461.693338] Enter: dla_enable_operation [ 5461.693869] Enable Convolution operation index 28 ROI 0 [ 5461.695000] Enter: dla_op_enabled [ 5461.695482] Exit: dla_op_enabled [ 5461.695947] Exit: dla_enable_operation status=0 [ 5461.696556] 28 HWLs done, totally 30 layers [ 5461.697130] Enter: dla_free_op_desc op desc index 26 ROI 0 [ 5461.699132] Exit: dla_free_op_desc [ 5461.699622] Enter: dla_dequeue_operation [ 5461.700148] exit SDP as there's no further operation [ 5461.700788] Exit: dla_dequeue_operation [ 5461.701322] Enter: dla_free_op_desc op desc index 27 ROI 0 [ 5461.703258] Exit: dla_free_op_desc [ 5461.703756] Exit:dla_op_completion processor SDP group0 status=0 [ 5461.704494] Exit:dla_handle_events, ret:0 [ 5461.705045] Enter:dla_handle_events, processor:PDP [ 5461.705661] Exit:dla_handle_events, ret:0 [ 5461.706201] Enter:dla_handle_events, processor:CDP [ 5461.706817] Exit:dla_handle_events, ret:0 [ 5461.707355] Enter:dla_handle_events, processor:RUBIK [ 5461.707989] Exit:dla_handle_events, ret:0 [ 5461.714385] Enter:dla_handle_events, processor:BDMA [ 5461.715208] Exit:dla_handle_events, ret:0 [ 5461.715823] Enter:dla_handle_events, processor:Convolution [ 5461.716527] Handle cdma data done event, processor Convolution group 1 [ 5461.717362] Exit:dla_handle_events, ret:0 [ 5461.717989] Enter:dla_handle_events, processor:SDP [ 5461.718606] Exit:dla_handle_events, ret:0 [ 5461.719145] Enter:dla_handle_events, processor:PDP [ 5461.719761] Exit:dla_handle_events, ret:0 [ 5461.720299] Enter:dla_handle_events, processor:CDP [ 5461.720934] Exit:dla_handle_events, ret:0 [ 5461.721475] Enter:dla_handle_events, processor:RUBIK [ 5461.722108] Exit:dla_handle_events, ret:0 [ 5461.880328] Enter:dla_handle_events, processor:BDMA [ 5461.881104] Exit:dla_handle_events, ret:0 [ 5461.881668] Enter:dla_handle_events, processor:Convolution [ 5461.882359] Handle cdma weight done event, processor Convolution group 1 [ 5461.883182] Handle op complete event, processor Convolution group 1 [ 5461.883953] Enter:dla_op_completion processor Convolution group1 [ 5461.884713] Completed Convolution operation index 28 ROI 0 [ 5461.885417] 29 HWLs done, totally 30 layers [ 5461.885980] Enter: dla_dequeue_operation [ 5461.886512] exit Convolution as there's no further operation [ 5461.887210] Exit: dla_dequeue_operation [ 5461.887746] Exit:dla_op_completion processor Convolution group1 status=0 [ 5461.888563] Exit:dla_handle_events, ret:0 [ 5461.889104] Enter:dla_handle_events, processor:SDP [ 5461.889722] Handle op complete event, processor SDP group 1 [ 5461.890422] Enter:dla_op_completion processor SDP group1 [ 5461.891096] Completed SDP operation index 29 ROI 0 [ 5461.891730] 30 HWLs done, totally 30 layers [ 5461.892302] Enter: dla_free_op_desc op desc index 28 ROI 0 [ 5461.893422] Exit: dla_free_op_desc [ 5461.893974] Enter: dla_free_op_desc op desc index 29 ROI 0 [ 5461.895028] Exit: dla_free_op_desc [ 5461.895555] Exit:dla_op_completion processor SDP group1 status=0 [ 5461.896293] Exit:dla_handle_events, ret:0 [ 5461.896846] Enter:dla_handle_events, processor:PDP [ 5461.897464] Exit:dla_handle_events, ret:0 [ 5461.898001] Enter:dla_handle_events, processor:CDP [ 5461.898618] Exit:dla_handle_events, ret:0 [ 5461.899157] Enter:dla_handle_events, processor:RUBIK [ 5461.899793] Exit:dla_handle_events, ret:0 [ 5461.907996] reset engine done Test pass
Thanks.
Hi, @smsharif1991 I was not able to see the test pass.do I need to change something in umd before compilation? can you please guide me to resolve this issue?
Thank You.
Hi, I am running the NVDLA small architecture on a FPGA. I succeded at running almost all the flatbufs tests available in the UMD. I just have a problem with the loadable
NN_L0_1_small_fbuf, which is supposed to be an AlexNet NN precompiled for the small architecture. The process stalls at a certain point and the FPGA stops working. Does anyone have the same problem or know how to solve it?When will the compiler for the NVDLA small be available?