search

tenstorrent / tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
Apache License 2.0
373 stars 44 forks source link

ttnn.conv2d fails with L1 error for mobilenetv2 test cases #8490

Open keerthana-r-mcw opened 3 months ago

keerthana-r-mcw commented 3 months ago

ttnn.conv2d is failing with L1 issue for some of the mobilenetv2 unit test cases.

To Reproduce Steps to reproduce the behavior:

  1. Checkout the branch keerthanar/mobilenetv2_conv_l1_issue_cases.
  2. Run the following command, pytest tests/ttnn/unit_tests/operations/test_conv2d.py:: test_mobilenetv2_conv_ttnn_l1_issue_case
  3. The following error will occur, E RuntimeError: TT_THROW @ tt_metal/impl/allocator/allocator.cpp:118: tt::exception E info: E Out of Memory: Not enough space to allocate 98304000 B L1 buffer across 100 banks, where each bank needs to store 983040 B
dvartaniansTT commented 3 months ago

@keerthana-r-mcw and @saichandax please make a new branch off of this one and only include the unit tests of interest: (32, 3, 480, 640, 3, 3, 2, 2, 1, 1, True), (24, 144, 120, 160, 1, 1, 1, 1, 0, 0, True), (1280, 320, 15, 20, 1, 1, 1, 1, 0, 0, True) please add the new branch to this issue once created.