Skip to content

On PR

On PR #2275

Manually triggered January 30, 2025 19:30
Status Success
Total duration 53m 58s
Artifacts 9

on-pr.yml

on: workflow_dispatch
docker-build  /  ...  /  build-image
18s
docker-build / docker-build / build-image
spdx  /  check-spdx-headers
3s
spdx / check-spdx-headers
pre-commit  /  pre-commit
46s
pre-commit / pre-commit
Matrix: docker-build / forge-build
Matrix: docker-build / run-tests
Fit to window
Zoom out
Zoom in

Annotations

80 errors and 5 warnings
test_fuyu_8b.test_fuyu8b[adept/fuyu-8b]: forge/test/models/pytorch/text/fuyu/test_fuyu_8b.py#L83
RuntimeError: TT_ASSERT @ /__w/tt-forge-fe/tt-forge-fe/forge/csrc/graph_lib/shape.cpp:135: (i >= 0) && (i < (int)dims_.size()) info: Trying to access element outside of dimensions: 3 backtrace: --- tt::graphlib::Shape::operator[](int) --- tt::passes::commute_through_concat(tt::graphlib::Graph*, tt::graphlib::OpNode*, tt::graphlib::OpNode*, tt::graphlib::Node*, tt::graphlib::Shape*, tt::graphlib::Shape*, bool, bool*, std::pair<int, int>*, tt::graphlib::OpType*, bool) --- tt::passes::can_commute_past_op(tt::graphlib::OpNode*, tt::graphlib::OpNode*, tt::graphlib::Graph*, tt::graphlib::Shape*, tt::graphlib::Shape*, bool, tt::graphlib::Node*) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x18fc4f) [0x7fe29f014c4f] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x18fd9d) [0x7fe29f014d9d] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x18fd9d) [0x7fe29f014d9d] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x18fd9d) [0x7fe29f014d9d] --- tt::passes::erase_inverse_ops(tt::graphlib::Graph*) --- tt::run_optimization_graph_passes(tt::graphlib::Graph*) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0xfda39) [0x7fe29ef82a39] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0xe0cf5) [0x7fe29ef65cf5] --- /opt/ttmlir-toolchain/venv/bin/python(+0x18ab32) [0x560eec89cb32] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x560eec89339b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x560eec88ca97] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x560eec887790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x560eec887790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x560eec8889ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0x122) [0x560eec8ab172] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x560eec889c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x560eec889c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x560eec8889ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x560eec88c702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x560eec8aa4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x560eec88c702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x560eec89261d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x560eec8a762c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x560eec9af464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x560eec89339b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x560eec88d99e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x560eec88797f] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x560eec889c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x560eec8889ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x560eec88c702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x560eec8aa4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x560eec88c702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x560eec89261d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x560eec8a762c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x560eec9af464] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x560eec8ab10b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x560eec889c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x560eec887790] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x560eec8aa4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x560eec8889ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x560eec889c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x560eec887790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x560eec8889ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x560eec889c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x560eec8889ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x560eec88c702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x560eec8aa4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x560eec88c702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x560eec89261d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x560eec8a762c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x560eec9af464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x560eec89339b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x560eec88d99e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x560eec889c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x560eec8889ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x560eec88c702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x560eec8aa4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x560eec88c702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x560eec89261d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x560eec8a762c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x560eec9af464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x560eec89339b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x560eec88d99e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x560eec887790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x560eec887790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x560eec89d38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x560eec889c30]
test_opt.test_opt_causal_lm[facebook/opt-125m]: forge/test/models/pytorch/text/opt/test_opt.py#L63
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_phi2.test_phi2_clm[microsoft/phi-2]: forge/test/models/pytorch/text/phi2/test_phi2.py#L67
AssertionError: Data mismatch on output 0 between framework and Forge codegen
test_qwen_v2.test_qwen_clm[Qwen/Qwen2.5-0.5B]: forge/test/models/pytorch/text/qwen/test_qwen_v2.py#L59
RuntimeError: Input count mismatch: expected 534, got 535
test_roberta.test_roberta_masked_lm[xlm-roberta-base]: forge/test/models/pytorch/text/roberta/test_roberta.py#L49
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_t5.test_t5_generation[t5-base]: forge/test/models/pytorch/text/t5/test_t5.py#L168
ValueError: Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model=tensor([[[-18.88008, -10.41466, -14.89029, ..., -43.63987, -43.76200, -43.71424]]], grad_fn=<UnsafeViewBackward0>), compiled_model=tensor([[[-31.69363, -10.19963, -13.79479, ..., -44.44143, -44.45059, -44.40383]]])
test_densenet.test_densenet_121_pytorch[densenet121_hf_xray]: forge/test/models/pytorch/vision/densenet/test_densenet.py#L52
AssertionError: Encountered unsupported op types. Check error logs for more details
test_detr.test_detr_detection[facebook/detr-resnet-50]: forge/test/models/pytorch/vision/detr/test_detr.py#L42
AttributeError: <class 'tvm.ir.op.Op'> has no attribute name_hint
test_hrnet.test_hrnet_osmr_pytorch[hrnet_w18_small_v1]: forge/test/models/pytorch/vision/hrnet/test_hrnet.py#L98
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_perceiverio.test_perceiverio_for_image_classification_pytorch[deepmind/vision-perceiver-conv]: forge/test/models/onnx/vision/perceiverio/test_perceiverio.py#L90
RuntimeError: Unknown type of tensor: <class 'transformers.models.perceiver.modeling_perceiver.PerceiverClassifierOutput'>
test_swin.test_swin_v2_tiny_4_256_hf_pytorch[microsoft/swinv2-tiny-patch4-window8-256]: forge/test/models/pytorch/vision/swin/test_swin.py#L77
AssertionError: Data mismatch on output 0 between framework and Forge codegen
test_yolo_v5.test_yolov5_640x640[yolov5s]: forge/test/models/onnx/vision/yolo/test_yolo_v5.py#L95
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_gpt2.test_gpt2_text_gen[gpt2]: forge/test/models/pytorch/text/gpt2/test_gpt2.py#L55
RuntimeError: Tensor 6 - data type mismatch: expected Float32, got UInt8
test_qwen.test_qwen1_5_causal_lm[Qwen/Qwen1.5-0.5B]: forge/test/models/pytorch/text/qwen/test_qwen.py#L56
RuntimeError: Input count mismatch: expected 534, got 535
test_t5.test_t5_generation[t5-large]: forge/test/models/pytorch/text/t5/test_t5.py#L168
ValueError: Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model=tensor([[[-20.48772, -10.36655, -13.71507, ..., -39.06538, -39.12180, -39.08955]]], grad_fn=<UnsafeViewBackward0>), compiled_model=tensor([[[-22.37089, -18.76008, -19.40021, ..., -60.30701, -60.50323, -60.47663]]])
test_nbeats.test_nbeats_with_seasonality_basis[seasionality_basis]: forge/test/models/pytorch/timeseries/nbeats/test_nbeats.py#L49
RuntimeError: Tensor 4 - stride mismatch: expected [24, 1], got [1, 12]
test_autoencoder.test_conv_ae_pytorch: forge/test/models/pytorch/vision/autoencoder/test_autoencoder.py#L51
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_densenet.test_densenet_161_pytorch[densenet161]: forge/test/models/pytorch/vision/densenet/test_densenet.py#L84
RuntimeError: Tensor 0 - stride mismatch: expected [150528, 50176, 224, 1], got [3, 1, 672, 3]
test_efficientnet.test_efficientnet_timm[efficientnet_b0]: forge/test/models/pytorch/vision/efficientnet/test_efficientnet.py#L93
RuntimeError: TT_THROW @ /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal/tt_metal/impl/program/program.cpp:898: tt::exception info: Statically allocated circular buffers on core range [(x=0,y=0) - (x=6,y=6)] grow to 1942368 B which is beyond max L1 size of 1499136 B backtrace: --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/libtt_metal.so(+0x1657eb) [0x7f477e2bf7eb] --- tt::tt_metal::detail::Program_::validate_circular_buffer_region(tt::tt_metal::v0::IDevice const*) --- tt::tt_metal::v0::CommandQueue::run_command_impl(tt::tt_metal::CommandInterface const&) --- tt::tt_metal::v0::EnqueueProgram(tt::tt_metal::v0::CommandQueue&, tt::tt_metal::v0::Program&, bool) --- void ttnn::device_operation::detail::launch_on_worker_thread<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >, unsigned char, long, tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >, tt::tt_metal::v0::IDevice*>(unsigned char, long, tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >&, tt::tt_metal::v0::IDevice*&) --- tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_return_value_t ttnn::device_operation::detail::launch_on_single_device<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > >(unsigned char, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::operation_attributes_t const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x306fe99) [0x7f4781581e99] --- tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_return_value_t ttnn::device_operation::detail::invoke<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > >(unsigned char, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::operation_attributes_t const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x306c5df) [0x7f478157e5df] --- std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > tt::tt_metal::operation::run_without_autoformat<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >(tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >&&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > > const&, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > > const&, unsigned char) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x46873f) [0x7f477e97a73f] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x471d90) [0x7f477e983d90] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x4729ec) [0x7f477e9849ec] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(_ZN4ttnn10operations4conv6conv2d18optimized_conv_newERKN2tt8tt_metal6TensorES7_St8optionalIS6_ERKNS0_14sliding_window19SlidingWindowConfigEjjbbRKNS2_34OptimizedConvParallelizationConfigERKNS2_24OptimizedConvBlockConfigERKNS4_12MemoryConfigENS4_8DataTypeESt5arrayIjLm4EEbRKSt7variantIJNS_28GrayskullComputeKernelConfigENS_27WormholeComputeKernelConfigEEEbbbbb+0x18f1) [0x7f477e902df1] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(_ZN4ttnn10operations4conv6conv2d6conv2dIN2tt8tt_metal2v07IDeviceEEESt5tupleIJNS5_6TensorEjjS9_St8optionalIS9_EEERKS9_SE_PT_jjjjjSt5arrayIjLm2EESI_SI_SI_jSA_ISD_ERKSA_IKNS2_12Conv2dConfigEERKSA_IKSt7variantIJNS_28GrayskullComputeKernelConfigENS_27WormholeComputeKernelConfigEEEERKSA_IKNS5_12MemoryConfigEE+0xf7b) [0x7f477e8f094b] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/libTTMLIR.so(+0x775ca3) [0x7f4783156ca3] --- tt::runtime::ttnn::operations::conv::run(tt::target::ttnn::Conv2dOp const*, tt::runtime::ttnn::ProgramContext&) --- tt::runtime::ttnn::runProgram(tt::tt_metal::distributed::MeshDevice&, tt::runtime::Binary, unsigned int, std::vector<tt::tt_metal::Tensor*, std::allocator<tt::tt_metal::Tensor*> > const&) --- tt::runtime::ttnn::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::runtime::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::run_binary(tt::runtime::Binary&, int, std::vector<at::Tensor, std::allocator<at::Tensor> > const&) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x3174e0) [0x7f478f8ca4e0] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x31742e) [0x7f478f8ca42e] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0xe0cf5) [0x7f478f693cf5] --- /opt/ttmlir-toolchain/venv/bin/python(+0x18ab32) [0x5588a274db32] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5588a274439b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x5588a273da97] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0xc4) [0x5588a2743574] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5588a275862c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x5588a2860464] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x5588a275c10b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5588a2738790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0x122) [0x5588a275c172] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5588a27399ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x5588a275b4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5588a274361d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5588a275862c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x5588a2860464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5588a274439b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x5588a273e99e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x5588a273897f] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5588a27399ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x5588a275b4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5588a274361d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5588a275862c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x5588a2860464] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x5588a275c10b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5588a2738790] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x5588a275b4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5588a27399ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5588a2738790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5588a27399ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5588a27399ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x5588a275b4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5588a274361d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5588a275862c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x5588a2860464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5588a274439b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x5588a273e99e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5588a27399ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702]
test_xception.test_xception_timm[xception]: forge/test/models/pytorch/vision/xception/test_xception.py#L65
RuntimeError: TT_FATAL @ /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal/ttnn/cpp/ttnn/operations/pool/generic/device/pool_op.cpp:37: (input_shape[3] % tt::constants::TILE_WIDTH == 0) || (input_shape[3] == 16) info: Input channels (728) should be padded to nearest TILE_WIDTH (32) or should be 16 backtrace: --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x3f4309) [0x7f477e906309] --- ttnn::operations::pool::validate_pool2d(tt::tt_metal::Tensor const&, ttnn::operations::sliding_window::SlidingWindowConfig const&, tt::tt_metal::MemoryConfig const&) --- void ttnn::device_operation::detail::launch_on_worker_thread<ttnn::operations::pool::Pool2D, unsigned char, long, ttnn::operations::pool::Pool2D::operation_attributes_t, ttnn::operations::pool::Pool2D::tensor_args_t, tt::tt_metal::Tensor, tt::tt_metal::v0::IDevice*>(unsigned char, long, ttnn::operations::pool::Pool2D::operation_attributes_t const&, ttnn::operations::pool::Pool2D::tensor_args_t const&, tt::tt_metal::Tensor&, tt::tt_metal::v0::IDevice*&) --- ttnn::operations::pool::Pool2D::tensor_return_value_t ttnn::device_operation::detail::launch_on_single_device<ttnn::operations::pool::Pool2D>(unsigned char, ttnn::operations::pool::Pool2D::operation_attributes_t const&, ttnn::operations::pool::Pool2D::tensor_args_t const&) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x174dee9) [0x7f477fc5fee9] --- ttnn::operations::pool::Pool2D::tensor_return_value_t ttnn::device_operation::detail::invoke<ttnn::operations::pool::Pool2D>(unsigned char, ttnn::operations::pool::Pool2D::operation_attributes_t const&, ttnn::operations::pool::Pool2D::tensor_args_t const&) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x174d96f) [0x7f477fc5f96f] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x1745598) [0x7f477fc57598] --- ttnn::operations::pool::Pool2DOp<(ttnn::operations::pool::Pool2DType)0>::invoke(unsigned char, tt::tt_metal::Tensor const&, unsigned int, unsigned int, unsigned int, unsigned int, std::array<unsigned int, 2ul>, std::array<unsigned int, 2ul>, std::array<unsigned int, 2ul>, std::array<unsigned int, 2ul>, std::optional<tt::tt_metal::MemoryConfig const> const&, std::optional<tt::tt_metal::TensorMemoryLayout const>, bool) --- tt::runtime::ttnn::operations::pool::run(tt::target::ttnn::MaxPool2dOp const*, tt::runtime::ttnn::ProgramContext&) --- tt::runtime::ttnn::runProgram(tt::tt_metal::distributed::MeshDevice&, tt::runtime::Binary, unsigned int, std::vector<tt::tt_metal::Tensor*, std::allocator<tt::tt_metal::Tensor*> > const&) --- tt::runtime::ttnn::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::runtime::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::run_binary(tt::runtime::Binary&, int, std::vector<at::Tensor, std::allocator<at::Tensor> > const&) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x3174e0) [0x7f478f8ca4e0] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x31742e) [0x7f478f8ca42e] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0xe0cf5) [0x7f478f693cf5] --- /opt/ttmlir-toolchain/venv/bin/python(+0x18ab32) [0x5588a274db32] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5588a274439b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x5588a273da97] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0xc4) [0x5588a2743574] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5588a275862c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x5588a2860464] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x5588a275c10b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5588a2738790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0x122) [0x5588a275c172] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5588a27399ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x5588a275b4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5588a274361d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5588a275862c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x5588a2860464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5588a274439b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x5588a273e99e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x5588a273897f] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5588a27399ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x5588a275b4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5588a274361d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5588a275862c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x5588a2860464] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x5588a275c10b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5588a2738790] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x5588a275b4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5588a27399ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5588a2738790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5588a27399ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5588a27399ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x5588a275b4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5588a274361d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5588a275862c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x5588a2860464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5588a274439b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x5588a273e99e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5588a273ac30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5588a27399ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x5588a275b4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5588a273d702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5588a274e38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5588a274361d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5588a275862c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x5588a2860464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5588a274439b]
test_yolox.test_yolox_pytorch[yolox_nano]: forge/test/models/pytorch/vision/yolo/test_yolox.py#L94
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_fuyu_8b.test_fuyu8b[adept/fuyu-8b]: forge/test/models/pytorch/text/fuyu/test_fuyu_8b.py#L83
RuntimeError: TT_ASSERT @ /__w/tt-forge-fe/tt-forge-fe/forge/csrc/graph_lib/shape.cpp:135: (i >= 0) && (i < (int)dims_.size()) info: Trying to access element outside of dimensions: 3 backtrace: --- tt::graphlib::Shape::operator[](int) --- tt::passes::commute_through_concat(tt::graphlib::Graph*, tt::graphlib::OpNode*, tt::graphlib::OpNode*, tt::graphlib::Node*, tt::graphlib::Shape*, tt::graphlib::Shape*, bool, bool*, std::pair<int, int>*, tt::graphlib::OpType*, bool) --- tt::passes::can_commute_past_op(tt::graphlib::OpNode*, tt::graphlib::OpNode*, tt::graphlib::Graph*, tt::graphlib::Shape*, tt::graphlib::Shape*, bool, tt::graphlib::Node*) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x18fc4f) [0x7f2992adbc4f] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x18fd9d) [0x7f2992adbd9d] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x18fd9d) [0x7f2992adbd9d] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x18fd9d) [0x7f2992adbd9d] --- tt::passes::erase_inverse_ops(tt::graphlib::Graph*) --- tt::run_optimization_graph_passes(tt::graphlib::Graph*) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0xfda39) [0x7f2992a49a39] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0xe0cf5) [0x7f2992a2ccf5] --- /opt/ttmlir-toolchain/venv/bin/python(+0x18ab32) [0x55ed04570b32] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55ed0456739b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x55ed04560a97] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55ed0455b790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55ed0455b790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55ed0455c9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0x122) [0x55ed0457f172] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55ed0455dc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55ed0455dc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55ed0455c9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55ed04560702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55ed0457e4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55ed04560702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55ed0456661d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55ed0457b62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55ed04683464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55ed0456739b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55ed0456199e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x55ed0455b97f] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55ed0455dc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55ed0455c9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55ed04560702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55ed0457e4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55ed04560702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55ed0456661d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55ed0457b62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55ed04683464] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55ed0457f10b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55ed0455dc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55ed0455b790] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55ed0457e4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55ed0455c9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55ed0455dc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55ed0455b790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55ed0455c9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55ed0455dc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55ed0455c9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55ed04560702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55ed0457e4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55ed04560702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55ed0456661d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55ed0457b62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55ed04683464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55ed0456739b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55ed0456199e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55ed0455dc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55ed0455c9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55ed04560702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55ed0457e4d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55ed04560702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55ed0456661d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55ed0457b62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55ed04683464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55ed0456739b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55ed0456199e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55ed0455b790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55ed0455b790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55ed0457138c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55ed0455dc30]
test_opt.test_opt_causal_lm[facebook/opt-125m]: forge/test/models/pytorch/text/opt/test_opt.py#L63
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_phi2.test_phi2_clm[microsoft/phi-2]: forge/test/models/pytorch/text/phi2/test_phi2.py#L67
AssertionError: Data mismatch on output 0 between framework and Forge codegen
test_qwen_v2.test_qwen_clm[Qwen/Qwen2.5-0.5B]: forge/test/models/pytorch/text/qwen/test_qwen_v2.py#L59
RuntimeError: Input count mismatch: expected 534, got 535
test_roberta.test_roberta_masked_lm[xlm-roberta-base]: forge/test/models/pytorch/text/roberta/test_roberta.py#L49
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_t5.test_t5_generation[t5-base]: forge/test/models/pytorch/text/t5/test_t5.py#L168
ValueError: Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model=tensor([[[-18.88008, -10.41466, -14.89029, ..., -43.63989, -43.76201, -43.71423]]], grad_fn=<UnsafeViewBackward0>), compiled_model=tensor([[[-31.69363, -10.19963, -13.79479, ..., -44.44143, -44.45059, -44.40383]]])
test_densenet.test_densenet_121_pytorch[densenet121_hf_xray]: forge/test/models/pytorch/vision/densenet/test_densenet.py#L52
AssertionError: Encountered unsupported op types. Check error logs for more details
test_detr.test_detr_detection[facebook/detr-resnet-50]: forge/test/models/pytorch/vision/detr/test_detr.py#L42
AttributeError: <class 'tvm.ir.op.Op'> has no attribute name_hint
test_hrnet.test_hrnet_osmr_pytorch[hrnet_w18_small_v1]: forge/test/models/pytorch/vision/hrnet/test_hrnet.py#L98
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_perceiverio.test_perceiverio_for_image_classification_pytorch[deepmind/vision-perceiver-conv]: forge/test/models/onnx/vision/perceiverio/test_perceiverio.py#L90
RuntimeError: Unknown type of tensor: <class 'transformers.models.perceiver.modeling_perceiver.PerceiverClassifierOutput'>
test_swin.test_swin_v2_tiny_4_256_hf_pytorch[microsoft/swinv2-tiny-patch4-window8-256]: forge/test/models/pytorch/vision/swin/test_swin.py#L77
AssertionError: Data mismatch on output 0 between framework and Forge codegen
test_yolo_v5.test_yolov5_640x640[yolov5s]: forge/test/models/onnx/vision/yolo/test_yolo_v5.py#L95
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_gpt2.test_gpt2_text_gen[gpt2]: forge/test/models/pytorch/text/gpt2/test_gpt2.py#L55
RuntimeError: Tensor 6 - data type mismatch: expected Float32, got UInt8
test_qwen.test_qwen1_5_causal_lm[Qwen/Qwen1.5-0.5B]: forge/test/models/pytorch/text/qwen/test_qwen.py#L56
RuntimeError: Input count mismatch: expected 534, got 535
test_t5.test_t5_generation[t5-large]: forge/test/models/pytorch/text/t5/test_t5.py#L168
ValueError: Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model=tensor([[[-20.48771, -10.36654, -13.71506, ..., -39.06541, -39.12180, -39.08952]]], grad_fn=<UnsafeViewBackward0>), compiled_model=tensor([[[-22.37089, -18.76008, -19.40021, ..., -60.30701, -60.50323, -60.47663]]])
test_nbeats.test_nbeats_with_seasonality_basis[seasionality_basis]: forge/test/models/pytorch/timeseries/nbeats/test_nbeats.py#L49
RuntimeError: Tensor 4 - stride mismatch: expected [24, 1], got [1, 12]
test_autoencoder.test_conv_ae_pytorch: forge/test/models/pytorch/vision/autoencoder/test_autoencoder.py#L51
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_densenet.test_densenet_161_pytorch[densenet161]: forge/test/models/pytorch/vision/densenet/test_densenet.py#L84
RuntimeError: Tensor 0 - stride mismatch: expected [150528, 50176, 224, 1], got [3, 1, 672, 3]
test_efficientnet.test_efficientnet_timm[efficientnet_b0]: forge/test/models/pytorch/vision/efficientnet/test_efficientnet.py#L93
RuntimeError: TT_THROW @ /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal/tt_metal/impl/program/program.cpp:898: tt::exception info: Statically allocated circular buffers on core range [(x=0,y=0) - (x=6,y=6)] grow to 1942368 B which is beyond max L1 size of 1499136 B backtrace: --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/libtt_metal.so(+0x1657eb) [0x7f81e12d87eb] --- tt::tt_metal::detail::Program_::validate_circular_buffer_region(tt::tt_metal::v0::IDevice const*) --- tt::tt_metal::v0::CommandQueue::run_command_impl(tt::tt_metal::CommandInterface const&) --- tt::tt_metal::v0::EnqueueProgram(tt::tt_metal::v0::CommandQueue&, tt::tt_metal::v0::Program&, bool) --- void ttnn::device_operation::detail::launch_on_worker_thread<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >, unsigned char, long, tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >, tt::tt_metal::v0::IDevice*>(unsigned char, long, tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >&, tt::tt_metal::v0::IDevice*&) --- tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_return_value_t ttnn::device_operation::detail::launch_on_single_device<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > >(unsigned char, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::operation_attributes_t const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x306fe99) [0x7f81e459ae99] --- tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_return_value_t ttnn::device_operation::detail::invoke<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > >(unsigned char, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::operation_attributes_t const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x306c5df) [0x7f81e45975df] --- std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > tt::tt_metal::operation::run_without_autoformat<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >(tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >&&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > > const&, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > > const&, unsigned char) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x46873f) [0x7f81e199373f] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x471d90) [0x7f81e199cd90] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x4729ec) [0x7f81e199d9ec] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(_ZN4ttnn10operations4conv6conv2d18optimized_conv_newERKN2tt8tt_metal6TensorES7_St8optionalIS6_ERKNS0_14sliding_window19SlidingWindowConfigEjjbbRKNS2_34OptimizedConvParallelizationConfigERKNS2_24OptimizedConvBlockConfigERKNS4_12MemoryConfigENS4_8DataTypeESt5arrayIjLm4EEbRKSt7variantIJNS_28GrayskullComputeKernelConfigENS_27WormholeComputeKernelConfigEEEbbbbb+0x18f1) [0x7f81e191bdf1] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(_ZN4ttnn10operations4conv6conv2d6conv2dIN2tt8tt_metal2v07IDeviceEEESt5tupleIJNS5_6TensorEjjS9_St8optionalIS9_EEERKS9_SE_PT_jjjjjSt5arrayIjLm2EESI_SI_SI_jSA_ISD_ERKSA_IKNS2_12Conv2dConfigEERKSA_IKSt7variantIJNS_28GrayskullComputeKernelConfigENS_27WormholeComputeKernelConfigEEEERKSA_IKNS5_12MemoryConfigEE+0xf7b) [0x7f81e190994b] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/libTTMLIR.so(+0x775ca3) [0x7f81e616fca3] --- tt::runtime::ttnn::operations::conv::run(tt::target::ttnn::Conv2dOp const*, tt::runtime::ttnn::ProgramContext&) --- tt::runtime::ttnn::runProgram(tt::tt_metal::distributed::MeshDevice&, tt::runtime::Binary, unsigned int, std::vector<tt::tt_metal::Tensor*, std::allocator<tt::tt_metal::Tensor*> > const&) --- tt::runtime::ttnn::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::runtime::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::run_binary(tt::runtime::Binary&, int, std::vector<at::Tensor, std::allocator<at::Tensor> > const&) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x3174e0) [0x7f81f28e34e0] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x31742e) [0x7f81f28e342e] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0xe0cf5) [0x7f81f26accf5] --- /opt/ttmlir-toolchain/venv/bin/python(+0x18ab32) [0x55fd773c2b32] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55fd773b939b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x55fd773b2a97] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0xc4) [0x55fd773b8574] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55fd773cd62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55fd774d5464] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55fd773d110b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55fd773ad790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0x122) [0x55fd773d1172] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55fd773ae9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55fd773d04d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55fd773b861d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55fd773cd62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55fd774d5464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55fd773b939b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55fd773b399e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x55fd773ad97f] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55fd773ae9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55fd773d04d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55fd773b861d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55fd773cd62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55fd774d5464] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55fd773d110b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55fd773ad790] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55fd773d04d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55fd773ae9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55fd773ad790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55fd773ae9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55fd773ae9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55fd773d04d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55fd773b861d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55fd773cd62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55fd774d5464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55fd773b939b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55fd773b399e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55fd773ae9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702]
test_xception.test_xception_timm[xception]: forge/test/models/pytorch/vision/xception/test_xception.py#L65
RuntimeError: TT_FATAL @ /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal/ttnn/cpp/ttnn/operations/pool/generic/device/pool_op.cpp:37: (input_shape[3] % tt::constants::TILE_WIDTH == 0) || (input_shape[3] == 16) info: Input channels (728) should be padded to nearest TILE_WIDTH (32) or should be 16 backtrace: --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x3f4309) [0x7f81e191f309] --- ttnn::operations::pool::validate_pool2d(tt::tt_metal::Tensor const&, ttnn::operations::sliding_window::SlidingWindowConfig const&, tt::tt_metal::MemoryConfig const&) --- void ttnn::device_operation::detail::launch_on_worker_thread<ttnn::operations::pool::Pool2D, unsigned char, long, ttnn::operations::pool::Pool2D::operation_attributes_t, ttnn::operations::pool::Pool2D::tensor_args_t, tt::tt_metal::Tensor, tt::tt_metal::v0::IDevice*>(unsigned char, long, ttnn::operations::pool::Pool2D::operation_attributes_t const&, ttnn::operations::pool::Pool2D::tensor_args_t const&, tt::tt_metal::Tensor&, tt::tt_metal::v0::IDevice*&) --- ttnn::operations::pool::Pool2D::tensor_return_value_t ttnn::device_operation::detail::launch_on_single_device<ttnn::operations::pool::Pool2D>(unsigned char, ttnn::operations::pool::Pool2D::operation_attributes_t const&, ttnn::operations::pool::Pool2D::tensor_args_t const&) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x174dee9) [0x7f81e2c78ee9] --- ttnn::operations::pool::Pool2D::tensor_return_value_t ttnn::device_operation::detail::invoke<ttnn::operations::pool::Pool2D>(unsigned char, ttnn::operations::pool::Pool2D::operation_attributes_t const&, ttnn::operations::pool::Pool2D::tensor_args_t const&) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x174d96f) [0x7f81e2c7896f] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/lib/_ttnn.so(+0x1745598) [0x7f81e2c70598] --- ttnn::operations::pool::Pool2DOp<(ttnn::operations::pool::Pool2DType)0>::invoke(unsigned char, tt::tt_metal::Tensor const&, unsigned int, unsigned int, unsigned int, unsigned int, std::array<unsigned int, 2ul>, std::array<unsigned int, 2ul>, std::array<unsigned int, 2ul>, std::array<unsigned int, 2ul>, std::optional<tt::tt_metal::MemoryConfig const> const&, std::optional<tt::tt_metal::TensorMemoryLayout const>, bool) --- tt::runtime::ttnn::operations::pool::run(tt::target::ttnn::MaxPool2dOp const*, tt::runtime::ttnn::ProgramContext&) --- tt::runtime::ttnn::runProgram(tt::tt_metal::distributed::MeshDevice&, tt::runtime::Binary, unsigned int, std::vector<tt::tt_metal::Tensor*, std::allocator<tt::tt_metal::Tensor*> > const&) --- tt::runtime::ttnn::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::runtime::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::run_binary(tt::runtime::Binary&, int, std::vector<at::Tensor, std::allocator<at::Tensor> > const&) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x3174e0) [0x7f81f28e34e0] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x31742e) [0x7f81f28e342e] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0xe0cf5) [0x7f81f26accf5] --- /opt/ttmlir-toolchain/venv/bin/python(+0x18ab32) [0x55fd773c2b32] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55fd773b939b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x55fd773b2a97] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0xc4) [0x55fd773b8574] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55fd773cd62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55fd774d5464] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55fd773d110b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55fd773ad790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0x122) [0x55fd773d1172] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55fd773ae9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55fd773d04d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55fd773b861d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55fd773cd62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55fd774d5464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55fd773b939b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55fd773b399e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x55fd773ad97f] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55fd773ae9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55fd773d04d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55fd773b861d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55fd773cd62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55fd774d5464] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55fd773d110b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55fd773ad790] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55fd773d04d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55fd773ae9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55fd773ad790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55fd773ae9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55fd773ae9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55fd773d04d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55fd773b861d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55fd773cd62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55fd774d5464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55fd773b939b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55fd773b399e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55fd773afc30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55fd773ae9ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x55fd773d04d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55fd773b2702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55fd773c338c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55fd773b861d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55fd773cd62c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x55fd774d5464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55fd773b939b]
test_yolox.test_yolox_pytorch[yolox_nano]: forge/test/models/pytorch/vision/yolo/test_yolox.py#L94
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_stereo.test_stereo[facebook/musicgen-small]: forge/test/models/pytorch/audio/stereo/test_stereo.py#L46
RuntimeError: TT_ASSERT @ /__w/tt-forge-fe/tt-forge-fe/forge/csrc/graph_lib/shape.cpp:135: (i >= 0) && (i < (int)dims_.size()) info: Trying to access element outside of dimensions: 3 backtrace: --- tt::graphlib::Shape::operator[](int) --- tt::passes::commute_through_concat(tt::graphlib::Graph*, tt::graphlib::OpNode*, tt::graphlib::OpNode*, tt::graphlib::Node*, tt::graphlib::Shape*, tt::graphlib::Shape*, bool, bool*, std::pair<int, int>*, tt::graphlib::OpType*, bool) --- tt::passes::can_commute_past_op(tt::graphlib::OpNode*, tt::graphlib::OpNode*, tt::graphlib::Graph*, tt::graphlib::Shape*, tt::graphlib::Shape*, bool, tt::graphlib::Node*) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x18fc4f) [0x7f481c59ec4f] --- tt::passes::erase_inverse_ops(tt::graphlib::Graph*) --- tt::run_optimization_graph_passes(tt::graphlib::Graph*) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0xfda39) [0x7f481c50ca39] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0xe0cf5) [0x7f481c4efcf5] --- /opt/ttmlir-toolchain/venv/bin/python(+0x18ab32) [0x557daf22bb32] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x557daf22239b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x557daf21ba97] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x557daf216790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x557daf216790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x557daf2179ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0x122) [0x557daf23a172] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x557daf218c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x557daf218c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x557daf2179ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x557daf21b702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x557daf2394d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x557daf21b702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x557daf22161d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x557daf23662c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x557daf33e464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x557daf22239b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x557daf21c99e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x557daf21697f] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x557daf218c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x557daf2179ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x557daf21b702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x557daf2394d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x557daf21b702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x557daf22161d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x557daf23662c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x557daf33e464] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x557daf23a10b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x557daf218c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x557daf216790] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x557daf2394d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x557daf2179ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x557daf218c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x557daf216790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x557daf2179ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x557daf218c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x557daf2179ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x557daf21b702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x557daf2394d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x557daf21b702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x557daf22161d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x557daf23662c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x557daf33e464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x557daf22239b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x557daf21c99e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x557daf218c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x557daf2179ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x557daf21b702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x557daf2394d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x557daf21b702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x557daf22161d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x557daf23662c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x557daf33e464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x557daf22239b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x557daf21c99e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x557daf216790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x557daf216790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x557daf218c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x557daf2179ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x557daf22c38c]
test_codegen.test_codegen[Salesforce/codegen-350M-mono]: forge/test/models/pytorch/text/codegen/test_codegen.py#L74
AssertionError: Data mismatch on output 0 between framework and Forge codegen
test_gemma_2b.test_gemma_2b[google/gemma-2b]: forge/test/models/pytorch/text/gemma/test_gemma_2b.py#L368
RuntimeError: Input count mismatch: expected 366, got 367
test_t5.test_t5_generation[t5-small]: forge/test/models/pytorch/text/t5/test_t5.py#L168
ValueError: Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model=tensor([[[-21.42685, -7.10311, -13.34142, ..., -40.87328, -40.79771, -40.71077]]], grad_fn=<UnsafeViewBackward0>), compiled_model=tensor([[[ 15.12560, -7.13685, -9.70421, ..., -35.87063, -35.87774, -35.95815]]])
test_alexnet.test_alexnet_torchhub: forge/test/models/pytorch/vision/alexnet/test_alexnet.py#L59
RuntimeError: Failed to run MLIR compiler pass pipeline.
test_densenet.test_densenet_169_pytorch[densenet169]: forge/test/models/pytorch/vision/densenet/test_densenet.py#L114
RuntimeError: Tensor 0 - stride mismatch: expected [150528, 50176, 224, 1], got [3, 1, 672, 3]
test_hrnet.test_hrnet_timm_pytorch[hrnet_w18_small]: forge/test/models/pytorch/vision/hrnet/test_hrnet.py#L174
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_inception_v4.test_inception_v4_osmr_pytorch: forge/test/models/pytorch/vision/inception/test_inception_v4.py#L48
RuntimeError: Tensor 47 - stride mismatch: expected [1225, 1], got [0, 0]
test_rcnn.test_rcnn_pytorch: forge/test/models/pytorch/vision/rcnn/test_rcnn.py#L93
RuntimeError: Failed to run MLIR compiler pass pipeline.
test_yolo_v5.test_yolov5_320x320[yolov5s]: forge/test/models/onnx/vision/yolo/test_yolo_v5.py#L52
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_yolo_v6.test_yolo_v6_pytorch[yolov6n]: forge/test/models/pytorch/vision/yolo/test_yolo_v6.py#L68
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_stereo.test_stereo[facebook/musicgen-small]: forge/test/models/pytorch/audio/stereo/test_stereo.py#L46
RuntimeError: TT_ASSERT @ /__w/tt-forge-fe/tt-forge-fe/forge/csrc/graph_lib/shape.cpp:135: (i >= 0) && (i < (int)dims_.size()) info: Trying to access element outside of dimensions: 3 backtrace: --- tt::graphlib::Shape::operator[](int) --- tt::passes::commute_through_concat(tt::graphlib::Graph*, tt::graphlib::OpNode*, tt::graphlib::OpNode*, tt::graphlib::Node*, tt::graphlib::Shape*, tt::graphlib::Shape*, bool, bool*, std::pair<int, int>*, tt::graphlib::OpType*, bool) --- tt::passes::can_commute_past_op(tt::graphlib::OpNode*, tt::graphlib::OpNode*, tt::graphlib::Graph*, tt::graphlib::Shape*, tt::graphlib::Shape*, bool, tt::graphlib::Node*) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0x18fc4f) [0x7fd3ccd4ac4f] --- tt::passes::erase_inverse_ops(tt::graphlib::Graph*) --- tt::run_optimization_graph_passes(tt::graphlib::Graph*) --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0xfda39) [0x7fd3cccb8a39] --- /opt/ttmlir-toolchain/venv/lib/python3.10/site-packages/forge/_C.so(+0xe0cf5) [0x7fd3ccc9bcf5] --- /opt/ttmlir-toolchain/venv/bin/python(+0x18ab32) [0x562a23307b32] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x562a232fe39b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x562a232f7a97] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x562a232f2790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x562a232f2790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x562a232f39ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0x122) [0x562a23316172] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x562a232f4c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x562a232f4c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x562a232f39ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x562a232f7702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x562a233154d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x562a232f7702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x562a232fd61d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x562a2331262c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x562a2341a464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x562a232fe39b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x562a232f899e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x562a232f297f] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x562a232f4c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x562a232f39ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x562a232f7702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x562a233154d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x562a232f7702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x562a232fd61d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x562a2331262c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x562a2341a464] --- /opt/ttmlir-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x562a2331610b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x562a232f4c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x562a232f2790] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x562a233154d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x562a232f39ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x562a232f4c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x562a232f2790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x562a232f39ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x562a232f4c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x562a232f39ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x562a232f7702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x562a233154d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x562a232f7702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x562a232fd61d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x562a2331262c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x562a2341a464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x562a232fe39b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x562a232f899e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x562a232f4c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x562a232f39ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x562a232f7702] --- /opt/ttmlir-toolchain/venv/bin/python(+0x1984d1) [0x562a233154d1] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x562a232f7702] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x562a232fd61d] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x562a2331262c] --- /opt/ttmlir-toolchain/venv/bin/python(+0x29d464) [0x562a2341a464] --- /opt/ttmlir-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x562a232fe39b] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x562a232f899e] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x562a232f2790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x562a232f2790] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x562a232f4c30] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c] --- /opt/ttmlir-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x562a232f39ab] --- /opt/ttmlir-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x562a2330838c]
test_codegen.test_codegen[Salesforce/codegen-350M-mono]: forge/test/models/pytorch/text/codegen/test_codegen.py#L74
AssertionError: Data mismatch on output 0 between framework and Forge codegen
test_gemma_2b.test_gemma_2b[google/gemma-2b]: forge/test/models/pytorch/text/gemma/test_gemma_2b.py#L368
RuntimeError: Input count mismatch: expected 366, got 367
test_t5.test_t5_generation[t5-small]: forge/test/models/pytorch/text/t5/test_t5.py#L168
ValueError: Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model=tensor([[[-21.42685, -7.10311, -13.34142, ..., -40.87328, -40.79771, -40.71077]]], grad_fn=<UnsafeViewBackward0>), compiled_model=tensor([[[ 15.12560, -7.13685, -9.70421, ..., -35.87063, -35.87774, -35.95815]]])
test_alexnet.test_alexnet_torchhub: forge/test/models/pytorch/vision/alexnet/test_alexnet.py#L59
RuntimeError: Failed to run MLIR compiler pass pipeline.
test_densenet.test_densenet_169_pytorch[densenet169]: forge/test/models/pytorch/vision/densenet/test_densenet.py#L114
RuntimeError: Tensor 0 - stride mismatch: expected [150528, 50176, 224, 1], got [3, 1, 672, 3]
test_hrnet.test_hrnet_timm_pytorch[hrnet_w18_small]: forge/test/models/pytorch/vision/hrnet/test_hrnet.py#L174
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_inception_v4.test_inception_v4_osmr_pytorch: forge/test/models/pytorch/vision/inception/test_inception_v4.py#L48
RuntimeError: Tensor 47 - stride mismatch: expected [1225, 1], got [0, 0]
test_rcnn.test_rcnn_pytorch: forge/test/models/pytorch/vision/rcnn/test_rcnn.py#L93
RuntimeError: Failed to run MLIR compiler pass pipeline.
test_yolo_v5.test_yolov5_320x320[yolov5s]: forge/test/models/onnx/vision/yolo/test_yolo_v5.py#L52
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_yolo_v6.test_yolo_v6_pytorch[yolov6n]: forge/test/models/pytorch/vision/yolo/test_yolo_v6.py#L68
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
pre-commit / pre-commit
The `python-version` input is not set. The version of Python currently in `PATH` will be used.
docker-build / run-tests (n150, 1)
⚠️ Action requires a valid issue number (PR reference) to be able to attach a comment..
docker-build / run-tests (n300, 1)
⚠️ Action requires a valid issue number (PR reference) to be able to attach a comment..
docker-build / run-tests (n300, 2)
⚠️ Action requires a valid issue number (PR reference) to be able to attach a comment..
docker-build / run-tests (n150, 2)
⚠️ Action requires a valid issue number (PR reference) to be able to attach a comment..

Artifacts

Produced during runtime
Name Size
build-forge-ubuntu-latest
328 MB
test-log-n150-1
231 KB
test-log-n150-2
231 KB
test-log-n300-1
231 KB
test-log-n300-2
231 KB
test-reports-n150-1
8.84 KB
test-reports-n150-2
9.88 KB
test-reports-n300-1
8.8 KB
test-reports-n300-2
9.81 KB