Skip to content
On PR

Add CPU test for ModernBert Model #2264

Sign in to view logs

Add CPU test for ModernBert Model

Add CPU test for ModernBert Model #2264

Triggered via pull request January 30, 2025 13:24
@pdeviTTpdeviTT
synchronize #1130
pdevi/modernbert
Status Failure
Total duration 2h 31m 32s
Artifacts –

on-pr.yml

on: pull_request
docker-build  /  ...  /  build-image
2h 31m
docker-build / docker-build / build-image
spdx  /  check-spdx-headers
5s
spdx / check-spdx-headers
pre-commit  /  pre-commit
50s
pre-commit / pre-commit
Matrix: docker-build / build-and-test
Fit to window
Zoom out
Zoom in

Annotations

60 errors and 2 warnings
docker-build / docker-build / build-image
System.IO.IOException: No space left on device : '/home/ubuntu/actions-runner/_diag/Worker_20250130-132412-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at GitHub.Runner.Common.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id) at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at GitHub.Runner.Worker.Worker.RunAsync(String pipeIn, String pipeOut) at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args) System.IO.IOException: No space left on device : '/home/ubuntu/actions-runner/_diag/Worker_20250130-132412-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at GitHub.Runner.Common.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id) at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at GitHub.Runner.Common.Tracing.Error(Exception exception) at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args) Unhandled exception. System.IO.IOException: No space left on device : '/home/ubuntu/actions-runner/_diag/Worker_20250130-132412-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at System.Diagnostics.TraceSource.Flush() at GitHub.Runner.Common.Tracing.Dispose(Boolean disposing) at GitHub.Runner.Common.Tracing.Dispose() at GitHub.Runner.Common.TraceManager.Dispose(Boolean disposing) at GitHub.Runner.Common.TraceManager.Dispose() at GitHub.Runner.Common.HostContext.Dispose(Boolean disposing) at GitHub.Runner.Common.HostContext.Dispose() at GitHub.Runner.Worker.Program.Main(String[] args)
test_whisper_0.test_whisper[openai/whisper-tiny]: forge/test/models/pytorch/audio/whisper/test_whisper_0.py#L94
AssertionError: Eltwise binary ops must have the same shape in both inputs, or one operand must be 1 wide to broadcast: [1, 3000, 1, 384] vs [1, 384, 3000, 1]
test_bart.test_pt_bart_classifier[facebook/bart-large-mnli]: forge/test/models/pytorch/text/bart/test_bart.py#L66
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_distilbert.test_distilbert_masked_lm_pytorch[distilbert-base-uncased]: forge/test/models/pytorch/text/distilbert/test_distilbert.py#L59
RuntimeError: Generated MLIR module failed verification.
test_fuyu_8b.test_fuyu8b[adept/fuyu-8b]: forge/test/models/pytorch/text/fuyu/test_fuyu_8b.py#L83
RuntimeError: TT_ASSERT @ /__w/tt-forge-fe/tt-forge-fe/forge/csrc/graph_lib/shape.cpp:135: (i >= 0) && (i < (int)dims_.size()) info: Trying to access element outside of dimensions: 3 backtrace: --- tt::graphlib::Shape::operator[](int) --- tt::passes::commute_through_concat(tt::graphlib::Graph*, tt::graphlib::OpNode*, tt::graphlib::OpNode*, tt::graphlib::Node*, tt::graphlib::Shape*, tt::graphlib::Shape*, bool, bool*, std::pair<int, int>*, tt::graphlib::OpType*, bool) --- tt::passes::can_commute_past_op(tt::graphlib::OpNode*, tt::graphlib::OpNode*, tt::graphlib::Graph*, tt::graphlib::Shape*, tt::graphlib::Shape*, bool, tt::graphlib::Node*) --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x19070f) [0x7f4611a9270f] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x19085d) [0x7f4611a9285d] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x19085d) [0x7f4611a9285d] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x19085d) [0x7f4611a9285d] --- tt::passes::erase_inverse_ops(tt::graphlib::Graph*) --- tt::run_optimization_graph_passes(tt::graphlib::Graph*) --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0xfe4e9) [0x7f4611a004e9] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0xe17a5) [0x7f46119e37a5] --- /opt/ttforge-toolchain/venv/bin/python(+0x18ab32) [0x5581df633b32] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5581df62a39b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x5581df623a97] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5581df61e790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5581df61e790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0x122) [0x5581df642172] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x5581df6414d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5581df62961d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5581df63e62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x5581df746464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5581df62a39b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x5581df62499e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x5581df61e97f] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x5581df6414d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5581df62961d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5581df63e62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x5581df746464] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x5581df64210b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5581df61e790] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x5581df6414d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5581df61e790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x5581df6414d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5581df62961d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5581df63e62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x5581df746464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5581df62a39b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x5581df62499e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x5581df6414d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5581df62961d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5581df63e62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x5581df746464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5581df62a39b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x5581df62499e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5581df61e790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5581df61e790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30]
test_qwen_coder.test_qwen_clm[Qwen/Qwen2.5-Coder-0.5B]: forge/test/models/pytorch/text/qwen/test_qwen_coder.py#L58
NotImplementedError: Unknown output type: <class 'transformers.cache_utils.DynamicCache'>
test_t5.test_t5_generation[google_flan_t5_small]: forge/test/models/pytorch/text/t5/test_t5.py#L168
ValueError: Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model=tensor([[[-33.09930, -0.46325, -3.45815, ..., -32.99524, -33.03174, -32.80391]]], grad_fn=<UnsafeViewBackward0>), compiled_model=tensor([[[-33.57178, -0.25877, -2.85354, ..., -33.39930, -33.48883, -33.16014]]])
test_xglm.test_xglm_causal_lm[facebook/xglm-564M]: forge/test/models/pytorch/text/xglm/test_xglm.py#L54
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_deit.test_deit_imgcls_hf_pytorch[facebook/deit-base-patch16-224]: forge/test/models/pytorch/vision/deit/test_deit.py#L63
RuntimeError: Failed to run MLIR compiler pass pipeline.
test_densenet.test_densenet_121_pytorch[densenet121_hf_xray]: forge/test/models/pytorch/vision/densenet/test_densenet.py#L52
AssertionError: Encountered unsupported op types. Check error logs for more details
test_detr.test_detr_detection[facebook/detr-resnet-50]: forge/test/models/pytorch/vision/detr/test_detr.py#L42
AttributeError: <class 'tvm.ir.op.Op'> has no attribute name_hint
test_hrnet.test_hrnet_osmr_pytorch[hrnet_w18_small_v1]: forge/test/models/pytorch/vision/hrnet/test_hrnet.py#L98
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_monodle.test_monodle_pytorch: forge/test/models/pytorch/vision/monodle/test_monodle.py#L47
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_regnet.test_regnet[facebook/regnet-y-040]: forge/test/models/pytorch/vision/regnet/test_regnet.py#L40
RuntimeError: Unknown type of tensor: <class 'transformers.modeling_outputs.BaseModelOutputWithPoolingAndNoAttention'>
test_swin.test_swin_v1_tiny_4_224_hf_pytorch[microsoft/swin-tiny-patch4-window7-224]: forge/test/models/pytorch/vision/swin/test_swin.py#L40
RuntimeError: Unknown model (swin-tiny-patch4-window7-224)
test_unet.test_unet_osmr_cityscape_pytorch: forge/test/models/pytorch/vision/unet/test_unet.py#L53
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_vgg.test_vgg_osmr_pytorch[vgg11]: forge/test/models/pytorch/vision/vgg/test_vgg.py#L66
RuntimeError: Failed to run MLIR compiler pass pipeline.
test_vovnet.test_vovnet_osmr_pytorch[vovnet27s]: forge/test/models/pytorch/vision/vovnet/test_vovnet.py#L51
RuntimeError: TT_FATAL @ /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal/ttnn/cpp/ttnn/tensor/tensor_utils.cpp:50: new_volume == old_volume info: Invalid arguments to reshape backtrace: --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x694828) [0x7f4611439828] --- tt::tt_metal::infer_dims_for_reshape(tt::tt_metal::Tensor const&, tt::stl::Span<int const, 18446744073709551615ul>) --- ttnn::operations::data_movement::ReshapeViewOperation::invoke(tt::tt_metal::Tensor const&, tt::stl::Span<int const, 18446744073709551615ul>) --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x77cb9b) [0x7f4611521b9b] --- tt::runtime::ttnn::operations::data_movement::run(tt::target::ttnn::ReshapeOp const*, tt::runtime::ttnn::ProgramContext&) --- tt::runtime::ttnn::runProgram(tt::tt_metal::distributed::MeshDevice&, tt::runtime::Binary, unsigned int, std::vector<tt::tt_metal::Tensor*, std::allocator<tt::tt_metal::Tensor*> > const&) --- tt::runtime::ttnn::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::runtime::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::run_binary(tt::runtime::Binary&, int, std::vector<at::Tensor, std::allocator<at::Tensor> > const&) --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x316b30) [0x7f4611c18b30] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x316a7e) [0x7f4611c18a7e] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0xe17a5) [0x7f46119e37a5] --- /opt/ttforge-toolchain/venv/bin/python(+0x18ab32) [0x5581df633b32] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5581df62a39b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x5581df623a97] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0xc4) [0x5581df629574] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5581df63e62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x5581df746464] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x5581df64210b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5581df61e790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0x122) [0x5581df642172] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x5581df6414d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5581df62961d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5581df63e62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x5581df746464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5581df62a39b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x5581df62499e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x5581df61e97f] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x5581df6414d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5581df62961d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5581df63e62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x5581df746464] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x5581df64210b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5581df61e790] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x5581df6414d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5581df61e790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x5581df6414d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5581df62961d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5581df63e62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x5581df746464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5581df62a39b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x5581df62499e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x5581df620c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x5581df61f9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x5581df6414d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x5581df623702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x5581df62961d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x5581df63e62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x5581df746464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x5581df62a39b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x5581df62499e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5581df61e790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x5581df63438c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x5581df61e790]
test_yolo_v5.test_yolov5_480x480[yolov5s]: forge/test/models/onnx/vision/yolo/test_yolo_v5.py#L134
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_stereo.test_stereo[facebook/musicgen-small]: forge/test/models/pytorch/audio/stereo/test_stereo.py#L39
RuntimeError: Failed to import transformers.models.timm_wrapper.configuration_timm_wrapper because of the following error (look up to see its traceback): cannot import name 'ImageNetInfo' from 'timm.data' (/opt/ttforge-toolchain/venv/lib/python3.10/site-packages/timm/data/__init__.py)
test_stable_diffusion_xl.test_stable_diffusion_generation[stable-diffusion-xl-base-1.0]: forge/test/models/pytorch/multimodal/stable_diffusion/test_stable_diffusion_xl.py#L64
NotImplementedError: Unknown output type: <class 'PIL.Image.Image'>
test_gptneo.test_gptneo_causal_lm[EleutherAI/gpt-neo-125M]: forge/test/models/pytorch/text/gptneo/test_gptneo.py#L76
AssertionError: Data mismatch on output 0 between framework and Forge codegen
test_mistral.test_mistral[mistralai/Mistral-7B-v0.1]: forge/test/models/pytorch/text/mistral/test_mistral.py#L94
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_t5.test_t5_generation[t5-small]: forge/test/models/pytorch/text/t5/test_t5.py#L168
ValueError: Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model=tensor([[[-21.42685, -7.10311, -13.34143, ..., -40.87328, -40.79771, -40.71077]]], grad_fn=<UnsafeViewBackward0>), compiled_model=tensor([[[ 15.12560, -7.13685, -9.70421, ..., -35.87063, -35.87774, -35.95815]]])
test_efficientnet.test_efficientnet_torchvision[efficientnet_b0]: forge/test/models/pytorch/vision/efficientnet/test_efficientnet.py#L163
RuntimeError: TT_THROW @ /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal/tt_metal/impl/program/program.cpp:898: tt::exception info: Statically allocated circular buffers on core range [(x=0,y=0) - (x=6,y=6)] grow to 1942368 B which is beyond max L1 size of 1499136 B backtrace: --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/libtt_metal.so(+0x1657eb) [0x7f2f345e17eb] --- tt::tt_metal::detail::Program_::validate_circular_buffer_region(tt::tt_metal::v0::IDevice const*) --- tt::tt_metal::v0::CommandQueue::run_command_impl(tt::tt_metal::CommandInterface const&) --- tt::tt_metal::v0::EnqueueProgram(tt::tt_metal::v0::CommandQueue&, tt::tt_metal::v0::Program&, bool) --- void ttnn::device_operation::detail::launch_on_worker_thread<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >, unsigned char, long, tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >, tt::tt_metal::v0::IDevice*>(unsigned char, long, tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >&, tt::tt_metal::v0::IDevice*&) --- tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_return_value_t ttnn::device_operation::detail::launch_on_single_device<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > >(unsigned char, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::operation_attributes_t const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&) --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x306fe99) [0x7f2f23364e99] --- tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_return_value_t ttnn::device_operation::detail::invoke<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > >(unsigned char, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::operation_attributes_t const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&) --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x306c5df) [0x7f2f233615df] --- std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > tt::tt_metal::operation::run_without_autoformat<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >(tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >&&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > > const&, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > > const&, unsigned char) --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x46873f) [0x7f2f2075d73f] --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x471d90) [0x7f2f20766d90] --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x4729ec) [0x7f2f207679ec] --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(_ZN4ttnn10operations4conv6conv2d18optimized_conv_newERKN2tt8tt_metal6TensorES7_St8optionalIS6_ERKNS0_14sliding_window19SlidingWindowConfigEjjbbRKNS2_34OptimizedConvParallelizationConfigERKNS2_24OptimizedConvBlockConfigERKNS4_12MemoryConfigENS4_8DataTypeESt5arrayIjLm4EEbRKSt7variantIJNS_28GrayskullComputeKernelConfigENS_27WormholeComputeKernelConfigEEEbbbbb+0x18f1) [0x7f2f206e5df1] --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(_ZN4ttnn10operations4conv6conv2d6conv2dIN2tt8tt_metal2v07IDeviceEEESt5tupleIJNS5_6TensorEjjS9_St8optionalIS9_EEERKS9_SE_PT_jjjjjSt5arrayIjLm2EESI_SI_SI_jSA_ISD_ERKSA_IKNS2_12Conv2dConfigEERKSA_IKSt7variantIJNS_28GrayskullComputeKernelConfigENS_27WormholeComputeKernelConfigEEEERKSA_IKNS5_12MemoryConfigEE+0xf7b) [0x7f2f206d394b] --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x761d13) [0x7f2f357b2d13] --- tt::runtime::ttnn::operations::conv::run(tt::target::ttnn::Conv2dOp const*, tt::runtime::ttnn::ProgramContext&) --- tt::runtime::ttnn::runProgram(tt::tt_metal::distributed::MeshDevice&, tt::runtime::Binary, unsigned int, std::vector<tt::tt_metal::Tensor*, std::allocator<tt::tt_metal::Tensor*> > const&) --- tt::runtime::ttnn::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::runtime::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::run_binary(tt::runtime::Binary&, int, std::vector<at::Tensor, std::allocator<at::Tensor> > const&) --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x316b30) [0x7f2f35ec4b30] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x316a7e) [0x7f2f35ec4a7e] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0xe17a5) [0x7f2f35c8f7a5] --- /opt/ttforge-toolchain/venv/bin/python(+0x18ab32) [0x56006c6d2b32] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x56006c6c939b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x56006c6c2a97] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0xc4) [0x56006c6c8574] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x56006c6dd62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x56006c7e5464] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x56006c6e110b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x56006c6bd790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0x122) [0x56006c6e1172] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x56006c6be9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x56006c6e04d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x56006c6c861d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x56006c6dd62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x56006c7e5464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x56006c6c939b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x56006c6c399e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x56006c6bd97f] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x56006c6be9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x56006c6e04d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x56006c6c861d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x56006c6dd62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x56006c7e5464] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x56006c6e110b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x56006c6bd790] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x56006c6e04d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x56006c6be9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x56006c6bd790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x56006c6be9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x56006c6be9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x56006c6e04d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x56006c6c861d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x56006c6dd62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x56006c7e5464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x56006c6c939b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x56006c6c399e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x56006c6be9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702]
test_fpn.test_fpn_pytorch: forge/test/models/onnx/vision/fpn/test_fpn.py#L34
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_googlenet.test_googlenet_pytorch: forge/test/models/pytorch/vision/googlenet/test_googlenet.py#L59
RuntimeError: TT_FATAL @ /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal/ttnn/cpp/ttnn/tensor/tensor_utils.cpp:50: new_volume == old_volume info: Invalid arguments to reshape backtrace: --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x694828) [0x7f2f356e5828] --- tt::tt_metal::infer_dims_for_reshape(tt::tt_metal::Tensor const&, tt::stl::Span<int const, 18446744073709551615ul>) --- ttnn::operations::data_movement::ReshapeViewOperation::invoke(tt::tt_metal::Tensor const&, tt::stl::Span<int const, 18446744073709551615ul>) --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x77cb9b) [0x7f2f357cdb9b] --- tt::runtime::ttnn::operations::data_movement::run(tt::target::ttnn::ReshapeOp const*, tt::runtime::ttnn::ProgramContext&) --- tt::runtime::ttnn::runProgram(tt::tt_metal::distributed::MeshDevice&, tt::runtime::Binary, unsigned int, std::vector<tt::tt_metal::Tensor*, std::allocator<tt::tt_metal::Tensor*> > const&) --- tt::runtime::ttnn::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::runtime::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::run_binary(tt::runtime::Binary&, int, std::vector<at::Tensor, std::allocator<at::Tensor> > const&) --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x316b30) [0x7f2f35ec4b30] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x316a7e) [0x7f2f35ec4a7e] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0xe17a5) [0x7f2f35c8f7a5] --- /opt/ttforge-toolchain/venv/bin/python(+0x18ab32) [0x56006c6d2b32] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x56006c6c939b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x56006c6c2a97] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0xc4) [0x56006c6c8574] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x56006c6dd62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x56006c7e5464] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x56006c6e110b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x56006c6bd790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0x122) [0x56006c6e1172] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x56006c6be9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x56006c6e04d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x56006c6c861d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x56006c6dd62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x56006c7e5464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x56006c6c939b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x56006c6c399e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x56006c6bd97f] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x56006c6be9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x56006c6e04d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x56006c6c861d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x56006c6dd62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x56006c7e5464] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x56006c6e110b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x56006c6bd790] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x56006c6e04d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x56006c6be9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x56006c6bd790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x56006c6be9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x56006c6be9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x56006c6e04d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x56006c6c861d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x56006c6dd62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x56006c7e5464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x56006c6c939b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x56006c6c399e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x56006c6bfc30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x56006c6be9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x56006c6e04d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x56006c6c2702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x56006c6c861d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x56006c6dd62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x56006c7e5464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x56006c6c939b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x56006c6c399e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x56006c6bd790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x56006c6d338c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x56006c6bd790]
test_mlp_mixer.test_mlp_mixer_timm_pytorch[mixer_b16_224]: forge/test/models/pytorch/vision/mlp_mixer/test_mlp_mixer.py#L52
NameError: name 'model' is not defined
test_rcnn.test_rcnn_pytorch: forge/test/models/pytorch/vision/rcnn/test_rcnn.py#L93
RuntimeError: Failed to run MLIR compiler pass pipeline.
test_segformer.test_segformer_image_classification_pytorch[nvidia/mit-b0]: forge/test/models/pytorch/vision/segformer/test_segformer.py#L61
RuntimeError: Failed to run MLIR compiler pass pipeline.
test_yolo_v5.test_yolov5_320x320[yolov5s]: forge/test/models/onnx/vision/yolo/test_yolo_v5.py#L52
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_yolo_v6.test_yolo_v6_pytorch[yolov6n]: forge/test/models/pytorch/vision/yolo/test_yolo_v6.py#L68
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_clip.test_clip_pytorch[openai/clip-vit-base-patch32]: forge/test/models/pytorch/multimodal/clip/test_clip.py#L53
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_gpt2.test_gpt2_text_gen[gpt2]: forge/test/models/pytorch/text/gpt2/test_gpt2.py#L55
RuntimeError: Tensor 6 - data type mismatch: expected Float32, got UInt8
test_opt.test_opt_causal_lm[facebook/opt-125m]: forge/test/models/pytorch/text/opt/test_opt.py#L63
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_phi2.test_phi2_clm[microsoft/phi-2]: forge/test/models/pytorch/text/phi2/test_phi2.py#L67
AssertionError: Data mismatch on output 0 between framework and Forge codegen
test_qwen_v2.test_qwen_clm[Qwen/Qwen2.5-0.5B]: forge/test/models/pytorch/text/qwen/test_qwen_v2.py#L56
NotImplementedError: Unknown output type: <class 'transformers.cache_utils.DynamicCache'>
test_roberta.test_roberta_masked_lm[xlm-roberta-base]: forge/test/models/pytorch/text/roberta/test_roberta.py#L49
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_t5.test_t5_generation[t5-base]: forge/test/models/pytorch/text/t5/test_t5.py#L168
ValueError: Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model=tensor([[[-18.88008, -10.41466, -14.89029, ..., -43.63989, -43.76201, -43.71423]]], grad_fn=<UnsafeViewBackward0>), compiled_model=tensor([[[-31.69363, -10.19963, -13.79479, ..., -44.44143, -44.45059, -44.40383]]])
test_autoencoder.test_conv_ae_pytorch: forge/test/models/pytorch/vision/autoencoder/test_autoencoder.py#L51
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_densenet.test_densenet_161_pytorch[densenet161]: forge/test/models/pytorch/vision/densenet/test_densenet.py#L84
RuntimeError: Tensor 0 - stride mismatch: expected [150528, 50176, 224, 1], got [3, 1, 672, 3]
test_efficientnet.test_efficientnet_timm[efficientnet_b0]: forge/test/models/pytorch/vision/efficientnet/test_efficientnet.py#L93
RuntimeError: TT_THROW @ /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal/tt_metal/impl/program/program.cpp:898: tt::exception info: Statically allocated circular buffers on core range [(x=0,y=0) - (x=6,y=6)] grow to 1942368 B which is beyond max L1 size of 1499136 B backtrace: --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/libtt_metal.so(+0x1657eb) [0x7f4515c0f7eb] --- tt::tt_metal::detail::Program_::validate_circular_buffer_region(tt::tt_metal::v0::IDevice const*) --- tt::tt_metal::v0::CommandQueue::run_command_impl(tt::tt_metal::CommandInterface const&) --- tt::tt_metal::v0::EnqueueProgram(tt::tt_metal::v0::CommandQueue&, tt::tt_metal::v0::Program&, bool) --- void ttnn::device_operation::detail::launch_on_worker_thread<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >, unsigned char, long, tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >, tt::tt_metal::v0::IDevice*>(unsigned char, long, tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> >&, tt::tt_metal::v0::IDevice*&) --- tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_return_value_t ttnn::device_operation::detail::launch_on_single_device<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > >(unsigned char, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::operation_attributes_t const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&) --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x306fe99) [0x7f4518ed1e99] --- tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_return_value_t ttnn::device_operation::detail::invoke<tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > > >(unsigned char, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::operation_attributes_t const&, tt::tt_metal::operation::OldInfraDeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >::tensor_args_t const&) --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x306c5df) [0x7f4518ece5df] --- std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > tt::tt_metal::operation::run_without_autoformat<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >(tt::tt_metal::operation::DeviceOperation<std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > >&&, std::vector<tt::tt_metal::Tensor, std::allocator<tt::tt_metal::Tensor> > const&, std::vector<std::optional<tt::tt_metal::Tensor const>, std::allocator<std::optional<tt::tt_metal::Tensor const> > > const&, std::vector<std::optional<tt::tt_metal::Tensor>, std::allocator<std::optional<tt::tt_metal::Tensor> > > const&, unsigned char) --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x46873f) [0x7f45162ca73f] --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x471d90) [0x7f45162d3d90] --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x4729ec) [0x7f45162d49ec] --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(_ZN4ttnn10operations4conv6conv2d18optimized_conv_newERKN2tt8tt_metal6TensorES7_St8optionalIS6_ERKNS0_14sliding_window19SlidingWindowConfigEjjbbRKNS2_34OptimizedConvParallelizationConfigERKNS2_24OptimizedConvBlockConfigERKNS4_12MemoryConfigENS4_8DataTypeESt5arrayIjLm4EEbRKSt7variantIJNS_28GrayskullComputeKernelConfigENS_27WormholeComputeKernelConfigEEEbbbbb+0x18f1) [0x7f4516252df1] --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(_ZN4ttnn10operations4conv6conv2d6conv2dIN2tt8tt_metal2v07IDeviceEEESt5tupleIJNS5_6TensorEjjS9_St8optionalIS9_EEERKS9_SE_PT_jjjjjSt5arrayIjLm2EESI_SI_SI_jSA_ISD_ERKSA_IKNS2_12Conv2dConfigEERKSA_IKSt7variantIJNS_28GrayskullComputeKernelConfigENS_27WormholeComputeKernelConfigEEEERKSA_IKNS5_12MemoryConfigEE+0xf7b) [0x7f451624094b] --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/build/lib/SharedLib/libTTMLIR.so(+0x761d13) [0x7f451aa92d13] --- tt::runtime::ttnn::operations::conv::run(tt::target::ttnn::Conv2dOp const*, tt::runtime::ttnn::ProgramContext&) --- tt::runtime::ttnn::runProgram(tt::tt_metal::distributed::MeshDevice&, tt::runtime::Binary, unsigned int, std::vector<tt::tt_metal::Tensor*, std::allocator<tt::tt_metal::Tensor*> > const&) --- tt::runtime::ttnn::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::runtime::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::run_binary(tt::runtime::Binary&, int, std::vector<at::Tensor, std::allocator<at::Tensor> > const&) --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x316b30) [0x7f45271fdb30] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x316a7e) [0x7f45271fda7e] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0xe17a5) [0x7f4526fc87a5] --- /opt/ttforge-toolchain/venv/bin/python(+0x18ab32) [0x55d6cf9b1b32] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55d6cf9a839b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x55d6cf9a1a97] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0xc4) [0x55d6cf9a7574] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55d6cf9bc62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55d6cfac4464] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55d6cf9c010b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55d6cf99ec30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55d6cf99c790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0x122) [0x55d6cf9c0172] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55d6cf99ec30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55d6cf99ec30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55d6cf99d9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55d6cf9a1702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55d6cf9bf4d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55d6cf9a1702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55d6cf9a761d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55d6cf9bc62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55d6cfac4464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55d6cf9a839b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55d6cf9a299e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x55d6cf99c97f] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55d6cf99ec30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55d6cf99d9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55d6cf9a1702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55d6cf9bf4d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55d6cf9a1702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55d6cf9a761d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55d6cf9bc62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55d6cfac4464] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55d6cf9c010b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55d6cf99ec30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55d6cf99c790] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55d6cf9bf4d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55d6cf99d9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55d6cf99ec30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55d6cf99c790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55d6cf99d9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55d6cf99ec30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55d6cf99d9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55d6cf9a1702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55d6cf9bf4d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55d6cf9a1702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55d6cf9a761d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55d6cf9bc62c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55d6cfac4464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55d6cf9a839b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55d6cf9a299e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55d6cf99ec30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55d6cf99d9ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55d6cf9b238c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55d6cf9a1702]
test_perceiverio.test_perceiverio_for_image_classification_pytorch[deepmind/vision-perceiver-conv]: forge/test/models/onnx/vision/perceiverio/test_perceiverio.py#L90
RuntimeError: Unknown type of tensor: <class 'transformers.models.perceiver.modeling_perceiver.PerceiverClassifierOutput'>
test_ssd300_resnet50.test_pytorch_ssd300_resnet50: forge/test/models/pytorch/vision/ssd300_resnet50/test_ssd300_resnet50.py#L48
RuntimeError: Failed to run MLIR compiler pass pipeline.
test_swin.test_swin_v2_tiny_4_256_hf_pytorch[microsoft/swinv2-tiny-patch4-window8-256]: forge/test/models/pytorch/vision/swin/test_swin.py#L77
AssertionError: Data mismatch on output 0 between framework and Forge codegen
test_yolo_v5.test_yolov5_640x640[yolov5s]: forge/test/models/onnx/vision/yolo/test_yolo_v5.py#L95
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_llama_prefil.test_llama_prefil_on_device_decode_on_cpu[meta-llama/Llama-3.2-1B]: forge/test/mlir/llama/tests/test_llama_prefil.py#L73
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_codegen.test_codegen[Salesforce/codegen-350M-mono]: forge/test/models/pytorch/text/codegen/test_codegen.py#L74
AssertionError: Data mismatch on output 0 between framework and Forge codegen
test_gemma_2b.test_gemma_2b[google/gemma-2b]: forge/test/models/pytorch/text/gemma/test_gemma_2b.py#L365
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_qwen.test_qwen1_5_causal_lm[Qwen/Qwen1.5-0.5B]: forge/test/models/pytorch/text/qwen/test_qwen.py#L56
RuntimeError: Input count mismatch: expected 534, got 535
test_squeezebert.test_squeezebert_sequence_classification_pytorch[squeezebert/squeezebert-mnli]: forge/test/models/pytorch/text/squeezebert/test_squeezebert.py#L48
RuntimeError: Failed to run MLIR compiler pass pipeline.
test_t5.test_t5_generation[t5-large]: forge/test/models/pytorch/text/t5/test_t5.py#L168
ValueError: Data mismatch -> AutomaticValueChecker (compare_with_golden): framework_model=tensor([[[-20.48771, -10.36654, -13.71506, ..., -39.06541, -39.12180, -39.08952]]], grad_fn=<UnsafeViewBackward0>), compiled_model=tensor([[[-22.37089, -18.76008, -19.40021, ..., -60.30701, -60.50323, -60.47663]]])
test_nbeats.test_nbeats_with_seasonality_basis[seasionality_basis]: forge/test/models/pytorch/timeseries/nbeats/test_nbeats.py#L49
RuntimeError: Tensor 4 - stride mismatch: expected [24, 1], got [1, 12]
test_alexnet.test_alexnet_torchhub: forge/test/models/pytorch/vision/alexnet/test_alexnet.py#L59
RuntimeError: Failed to run MLIR compiler pass pipeline.
test_densenet.test_densenet_169_pytorch[densenet169]: forge/test/models/pytorch/vision/densenet/test_densenet.py#L114
RuntimeError: Tensor 0 - stride mismatch: expected [150528, 50176, 224, 1], got [3, 1, 672, 3]
test_hrnet.test_hrnet_timm_pytorch[hrnet_w18_small]: forge/test/models/pytorch/vision/hrnet/test_hrnet.py#L174
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
test_inception_v4.test_inception_v4_osmr_pytorch: forge/test/models/pytorch/vision/inception/test_inception_v4.py#L48
RuntimeError: Tensor 47 - stride mismatch: expected [1225, 1], got [0, 0]
test_vit.test_vit_classify_224_hf_pytorch[google/vit-base-patch16-224]: forge/test/models/pytorch/vision/vit/test_vit.py#L57
RuntimeError: Failed to run MLIR compiler pass pipeline.
test_xception.test_xception_timm[xception]: forge/test/models/pytorch/vision/xception/test_xception.py#L65
RuntimeError: TT_FATAL @ /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal/ttnn/cpp/ttnn/operations/pool/generic/device/pool_op.cpp:37: (input_shape[3] % tt::constants::TILE_WIDTH == 0) || (input_shape[3] == 16) info: Input channels (728) should be padded to nearest TILE_WIDTH (32) or should be 16 backtrace: --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x3f4309) [0x7fd64a064309] --- ttnn::operations::pool::validate_pool2d(tt::tt_metal::Tensor const&, ttnn::operations::sliding_window::SlidingWindowConfig const&, tt::tt_metal::MemoryConfig const&) --- void ttnn::device_operation::detail::launch_on_worker_thread<ttnn::operations::pool::Pool2D, unsigned char, long, ttnn::operations::pool::Pool2D::operation_attributes_t, ttnn::operations::pool::Pool2D::tensor_args_t, tt::tt_metal::Tensor, tt::tt_metal::v0::IDevice*>(unsigned char, long, ttnn::operations::pool::Pool2D::operation_attributes_t const&, ttnn::operations::pool::Pool2D::tensor_args_t const&, tt::tt_metal::Tensor&, tt::tt_metal::v0::IDevice*&) --- ttnn::operations::pool::Pool2D::tensor_return_value_t ttnn::device_operation::detail::launch_on_single_device<ttnn::operations::pool::Pool2D>(unsigned char, ttnn::operations::pool::Pool2D::operation_attributes_t const&, ttnn::operations::pool::Pool2D::tensor_args_t const&) --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x174dee9) [0x7fd64b3bdee9] --- ttnn::operations::pool::Pool2D::tensor_return_value_t ttnn::device_operation::detail::invoke<ttnn::operations::pool::Pool2D>(unsigned char, ttnn::operations::pool::Pool2D::operation_attributes_t const&, ttnn::operations::pool::Pool2D::tensor_args_t const&) --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x174d96f) [0x7fd64b3bd96f] --- /__w/tt-forge-fe/tt-forge-fe/third_party/tt-mlir/third_party/tt-metal/src/tt-metal-build/lib/_ttnn.so(+0x1745598) [0x7fd64b3b5598] --- ttnn::operations::pool::Pool2DOp<(ttnn::operations::pool::Pool2DType)0>::invoke(unsigned char, tt::tt_metal::Tensor const&, unsigned int, unsigned int, unsigned int, unsigned int, std::array<unsigned int, 2ul>, std::array<unsigned int, 2ul>, std::array<unsigned int, 2ul>, std::array<unsigned int, 2ul>, std::optional<tt::tt_metal::MemoryConfig const> const&, std::optional<tt::tt_metal::TensorMemoryLayout const>, bool) --- tt::runtime::ttnn::operations::pool::run(tt::target::ttnn::MaxPool2dOp const*, tt::runtime::ttnn::ProgramContext&) --- tt::runtime::ttnn::runProgram(tt::tt_metal::distributed::MeshDevice&, tt::runtime::Binary, unsigned int, std::vector<tt::tt_metal::Tensor*, std::allocator<tt::tt_metal::Tensor*> > const&) --- tt::runtime::ttnn::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::runtime::submit(tt::runtime::Device, tt::runtime::Binary, unsigned int, std::vector<tt::runtime::Tensor, std::allocator<tt::runtime::Tensor> > const&) --- tt::run_binary(tt::runtime::Binary&, int, std::vector<at::Tensor, std::allocator<at::Tensor> > const&) --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x316b30) [0x7fd65b00bb30] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0x316a7e) [0x7fd65b00ba7e] --- /__w/tt-forge-fe/tt-forge-fe/forge/forge/_C.so(+0xe17a5) [0x7fd65add67a5] --- /opt/ttforge-toolchain/venv/bin/python(+0x18ab32) [0x55c72acacb32] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55c72aca339b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x59c7) [0x55c72ac9ca97] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0xc4) [0x55c72aca2574] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55c72acb762c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55c72adbf464] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55c72acbb10b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55c72ac99c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55c72ac97790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0x122) [0x55c72acbb172] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55c72ac99c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55c72ac99c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55c72ac989ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55c72ac9c702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55c72acba4d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55c72ac9c702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55c72aca261d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55c72acb762c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55c72adbf464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55c72aca339b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55c72ac9d99e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x8af) [0x55c72ac9797f] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55c72ac99c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55c72ac989ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55c72ac9c702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55c72acba4d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55c72ac9c702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55c72aca261d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55c72acb762c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55c72adbf464] --- /opt/ttforge-toolchain/venv/bin/python(PyObject_Call+0xbb) [0x55c72acbb10b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55c72ac99c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55c72ac97790] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55c72acba4d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55c72ac989ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55c72ac99c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x6c0) [0x55c72ac97790] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55c72ac989ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55c72ac99c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55c72ac989ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55c72ac9c702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55c72acba4d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55c72ac9c702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55c72aca261d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55c72acb762c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55c72adbf464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55c72aca339b] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x68ce) [0x55c72ac9d99e] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x2b60) [0x55c72ac99c30] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x18db) [0x55c72ac989ab] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55c72ac9c702] --- /opt/ttforge-toolchain/venv/bin/python(+0x1984d1) [0x55c72acba4d1] --- /opt/ttforge-toolchain/venv/bin/python(_PyEval_EvalFrameDefault+0x5632) [0x55c72ac9c702] --- /opt/ttforge-toolchain/venv/bin/python(_PyFunction_Vectorcall+0x7c) [0x55c72acad38c] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_FastCallDictTstate+0x16d) [0x55c72aca261d] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_Call_Prepend+0x5c) [0x55c72acb762c] --- /opt/ttforge-toolchain/venv/bin/python(+0x29d464) [0x55c72adbf464] --- /opt/ttforge-toolchain/venv/bin/python(_PyObject_MakeTpCall+0x25b) [0x55c72aca339b]
test_yolox.test_yolox_pytorch[yolox_nano]: forge/test/models/pytorch/vision/yolo/test_yolox.py#L94
RuntimeError: Found Unsupported operations while lowering from TTForge to TTIR in forward graph
pre-commit / pre-commit
The `python-version` input is not set. The version of Python currently in `PATH` will be used.
docker-build / docker-build / build-image
You are running out of disk space. The runner will stop working when the machine runs out of disk space. Free space left: 29 MB