Code

Ort openvino npu 1.17 master#19966

Code

Merged

jywu-msft merged 59 commits intomicrosoft:mainmicrosoft/onnxruntime:mainfrom intel:ort-openvino-npu-1.17-masterintel/onnxruntime:ort-openvino-npu-1.17-masterCopy head branch name to clipboardMar 22, 2024

+275-843

Commits

Commits on Mar 13, 2024

• Add OpenVINO 2023.2 support

  sspintel

  committed
  9e9c1fb

• num_of_threads mapped to inference_num_threads property of CPU

  sspintel

  committed
  f71ca3a

• Use ONNX FrontEnd convert_model to facilitate external weights path

  sspintel

  committed
  b656d06

• Fix Lint issues

  sspintel

  committed
  cce97c0

• inference_num_threadas is applicable only for the CPU device

  sspintel

  committed
  babc244

• Fix Lint issues

  sspintel

  committed
  b6e4af0

• Add an user option to disable default dynamic model execution for improved performance

  

  preetha-intel

  authored and

  sspintel

  committed
  6b8c867

• Fix for runtime errors with dynamic shapes flag

  sspintel

  committed
  4f7fe28

• Fix conflict in gitignore

  sspintel

  committed
  6704415

• Revert removal of USE_OPENVINO macro in provider registration; Add checks for proxy plugins for NUM_STREAMS

  sspintel

  committed
  359b71b

• Enable OV CPU fallback for NPU compilation failures

  

  preetha-intel

  authored and

  sspintel

  committed
  fb6d981

• Add NPU device in supported list of openvino devices

  

  preetha-intel

  authored and

  sspintel

  committed
  d2879b9

• Handle dynamic shapes fallback for NPU to OV CPU

  

  preetha-intel

  authored and

  sspintel

  committed
  b7db23f

• Remove NPU operator from static mapping

  

  preetha-intel

  authored and

  sspintel

  committed
  08f5b8c

• Add NPU device; Revert num_of_threads to 1 to be default

  sspintel

  committed
  d9fe4c1

• Add support for LayerNormalization Op; NPU to go through ReadModel -> CompileModel stages

  

  Ubuntu

  authored and

  sspintel

  committed
  ff7070b

• Fix an issue with provider options getting overwritten

  Show description for b4b2c59
  sspintel

  committed
  b4b2c59

• Add device_precision access for UnsupportedOpModes

  sspintel

  committed
  4121684

• Fix an issue that shared global_context across subgraphs

  sspintel

  committed
  e8fd60a

• Remove static mapping of LayerNorm op for the NPU; Remove unused MLAS fallback code

  sspintel

  committed
  439afd3

• Add support for UINT16 DTYPE in initializers, NPU, and CPU devices

  sspintel

  committed
  593d870

• Temporarily disable model domain check as it is yet to be supported by the onnx frontend

  sspintel

  committed
  de8194c

• Allow overriding NPU compiler type through an environmental variable

  sspintel

  committed
  8fe5760

• Remove deprecated model domain check

  sspintel

  committed
  281ddf6

• Remove unused parameter op_map

  sspintel

  committed
  49d7f4a

• Enable dynamic backend execution for NPU

  

  preetha-intel

  authored and

  sspintel

  committed
  0466f29

• OV NPU fallback for OV CPU

  

  preetha-intel

  authored and

  sspintel

  committed
  e4cc1c9

• The default should be false

  

  hmamidix

  authored and

  sspintel

  committed
  da26118

• Resetting num of threads to 0

  

  hmamidix

  authored and

  sspintel

  committed
  6adbc90

• Nuget does not need openvino windows dll

  

  vthaniel

  authored and

  sspintel

  committed
  16c9a3e

• Bug fix with dynamic backend key

  

  preetha-intel

  authored and

  sspintel

  committed
  4b78e50

• Update Cmake to latest OV libs (#343)

  Show description for cbbcf43
  

  preetha-intel

  authored and

  sspintel

  committed
  cbbcf43

• add gelu op for ps* models

  

  saurabhkale17

  authored and

  sspintel

  committed
  0ff4b4f

• OV deprecated api

  

  saurabhkale17

  authored and

  sspintel

  committed
  8d0b825

• Remove deprecated code comments

  

  vthaniel

  authored and

  sspintel

  committed
  c7112f4

• Update get_capability of OVEP

  

  preetha-intel

  authored and

  sspintel

  committed
  953398f

• Add a cmake option to install openvino providers library in a desired location

  sspintel

  committed
  543247c

• Throw useful Exceptions from OVEP

  sspintel

  committed
  e211110

• Use std::runtime_error instead of ov::Exception in basic_backend

  sspintel

  committed
  7e75c9f

• Fix Unknown Exceptions arising from ov_interface.cc

  sspintel

  committed
  698333e

• Apply lintrunner patches

  

  Ubuntu

  authored and

  sspintel

  committed
  b4e8838

• Rename OVEP device for NPU without precision

  

  preetha-intel

  authored and

  sspintel

  committed
  9d7892f

• Add Capability for OV 2024.0

  sspintel

  committed
  b9506a9

• Remove unsupported Op LpPool; GridSample com.microsoft supported only in model; Celu is a function Op

  sspintel

  committed
  ea4001b

• Disable ONNX_Gelu UT; Apply lintrunner

  sspintel

  committed
  5d77fe3

• Remove Dockerfiles for OpenVINO

  sspintel

  committed
  56ce6fb

• Revert "Remove Dockerfiles for OpenVINO"

  Show description for 04cf70e
  sspintel

  committed
  04cf70e

• Remove and Update OpenVINO EP Dockerfiles

  sspintel

  committed
  9f98cdb

• Provide backward compatability for OVEP API in python

  preetha-intel

  committed
  8340059

Commits on Mar 18, 2024

• Fix fallback failure by catching the correct exception type (#353)

  Show description for 4888eb1
  sspintel

  authored
  4888eb1

Commits on Mar 19, 2024

• Apply lintrunner patch

  sspintel

  committed
  0ba959a

Commits on Mar 20, 2024

• Remove Date from Licence File Information

  Show description for ac0762f
  sfatimar

  committed
  ac0762f

• Fixed OpenVINO Dockerfile

  sfatimar

  committed
  2eea77a

• Merge pull request #354 from intel/sahar/fix_npu_pr_19666

  Show description for 514d0c1
  sfatimar

  authored
  514d0c1

• Pointing to OpenVINO 2024.0.0

  sfatimar

  committed
  a96e123

• Merge branch 'ort-openvino-npu-1.17-master' of https://github.com/intel/onnxruntime into ort-openvino-npu-1.17-master

  sfatimar

  committed
  2a6397e

Commits on Mar 21, 2024

• Disable ActivationOpTest.Gelu for OpenVINO

  sspintel

  committed
  9d72346

• Ignore Gelu tests in ONNX Backend test

  sspintel

  committed
  3eaa70a

• Merge pull request #355 from intel/sp/ignore-gelu-tests-python

  Show description for 76d7e17
  sfatimar

  authored
  76d7e17