Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use graph properties from ZeroInitStruct in compiler adapter #28699

Merged
merged 5 commits into from
Jan 28, 2025
Merged

Use graph properties from ZeroInitStruct in compiler adapter #28699

merged 5 commits into from
Jan 28, 2025
+15 −16

Conversation

PatrikStepan
Copy link
Contributor

@PatrikStepan PatrikStepan commented Jan 27, 2025 •
edited
Loading

Details:

  • FEIL/FIL was increased with [intel-npu] Adding new read-only property: NPU_COMPILER_VERSION #28314. Querying compiler properties forces UMD to load the compiler DLL. To optimize the memory consumption UMD will also unload the the compiler DLL.
  • By reusing graph properties in the compiler adapter we remove one (load + read + unload) cycle from FEIL/FIL
  • Rename private member names to compiler_properties: even if we use a common graph ext API to query graph properties we only store ZE_STRUCTURE_TYPE_DEVICE_GRAPH_PROPERTIES - which are compiler properties.

Tickets:

@PatrikStepan PatrikStepan requested review from a team as code owners January 27, 2025 16:36
@github-actions github-actions bot added the category: NPU OpenVINO NPU plugin label Jan 27, 2025
@PatrikStepan PatrikStepan force-pushed the reuse_graph_properties branch from 5596e96 to 32972b8 Compare January 28, 2025 06:29
@PatrikStepan PatrikStepan force-pushed the reuse_graph_properties branch from 32972b8 to 71e17db Compare January 28, 2025 06:34
@PatrikStepan PatrikStepan added this pull request to the merge queue Jan 28, 2025
Merged via the queue into openvinotoolkit:master with commit 5981aab Jan 28, 2025
157 checks passed
@PatrikStepan PatrikStepan deleted the reuse_graph_properties branch January 28, 2025 15:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sbutnari sbutnari sbutnari approved these changes

@pereanub pereanub pereanub approved these changes

@csoka csoka csoka approved these changes

Assignees
No one assigned
Labels
category: NPU OpenVINO NPU plugin
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@PatrikStepan @csoka @pereanub @sbutnari