Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] WebGPU EP [skip ci] #21904

Draft
wants to merge 101 commits into
base: main
Choose a base branch
from
Draft

[WIP] WebGPU EP [skip ci] #21904

wants to merge 101 commits into from
+9,246 −16

Commits on Aug 28, 2024

  1. [WIP] WebGPU EP initial commit

    @fs-eire
    fs-eire committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    4037bd4 View commit details
    Browse the repository at this point in the history

  2. update C-API

    @fs-eire
    fs-eire committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    9c36250 View commit details
    Browse the repository at this point in the history

  3. fix build break

    @fs-eire
    fs-eire committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    3a0756d View commit details
    Browse the repository at this point in the history

  4. add an empty symbols.txt file

    @fs-eire
    fs-eire committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    5199e98 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. fix an error in doc

    @fs-eire
    fs-eire committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    1c68dbd View commit details
    Browse the repository at this point in the history

  2. remove string_join.h in favor of absl::StrJoin

    @fs-eire
    fs-eire committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    7db03de View commit details
    Browse the repository at this point in the history

  3. fix DLL copy

    @fs-eire
    fs-eire committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    6a373c2 View commit details
    Browse the repository at this point in the history

  4. update doc: require --skip_tests

    @fs-eire
    fs-eire committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    ee42bba View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

    @fs-eire
    fs-eire committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    5fac202 View commit details
    Browse the repository at this point in the history

  6. update dawn version

    @fs-eire
    fs-eire committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    3f46e5c View commit details
    Browse the repository at this point in the history

  7. disable Tint tests

    @fs-eire
    fs-eire committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    9f61279 View commit details
    Browse the repository at this point in the history

  8. fix one build break in Linux

    @fs-eire
    fs-eire committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    6bb6335 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. remove unused variables

    @fs-eire
    fs-eire committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    d839dbc View commit details
    Browse the repository at this point in the history

  2. make webgpu build on linux and known to most tools (#21937) 

    Co-authored-by: Yulong Wang <7679871+fs-eire@users.noreply.github.com>
    @guschmue @fs-eire
    guschmue and fs-eire committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    b70943d View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

    @fs-eire
    fs-eire committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    c33ac2e View commit details
    Browse the repository at this point in the history

  4. revert type of ShaderVariable::rank_ to int

    @fs-eire
    fs-eire committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    8437267 View commit details
    Browse the repository at this point in the history

  5. output Impl() for variables

    @fs-eire
    fs-eire committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    3caf032 View commit details
    Browse the repository at this point in the history

  6. code formatting

    @fs-eire
    fs-eire committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    84494c4 View commit details
    Browse the repository at this point in the history

  7. better format of Uniform

    @fs-eire
    fs-eire committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    aa70163 View commit details
    Browse the repository at this point in the history

  8. revise document

    @fs-eire
    fs-eire committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    d772db7 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2024

  1. more build fix for linux

    @fs-eire
    fs-eire committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    6ef3dad View commit details
    Browse the repository at this point in the history

  2. apply formatter

    @fs-eire
    fs-eire committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    a56f6c3 View commit details
    Browse the repository at this point in the history

  3. simple test runner

    @fs-eire
    fs-eire committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    12cd79d View commit details
    Browse the repository at this point in the history

  4. Program macros update - allow extend

    @fs-eire
    fs-eire committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    14c8966 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2024

  1. fix BucketCacheManager

    @fs-eire
    fs-eire committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    4fff35f View commit details
    Browse the repository at this point in the history

  2. add a method to get logger from ComputeContext

    @fs-eire
    fs-eire committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    4fd8ad1 View commit details
    Browse the repository at this point in the history

  3. add verbose log for cache key

    @fs-eire
    fs-eire committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    3bd92ad View commit details
    Browse the repository at this point in the history

  4. revise suite test

    @fs-eire
    fs-eire committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    6a1bbfe View commit details
    Browse the repository at this point in the history

  5. device lost handler

    @fs-eire
    fs-eire committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    947aee1 View commit details
    Browse the repository at this point in the history

  6. add '-a' and '-t' to test runner

    @fs-eire
    fs-eire committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    99b2578 View commit details
    Browse the repository at this point in the history

  7. atol/rtol 0.0001 -> 0.001

    @fs-eire
    fs-eire committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    aa7b3f5 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. Fix uniform

    @fs-eire
    fs-eire committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    e659acd View commit details
    Browse the repository at this point in the history

  2. add some unary ops

    @fs-eire
    fs-eire committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    6ad89c5 View commit details
    Browse the repository at this point in the history

  3. various of fixes

    @fs-eire
    fs-eire committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    8361fc3 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. fix workgroup_size, cache key stringnify and indices type

    @fs-eire
    fs-eire committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    c89159d View commit details
    Browse the repository at this point in the history

  2. shape_uniforms preparation

    @fs-eire
    fs-eire committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    5ea5936 View commit details
    Browse the repository at this point in the history

  3. allow uniforms of input/output shape/stride being added automatically

    @fs-eire
    fs-eire committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    7d83054 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

    @fs-eire
    fs-eire committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    7a64cc7 View commit details
    Browse the repository at this point in the history

  5. fix build (linux)

    @fs-eire
    fs-eire committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    1d53ac8 View commit details
    Browse the repository at this point in the history

  6. fix stride

    @fs-eire
    fs-eire committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    4d52602 View commit details
    Browse the repository at this point in the history

  7. fix "{res_name}_bi2o_{name}"

    @fs-eire
    fs-eire committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    3761aad View commit details
    Browse the repository at this point in the history

  8. Add Expand operator (#21933) 

    ### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
    @qjia7
    qjia7 committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    351da84 View commit details
    Browse the repository at this point in the history

  9. support onnxruntime_test_all

    @fs-eire
    fs-eire committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    0b7ce77 View commit details
    Browse the repository at this point in the history

  10. reflect change in WebGpuProviderFactoryCreator::Create signature (#21971 

    )

reflect change in WebGpuProviderFactoryCreator::Create signature
    @guschmue
    guschmue committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    33726b1 View commit details
    Browse the repository at this point in the history

  11. compare the content of WEBGPU_BUFFER, not the address (#21967) 

    On linux (not sure about windows) WEBGPU_BUFFER is defined in multiple
object files and comparing the address is not sufficient - use strcmp.
onnxruntime uses strcmp for the most but there are some other places
that compare against address which might make trouble if passed acrross
object file boundary.
    @guschmue
    guschmue committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    50ea9eb View commit details
    Browse the repository at this point in the history

  12. fix tanh

    @fs-eire
    fs-eire committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    d6f6148 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. support size==0 for element wise operators

    @fs-eire
    fs-eire committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    626edaf View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

    @fs-eire
    fs-eire committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    8913da1 View commit details
    Browse the repository at this point in the history

  3. use shared ComputeBroadcastOutputShape()

    @fs-eire
    fs-eire committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    bacc54c View commit details
    Browse the repository at this point in the history

  4. add workgroup_idx

    @fs-eire
    fs-eire committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    7ecc5bb View commit details
    Browse the repository at this point in the history

  5. expose name for shader variable

    @fs-eire
    fs-eire committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    ae836b1 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. add uniform for 1D variable

    @fs-eire
    fs-eire committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    243078b View commit details
    Browse the repository at this point in the history

  2. fix GetElementAt with uniform

    @fs-eire
    fs-eire committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    4d48d28 View commit details
    Browse the repository at this point in the history

  3. document update folder

    @fs-eire
    fs-eire committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    dbe673b View commit details
    Browse the repository at this point in the history

  4. fix adapter/device creating: add toggles

    @fs-eire
    fs-eire committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    38f182e View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. more strict shape&stride usage check

    @fs-eire
    fs-eire committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    eb80f7c View commit details
    Browse the repository at this point in the history

  2. fix vector realloc

    @fs-eire
    fs-eire committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    39d5509 View commit details
    Browse the repository at this point in the history

  3. simplify cache hint interface.

    @fs-eire
    fs-eire committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    cd961c3 View commit details
    Browse the repository at this point in the history

  4. revise expand

    @fs-eire
    fs-eire committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    ddc2fbb View commit details
    Browse the repository at this point in the history

  5. revise unary

    @fs-eire
    fs-eire committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    e8be835 View commit details
    Browse the repository at this point in the history

  6. Elu/Relu/LeakyRelu/ThresholdedRelu/Gelu

    @fs-eire
    fs-eire committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    bd7d592 View commit details
    Browse the repository at this point in the history

  7. Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

    @fs-eire
    fs-eire committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    eecac18 View commit details
    Browse the repository at this point in the history

  8. remove unused field in class Gelu

    @fs-eire
    fs-eire committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    601e50f View commit details
    Browse the repository at this point in the history

  9. remove out-of-dated comments

    @fs-eire
    fs-eire committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    8f36da2 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2024

  1. Clip

    @fs-eire
    fs-eire committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    72ebd85 View commit details
    Browse the repository at this point in the history

  2. fix rank in shader helper

    @fs-eire
    fs-eire committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    a3244ae View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. fix shader variable

    @fs-eire
    fs-eire committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    5a2ae8c View commit details
    Browse the repository at this point in the history

  2. move components number from variable to program

    @fs-eire
    fs-eire committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    aa54ff8 View commit details
    Browse the repository at this point in the history

  3. mark components in cache key

    @fs-eire
    fs-eire committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    969384d View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Add FastGelu op (#21991) 

    ### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

---------

Co-authored-by: Yulong Wang <7679871+fs-eire@users.noreply.github.com>
    @qjia7 @fs-eire
    qjia7 and fs-eire committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    6b82486 View commit details
    Browse the repository at this point in the history

  2. use 'set/add' as prefix for some functions

    @fs-eire
    fs-eire committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    2b3e7c2 View commit details
    Browse the repository at this point in the history

  3. remove unnecessary cache hint for FastGelu

    @fs-eire
    fs-eire committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    ef0d53b View commit details
    Browse the repository at this point in the history

  4. revise unary - expose consts in header

    @fs-eire
    fs-eire committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    c4ca47f View commit details
    Browse the repository at this point in the history

  5. use path for header file

    @fs-eire
    fs-eire committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    8806d57 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. a few revises to the code (#22047)

    @fs-eire
    fs-eire committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    0568e2b View commit details
    Browse the repository at this point in the history

  2. use OrtMutex

    @fs-eire
    fs-eire committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    b7a9c0e View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

    @fs-eire
    fs-eire committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    f65ade9 View commit details
    Browse the repository at this point in the history

  4. [webgpu-native] Add transpose op (#21986) 

    Co-authored-by: Yulong Wang <7679871+fs-eire@users.noreply.github.com>
    @axinging @fs-eire
    axinging and fs-eire committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    d4a963d View commit details
    Browse the repository at this point in the history

  5. PushErrorScope and PopErrorScope

    @fs-eire
    fs-eire committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    8b61532 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. placeholder for setting proc table

    @fs-eire
    fs-eire committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    dce0f18 View commit details
    Browse the repository at this point in the history

  2. Revert "placeholder for setting proc table" 

    This reverts commit dce0f18.
    @fs-eire
    fs-eire committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    8978d89 View commit details
    Browse the repository at this point in the history

  3. allow setting "ValidationMode"

    @fs-eire
    fs-eire committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    43ccaf4 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. make shape/stride correct when component != 1

    @fs-eire
    fs-eire committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    eae4c3f View commit details
    Browse the repository at this point in the history

  2. expose number of components

    @fs-eire
    fs-eire committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    b8c369d View commit details
    Browse the repository at this point in the history

  3. Fix build errors

    @skottmckay @fs-eire
    skottmckay authored and fs-eire committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    c3086d6 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2024

  1. [WebGPU EP] Support Shape operator (#22095) 

    ### Description
Shape operator



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
    @satyajandhyala
    satyajandhyala committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    c5cf2ab View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. [webgpu EP] Binary operators (#22112) 

    based on:
- #22058

---------

Co-authored-by: Qin Jiajia <jiajia.qin@intel.com>
    @fs-eire @qjia7
    fs-eire and qjia7 committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    0bc714f View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

    @fs-eire
    fs-eire committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    4421676 View commit details
    Browse the repository at this point in the history

  3. use f32 for pow anyway

    @fs-eire
    fs-eire committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    2e91a8b View commit details
    Browse the repository at this point in the history

  4. Cast operator

    @fs-eire
    fs-eire committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    87f9edb View commit details
    Browse the repository at this point in the history

  5. do not use virtual function for getting ProgramMetadata

    @fs-eire
    fs-eire committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    19ee9f3 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. reshape, squeeze and unsqueeze

    @fs-eire
    fs-eire committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    d9f7f19 View commit details
    Browse the repository at this point in the history

  2. fix Cast and Clip

    @fs-eire
    fs-eire committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    07675cf View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. [webgpu-native] Add where op (#22014) 

    
Co-authored-by: Yulong Wang <7679871+fs-eire@users.noreply.github.com>
    @axinging @fs-eire
    axinging and fs-eire committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    dfab322 View commit details
    Browse the repository at this point in the history

  2. fix linux build break

    @fs-eire
    fs-eire committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    cb9f3a4 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

    @fs-eire
    fs-eire committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    207be92 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. expose KernelContext

    @fs-eire
    fs-eire committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    929725e View commit details
    Browse the repository at this point in the history

  2. revise fast gelu

    @fs-eire
    fs-eire committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    c5e5af3 View commit details
    Browse the repository at this point in the history

  3. expose Rank in IndicesHelper

    @fs-eire
    fs-eire committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    82cd59e View commit details
    Browse the repository at this point in the history

  4. fix: move inline impl to .h

    @fs-eire
    fs-eire committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    2393dbf View commit details
    Browse the repository at this point in the history

  5. add const modifier

    @fs-eire
    fs-eire committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    9bdbd85 View commit details
    Browse the repository at this point in the history