Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add basic support for list of optional tensors in reduce-op-variants #971

Merged
merged 1 commit into from
Jul 8, 2022

Conversation

ramiro050
Copy link
Collaborator

@ramiro050 ramiro050 commented Jun 23, 2022

This commit adds support for lists of type list<optional<tensor>>
where each element in the list is either a !torch.tensor or a
!torch.none.

@ramiro050 ramiro050 requested a review from silvasean June 23, 2022 20:52
@ramiro050 ramiro050 force-pushed the fix-reduce-op-variants-list branch 2 times, most recently from 99efdac to cb5b3d7 Compare July 6, 2022 23:15
@ramiro050 ramiro050 marked this pull request as draft July 6, 2022 23:16
@ramiro050 ramiro050 removed the request for review from silvasean July 6, 2022 23:16
@ramiro050 ramiro050 force-pushed the fix-reduce-op-variants-list branch from cb5b3d7 to 934097e Compare July 7, 2022 23:33
This commit adds support for lists of type `list<optional<tensor>>`
where each element in the list is either a `!torch.tensor` or a
`!torch.none`.
@ramiro050 ramiro050 force-pushed the fix-reduce-op-variants-list branch from 934097e to a495be1 Compare July 8, 2022 17:56
@ramiro050 ramiro050 changed the title Fix handling of conversion to immutable tensors for lists Add basic support for list of optional tensors in reduce-op-variants Jul 8, 2022
@ramiro050 ramiro050 marked this pull request as ready for review July 8, 2022 17:59
@ramiro050 ramiro050 merged commit 6a72ab4 into llvm:main Jul 8, 2022
@ramiro050 ramiro050 deleted the fix-reduce-op-variants-list branch July 8, 2022 18:12
gpetters94 pushed a commit to gpetters94/mlir-npcomp that referenced this pull request Jul 12, 2022
…lvm#971)

This commit adds support for lists of type `list<optional<tensor>>`
where each element in the list is either a `!torch.tensor` or a
`!torch.none`.
gpetters94 pushed a commit to gpetters94/mlir-npcomp that referenced this pull request Jul 27, 2022
…lvm#971)

This commit adds support for lists of type `list<optional<tensor>>`
where each element in the list is either a `!torch.tensor` or a
`!torch.none`.
qedawkins pushed a commit to nod-ai/torch-mlir that referenced this pull request Oct 3, 2022
Signed-off-by: Ettore Tiotto <etiotto@ca.ibm.com>
qedawkins pushed a commit to nod-ai/torch-mlir that referenced this pull request Oct 3, 2022
… errors by assertion. (llvm#968)

* Conversion support (llvm#956)

* initial

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* works, bool is great, but unsigned create issues

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* added support to remove the UnrealizedConversionCastOp while lowering to llvm

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* last version to support some shaped type in conversion, reduce after to Integer or Float

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* converted to cast scalar only

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* added lit tests

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* update

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* initial

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* works, bool is great, but unsigned create issues

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* added support to remove the UnrealizedConversionCastOp while lowering to llvm

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* last version to support some shaped type in conversion, reduce after to Integer or Float

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* converted to cast scalar only

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* added lit tests

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* update

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* implemented cast with index, before replacing usage

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* update

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* cleanup and use of createMath constant/constantIndex/cast/castIndex

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* make sure that only explicitly unsigned are treated as unsigned; signless and indices are treated as signed

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>
Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Add the onnx-mlir logo to the onnxai webpage (llvm#959)

* Add the onnx-mlir logo to the onnxai webpage

Signed-off-by: Tung D. Le <tung@jp.ibm.com>

* Remove a dump()

Signed-off-by: Tung D. Le <tung@jp.ibm.com>

* Missing git-add the .png file

Signed-off-by: Tung D. Le <tung@jp.ibm.com>
Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Several small improvements including adding onnx-mlir-doc to ALL target and building onnx from the submodule (llvm#957)

1. Add onnx-mlir-doc to the ALL target. This way it will be run with the default target
2. On Windows instead of installing onnx from pip, build it from source to match other CIs
3. Remove unnecessary include in Compiler

Signed-off-by: Stella Stamenova <stilis@microsoft.com>

Co-authored-by: Alexandre Eichenberger <alexe@us.ibm.com>
Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* fix the mistake of shape in doc-example (llvm#964)

Signed-off-by: david.cheng <david.cheng@enflame-tech.com>

Co-authored-by: david.cheng <david.cheng@enflame-tech.com>
Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* install dll to bin (llvm#963)

Signed-off-by: Michael Holman <michhol@microsoft.com>

Co-authored-by: Alexandre Eichenberger <alexe@us.ibm.com>
Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Output better error messages for file opening errors.

Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Fix clang-format errors

Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Fix build errors.

Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Fix a build error

Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Onehot update (llvm#967)

* initial commit

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* one hot upgraded, more dyn cases

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* cleanup

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* cleanup

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* initial commit

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* one hot upgraded, more dyn cases

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* cleanup

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* cleanup

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>
Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* We currently run a few test sets, e.g., check-onnx-backend, (llvm#958)

check-onnx-backend-dynamic, etc., in serial. While we do
parallelize within each test set, we don't get much benefit
from it. Because within each test set, most of the time was
spent on one or two long running tests. While waiting for
these long running tests, we could have started the other
test sets.

This patch parallelizes across tests sets by starting them
all at once so the long running tests from different test
sets can run in parallel.

CompilerLib tests are disabled because a bug has been uncovered
that it was actually still using onnx-mlir instead of CompilerLibTest
to compile the models. Fix the bug to use CompilerLibTest and
it fails to compile the models.

Use CTEST_PARALLEL_LEVEL for numerical tests to be compatible
with Windows CI

Signed-off-by: Gong Su <gong_su@hotmail.com>

Co-authored-by: Alexandre Eichenberger <alexe@us.ibm.com>
Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Use ninja as a build system (llvm#946)

Signed-off-by: mshr-h <mhg00g13@gmail.com>

Co-authored-by: Alexandre Eichenberger <alexe@us.ibm.com>
Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Added documentation on using DEBUG according to LLVM (llvm#970)

* added documentation on using DEBUG according to LLVM

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* removed errand printf for debugging

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>
Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* CategoryMapper: shape inference support. (llvm#971)

Signed-off-by: Ettore Tiotto <etiotto@ca.ibm.com>
Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Updating docs to move into the right place (llvm#972)

* Updating docs to move into the right place

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* add link

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* add links

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* add links

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>

* respond to comments on MLIR.cmake

Signed-off-by: Alexandre Eichenberger <alexe@us.ibm.com>
Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Fix EnableMemoryPool to account for 'memref.cast' operation. (llvm#966)

Signed-off-by: Ettore Tiotto <etiotto@ca.ibm.com>
Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Fix typo.

Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Revert "Fix typo."

This reverts commit f2934faee463557ebc2adb6aca5b9521f5064f12.

Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

* Fix typo

Signed-off-by: Yasushi Negishi <negishi@jp.ibm.com>

Co-authored-by: Alexandre Eichenberger <alexe@us.ibm.com>
Co-authored-by: Tung D. Le <tung@jp.ibm.com>
Co-authored-by: Stella Stamenova <stilis@microsoft.com>
Co-authored-by: DavidChan <chengwei0519@163.com>
Co-authored-by: david.cheng <david.cheng@enflame-tech.com>
Co-authored-by: Michael Holman <michhol@microsoft.com>
Co-authored-by: gongsu832 <gong_su@hotmail.com>
Co-authored-by: Masahiro Hiramori <mhg00g13@gmail.com>
Co-authored-by: Ettore Tiotto <etiotto@ca.ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants