What's New

Keras

Update support for TFOpLambda layers in Batch Norm Folding with extra call args/kwargs.

PyTorch

Added AIMET to support PyTorch version 1.13.0. Only ONNX opset 14 is supported for export.
[experimental] Debugging APIs have been added for dumping intermediate tensor data. This data can be used with current QNN/SNPE tools for debugging accuracy problems. Layer Output Generation API gives incorrect tensor data for the layer just before Relu when used for original FP32 model.
[experimental] Support for embedding AIMET encodings within the graph using ONNX quantize/dequantize operators. Currently this is option is only supported when using 8bit per-tensor quantization.
Fixed a bug in AIMET QuantSim for PyTorch models to handle non-contiguous tensors.

ONNX

AIMET support for ONNX 1.11.0 has been added. However there is currently limited op support in QNN/SNPE. If the model fails to load please continue to use opset 11 for export.

TensorFlow

[experimental] Debugging APIs have been added for dumping intermediate tensor outputs. This data can be used with current QNN/SNPE tools for debugging accuracy problems.

Documentation