Skip to content
This repository has been archived by the owner on Jul 1, 2024. It is now read-only.

Latest commit

 

History

History
436 lines (418 loc) · 52.4 KB

MODELS.md

File metadata and controls

436 lines (418 loc) · 52.4 KB

English | 简体中文

This document provides a list of all validated models that are supported by OpenVINO™ integration with TensorFlow. The list of supported models and performance is continuously evolving as we are optimizing models and enabling more operators. The performance gain depends on various factors such as model architecture, Intel® Platform (e.g. Xeon® or CoreTM), Backend device (e.g. CPU, GPU or VPU) etc.

TensorFlow-Slim Image Classification Library

Model Name Supported Devices
Inception V3 CPU, iGPU, MYRIAD, VAD-M
Inception_V4 CPU, iGPU, MYRIAD, VAD-M
Resnet V1 50 CPU, iGPU, MYRIAD, VAD-M
Resnet V2 152 CPU, iGPU, MYRIAD, VAD-M
Resnet V2 50 CPU, iGPU, MYRIAD, VAD-M
VGG 16 CPU, iGPU, MYRIAD, VAD-M
VGG 19 CPU, iGPU, MYRIAD, VAD-M
MobileNet_v1_1.0_224 CPU, iGPU, MYRIAD, VAD-M
MobileNet_v2_1.4_224 CPU, iGPU, MYRIAD, VAD-M
CifarNet CPU, iGPU, MYRIAD, VAD-M
LeNet CPU, iGPU, MYRIAD, VAD-M

The links to the TensorFlow-Slim models include the pre-trained checkpoint files only. You should refer to TensorFlow-Slim models instructions page to run inference or freeze the models. (No pre-trained checkpoint files provided for CifarNet and LeNet.)

TensorFlow Object Detection Model Zoo

Model Name Supported Devices
faster_rcnn_inception_resnet_v2_atrous_coco CPU, iGPU, MYRIAD, VAD-M
faster_rcnn_inception_v2_coco CPU, iGPU, MYRIAD, VAD-M
faster_rcnn_resnet50_coco CPU, iGPU, MYRIAD, VAD-M
faster_rcnn_resnet101_coco CPU, iGPU, MYRIAD, VAD-M
faster_rcnn_resnet50_lowproposals_coco CPU, iGPU, MYRIAD, VAD-M
ssd_inception_v2 CPU, iGPU, MYRIAD, VAD-M
ssd_mobilenet_v1 CPU, iGPU, MYRIAD, VAD-M
ssd_mobilenet_v1_fpn CPU, iGPU, MYRIAD, VAD-M
ssd_mobilenet_v2 CPU, iGPU, MYRIAD, VAD-M
ssd_resnet_50_fpn CPU, iGPU, MYRIAD, VAD-M
ssdlite_mobilenet_v2 CPU, iGPU, MYRIAD, VAD-M
mask_rcnn_inception_resnet_v2_atrous_coco CPU, iGPU, MYRIAD, VAD-M
mask_rcnn_inception_v2_coco CPU, iGPU, MYRIAD, VAD-M

Pre-trained frozen models are provided for these models.

TensorFlow Keras Applications

Model Name Supported Devices
DenseNet121 CPU, iGPU, MYRIAD, VAD-M
DenseNet169 CPU, iGPU, MYRIAD, VAD-M
DenseNet201 CPU, iGPU, MYRIAD, VAD-M
EfficientnetB0 CPU, iGPU, MYRIAD, VAD-M
EfficientnetB1 CPU, iGPU, MYRIAD, VAD-M
EfficientnetB2 CPU, iGPU, MYRIAD, VAD-M
EfficientnetB3 CPU, iGPU, MYRIAD, VAD-M
EfficientnetB4 CPU, iGPU, MYRIAD, VAD-M
EfficientnetB5 CPU, iGPU, MYRIAD, VAD-M
EfficientnetB6 CPU, iGPU, MYRIAD, VAD-M
EfficientnetB7 CPU, iGPU, MYRIAD, VAD-M
InceptionV3 CPU, iGPU, MYRIAD, VAD-M
NASNetLarge CPU, iGPU, MYRIAD, VAD-M
NASNetMobile CPU, iGPU, MYRIAD, VAD-M
ResNet50v2 CPU, iGPU, MYRIAD, VAD-M

Please follow the instructions on Keras Applications page for further information about using these pre-trained models.

TensorFlow-Hub Models

Model Name Supported Devices
aiy_vision_classifier_birds_V1   CPU, iGPU, MYRIAD
aiy_vision_classifier_food_V1   CPU, iGPU, MYRIAD
albert_en_base CPU, iGPU, MYRIAD
albert_en_preprocess CPU, iGPU, MYRIAD
albert_en_xxlarge CPU, iGPU, MYRIAD
bert_en_cased_L-12_H-768_A-12 CPU, iGPU, MYRIAD
bert_en_cased_L-24_H-1024_A-16 CPU, iGPU, MYRIAD
bert_en_cased_preprocess   CPU, iGPU, MYRIAD
bert_en_uncased_L-12_H-768_A-12 CPU, iGPU, MYRIAD
bert_en_uncased_L-24_H-1024_A-16 CPU, iGPU, MYRIAD
bert_en_uncased_preprocess CPU, iGPU, MYRIAD
bert_en_wwm_uncased_L-24_H-1024_A-16 CPU, iGPU, MYRIAD
bert_multi_cased_preprocess CPU, iGPU, MYRIAD
bert_zh_L-12_H-768_A-12 CPU, iGPU, MYRIAD
bert_zh_preprocess CPU, iGPU, MYRIAD
bit​/m-r101x1 CPU, iGPU, MYRIAD
bit​/m-r101x3 CPU, iGPU, MYRIAD
bit​/m-r50x1​/ilsvrc2012_classification CPU, iGPU, MYRIAD
bit​/m-r50x1 CPU, iGPU, MYRIAD
bit​/m-r50x3 CPU, iGPU, MYRIAD
bit​/s-r50x1 CPU, iGPU, MYRIAD
centernet​/hourglass_512x512 iGPU, MYRIAD
centernet​/hourglass_512x512_kpts CPU, iGPU, MYRIAD
centernet​/resnet50v1_fpn_512x512 iGPU, MYRIAD
centernet_hourglass_1024x1024 CPU, iGPU, MYRIAD
centernet_resnet101v1_fpn_512x512 CPU, iGPU, MYRIAD
centernet_resnet50v1_fpn_512x512_kpts CPU, iGPU, MYRIAD
centernet_resnet50v2_512x512 CPU, iGPU, MYRIAD
cord-19_swivel-128d   CPU, iGPU, MYRIAD
cropnet​/classifier​/cassava_disease_V1 CPU, iGPU, MYRIAD
efficientdet​/d0 MYRIAD
efficientdet​/d4 MYRIAD
efficientdet​/d7 CPU, iGPU, MYRIAD
efficientdet​/lite0​/detection CPU, MYRIAD
efficientdet​/lite0​/feature-vector CPU, iGPU, MYRIAD
efficientdet_d1   iGPU, MYRIAD
efficientdet_d2   iGPU, MYRIAD
efficientdet_d6   CPU, MYRIAD
efficientdet_lite1_detection   CPU, iGPU, MYRIAD
efficientdet_lite1_feature-vector   CPU, iGPU, MYRIAD
efficientdet_lite2_feature-vector   CPU, iGPU, MYRIAD
efficientdet_lite3_detection   CPU, iGPU, MYRIAD
efficientdet_lite3x_detection   CPU, iGPU, MYRIAD
efficientdet_lite4_detection   CPU, MYRIAD
efficientdet_lite4_feature-vector   CPU, iGPU, MYRIAD
efficientnet​/b0​/classification CPU, iGPU, MYRIAD
efficientnet​/b0​/feature-vector CPU, iGPU, MYRIAD
efficientnet​/b3​/feature-vector CPU, iGPU, MYRIAD
efficientnet​/b4​/feature-vector CPU, iGPU, MYRIAD
efficientnet​/b7​/classification CPU, iGPU, MYRIAD
efficientnet​/b7​/feature-vector CPU, iGPU, MYRIAD
efficientnet_b2_feature-vector   CPU, iGPU, MYRIAD
electra_base   CPU, iGPU, MYRIAD
electra_small CPU, iGPU, MYRIAD
elmo   CPU, iGPU, MYRIAD
esrgan-tf2 CPU, iGPU, MYRIAD
experts​/bert​/wiki_books CPU, iGPU, MYRIAD
experts_bert_pubmed   CPU, iGPU, MYRIAD
faster_rcnn​/inception_resnet_v2_1024x1024 CPU, iGPU, MYRIAD
faster_rcnn​/inception_resnet_v2_640x640 CPU, iGPU, MYRIAD
faster_rcnn​/resnet50_v1_640x640 CPU, iGPU, MYRIAD
faster_rcnn_resnet101_v1_640x640   CPU, iGPU, MYRIAD
imagenet​/inception_resnet_v2​/classification CPU, iGPU, MYRIAD
imagenet​/inception_resnet_v2​/feature_vector CPU, iGPU, MYRIAD
imagenet​/inception_v1​/classification CPU, iGPU, MYRIAD
imagenet​/inception_v1​/feature_vector CPU, iGPU, MYRIAD
imagenet​/inception_v2​/feature_vector CPU, iGPU, MYRIAD
imagenet​/inception_v3​/classification CPU, iGPU, MYRIAD
imagenet​/inception_v3​/feature_vector CPU, iGPU, MYRIAD
imagenet​/mobilenet_v1_025_224​/classification CPU, iGPU, MYRIAD
imagenet​/mobilenet_v1_050_160​/classification CPU, iGPU, MYRIAD
imagenet​/mobilenet_v1_100_224​/classification CPU, iGPU, MYRIAD
imagenet​/mobilenet_v1_100_224​/feature_vector CPU, iGPU, MYRIAD
imagenet​/mobilenet_v2_035_128​/feature_vector CPU, iGPU, MYRIAD
imagenet​/mobilenet_v2_035_224​/classification CPU, iGPU, MYRIAD
imagenet​/mobilenet_v2_035_96​/classification CPU, iGPU, MYRIAD
imagenet​/mobilenet_v2_050_224​/classification CPU, iGPU, MYRIAD
imagenet​/mobilenet_v2_075_224​/classification CPU, iGPU, MYRIAD
imagenet​/mobilenet_v2_100_224​/classification CPU, iGPU, MYRIAD
imagenet​/mobilenet_v2_100_224​/feature_vector CPU, iGPU, MYRIAD
imagenet​/mobilenet_v2_130_224​/classification CPU, iGPU, MYRIAD
imagenet​/mobilenet_v2_140_224​/classification CPU, iGPU, MYRIAD
imagenet​/mobilenet_v2_140_224​/feature_vector CPU, iGPU, MYRIAD
imagenet​/mobilenet_v3_small_100_224​/feature_vector CPU, iGPU, MYRIAD
imagenet​/pnasnet_large​/feature_vector CPU, iGPU, MYRIAD
imagenet​/resnet_v1_50​/feature_vector CPU, iGPU, MYRIAD
imagenet​/resnet_v2_152​/feature_vector CPU, iGPU, MYRIAD
imagenet​/resnet_v2_50​/classification CPU, iGPU, MYRIAD
imagenet​/resnet_v2_50​/feature_vector CPU, iGPU, MYRIAD
imagenet_efficientnet_v2_imagenet21k_xl_feature_vector   CPU, iGPU, MYRIAD
imagenet_mobilenet_v2_100_96_feature_vector   CPU, iGPU, MYRIAD
imagenet_mobilenet_v2_130_224_feature_vector   CPU, iGPU, MYRIAD
imagenet_mobilenet_v3_large_100_224_classification   CPU, iGPU, MYRIAD
imagenet_mobilenet_v3_large_100_224_feature_vector   CPU, iGPU, MYRIAD
imagenet_mobilenet_v3_small_075_224_classification   CPU, iGPU, MYRIAD
imagenet_mobilenet_v3_small_100_224_classification   CPU, iGPU, MYRIAD
imagenet_nasnet_large_classification   CPU, iGPU, MYRIAD
imagenet_nasnet_large_feature_vector   CPU, iGPU, MYRIAD
imagenet_nasnet_mobile_feature_vector   CPU, iGPU, MYRIAD
imagenet_resnet_v1_50_classification   CPU, iGPU, MYRIAD
imagenet_resnet_v2_101_classification   CPU, iGPU, MYRIAD
imagenet_resnet_v2_152_classification   CPU, iGPU, MYRIAD
inaturalist​/inception_v3​/feature_vector CPU, iGPU, MYRIAD
LaBSE CPU, iGPU, MYRIAD
magenta_arbitrary-image-stylization-v1-256   CPU, iGPU, MYRIAD
mask_rcnn​/inception_resnet_v2_1024x1024 CPU, iGPU, MYRIAD
mask_rcnn_inception_resnet_v2_1024x1024   CPU, iGPU, MYRIAD
movenet​/singlepose​/lightning CPU, iGPU, MYRIAD
movenet_multipose_lightning   CPU, iGPU, MYRIAD
movenet_singlepose_thunder   CPU, iGPU, MYRIAD
MuRIL CPU, iGPU, MYRIAD
MuRIL_preprocess   CPU, iGPU, MYRIAD
nnlm-de-dim50 CPU, iGPU, MYRIAD
nnlm-de-dim50-with-normalization CPU, iGPU, MYRIAD
nnlm-en-dim128 CPU, iGPU, MYRIAD
nnlm-en-dim128-with-normalization CPU, iGPU, MYRIAD
nnlm-en-dim50 CPU, iGPU, MYRIAD
nnlm-en-dim50-with-normalization CPU, iGPU, MYRIAD
nnlm-es-dim128 CPU, iGPU, MYRIAD
nnlm-es-dim128-with-normalization   CPU, iGPU, MYRIAD
nnlm-ja-dim128 CPU, iGPU, MYRIAD
nnlm-ja-dim128-with-normalization CPU, iGPU, MYRIAD
nnlm-ja-dim50 CPU, iGPU, MYRIAD
nonsemantic-speech-benchmark​/trill CPU, iGPU, MYRIAD
nonsemantic-speech-benchmark​/trill-distilled CPU, iGPU, MYRIAD
resnet_50​/classification CPU, iGPU, MYRIAD
resnet_50​/feature_vector CPU, iGPU, MYRIAD
retinanet_resnet50_v1_fpn_640x640   CPU, iGPU, MYRIAD
small_bert​/bert_en_uncased_L-2_H-128_A-2 CPU, iGPU, MYRIAD
small_bert​/bert_en_uncased_L-4_H-512_A-8 CPU, iGPU, MYRIAD
small_bert_bert_en_uncased_L-12_H-128_A-2   CPU, iGPU, MYRIAD
small_bert_bert_en_uncased_L-12_H-768_A-12   CPU, iGPU, MYRIAD
small_bert_bert_en_uncased_L-2_H-256_A-4   CPU, iGPU, MYRIAD
small_bert_bert_en_uncased_L-4_H-128_A-2   CPU, iGPU, MYRIAD
small_bert_bert_en_uncased_L-4_H-256_A-4   CPU, iGPU, MYRIAD
small_bert_bert_en_uncased_L-8_H-512_A-8   CPU, iGPU, MYRIAD
spice   CPU, iGPU, MYRIAD
ssd_mobilenet_v1_fpn_640x640   CPU, iGPU, MYRIAD
ssd_mobilenet_v2​/fpnlite_320x320 CPU, iGPU, MYRIAD
ssd_mobilenet_v2​/fpnlite_640x640 CPU, iGPU, MYRIAD
ssd_mobilenet_v2 CPU, iGPU, MYRIAD
talkheads_ggelu_bert_en_base   CPU, iGPU, MYRIAD
tf2-preview​/gnews-swivel-20dim CPU, iGPU, MYRIAD
tf2-preview​/gnews-swivel-20dim-with-oov CPU, iGPU, MYRIAD
tf2-preview​/inception_v3​/classification CPU, iGPU, MYRIAD
tf2-preview​/inception_v3​/feature_vector CPU, iGPU, MYRIAD
tf2-preview​/mobilenet_v2​/classification CPU, iGPU, MYRIAD
tf2-preview​/mobilenet_v2​/feature_vector CPU, iGPU, MYRIAD
tf2-preview​/nnlm-en-dim128 CPU, iGPU, MYRIAD
tf2-preview​/nnlm-en-dim128-with-normalization CPU, iGPU, MYRIAD
tf2-preview​/nnlm-en-dim50 CPU, iGPU, MYRIAD
tf2-preview​/nnlm-es-dim50-with-normalization CPU, iGPU, MYRIAD
universal-sentence-encoder CPU, iGPU, MYRIAD
universal-sentence-encoder-cmlm​/multilingual-preprocess CPU, iGPU, MYRIAD
universal-sentence-encoder-cmlm_multilingual-base   CPU, iGPU, MYRIAD
universal-sentence-encoder-cmlm_multilingual-base-br   CPU, iGPU, MYRIAD
universal-sentence-encoder-large CPU, iGPU, MYRIAD
universal-sentence-encoder-multilingual CPU, iGPU, MYRIAD
universal-sentence-encoder-multilingual-large CPU, iGPU, MYRIAD
universal-sentence-encoder-multilingual-qa CPU, iGPU, MYRIAD
universal-sentence-encoder-qa CPU, iGPU, MYRIAD
vggish CPU, iGPU, MYRIAD
Wiki-words-250 CPU, iGPU, MYRIAD
Wiki-words-250-with-normalization CPU, iGPU, MYRIAD
Wiki-words-500   CPU, iGPU, MYRIAD
Wiki-words-500-with-normalization CPU, iGPU, MYRIAD
yamnet CPU, iGPU, MYRIAD
albert_base CPU, GPU, MYRIAD
albert_en_large CPU, GPU, MYRIAD
albert_large CPU, GPU, MYRIAD
albert_xlarge CPU, GPU, MYRIAD
albert_xxlarge CPU, GPU, MYRIAD
bert_cased_L-12_H-768_A-12 CPU, GPU, MYRIAD
bert_cased_L-24_H-1024_A-16 CPU, GPU, MYRIAD
bert_chinese_L-12_H-768_A-12 CPU, GPU, MYRIAD
bert_uncased_L-12_H-768_A-12 CPU, GPU, MYRIAD
bert_uncased_L-24_H-1024_A-16 CPU, GPU, MYRIAD
bigbigan-resnet50 CPU, GPU, MYRIAD
biggan-128 CPU, GPU, MYRIAD
biggan-256 CPU, GPU, MYRIAD
biggan-512 CPU, GPU, MYRIAD
biggan-deep-128 CPU, GPU, MYRIAD
biggan-deep-256 CPU, GPU, MYRIAD
biggan-deep-512 CPU, GPU, MYRIAD
bit_m-r152x4_imagenet21k_classification MYRIAD
bit_m-r50x1_imagenet21k_classification CPU, GPU, MYRIAD
centernet_hourglass_1024x1024_kpts CPU, GPU, MYRIAD
efficientnet_b1_feature-vector CPU, GPU, MYRIAD
efficientnet_b5_feature-vector CPU, GPU, MYRIAD
efficientnet_lite0_feature-vector CPU, GPU, MYRIAD
efficientnet_lite1_classification CPU, GPU, MYRIAD
efficientnet_lite1_feature-vector CPU, GPU, MYRIAD
efficientnet_lite2_classification CPU, GPU, MYRIAD
efficientnet_lite2_feature-vector CPU, GPU, MYRIAD
efficientnet_lite3_classification CPU, GPU, MYRIAD
efficientnet_lite3_feature-vector CPU, GPU, MYRIAD
efficientnet_lite4_feature-vector CPU, GPU, MYRIAD
enformer CPU, GPU, MYRIAD
experts_bert_wiki_books_sst2 CPU, GPU, MYRIAD
faster_rcnn_openimages_v4_inception_resnet_v2 CPU, GPU, MYRIAD
faster_rcnn_resnet152_v1_640x640 CPU, GPU, MYRIAD
faster_rcnn_resnet50_v1_1024x1024 CPU, GPU, MYRIAD
ganeval-cifar10-convnet CPU, GPU, MYRIAD
imagenet_efficientnet_v2_imagenet1k_b0_feature_vector CPU, GPU, MYRIAD
imagenet_efficientnet_v2_imagenet1k_s_feature_vector CPU, GPU, MYRIAD
imagenet_efficientnet_v2_imagenet21k_b0_feature_vector CPU, GPU, MYRIAD
imagenet_efficientnet_v2_imagenet21k_s_feature_vector CPU, GPU, MYRIAD
imagenet_mobilenet_v1_025_224_feature_vector CPU, GPU, MYRIAD
imagenet_mobilenet_v1_075_160_feature_vector CPU, GPU, MYRIAD
imagenet_mobilenet_v2_050_192_classification CPU, GPU, MYRIAD
imagenet_mobilenet_v3_large_075_224_feature_vector CPU, GPU, MYRIAD
imagenet_mobilenet_v3_large_100_224_classification CPU, GPU, MYRIAD
imagenet_mobilenet_v3_small_075_224_feature_vector CPU, GPU, MYRIAD
imagenet_mobilenet_v3_small_100_224_feature_vector CPU, GPU, MYRIAD
imagenet_nasnet_mobile_classification CPU, GPU, MYRIAD
imagenet_resnet_v1_50_feature_vector+A27 CPU, GPU, MYRIAD
mil-nce_s3d
mobilebert_uncased_L-24_H-128_B-512_A-4_F-4_OPT_squadv1 CPU, GPU, MYRIAD
movinet_a2_base_kinetics-600_classification CPU, GPU, MYRIAD
progan-128 CPU, GPU, MYRIAD
random-nnlm-en-dim128 CPU, GPU, MYRIAD
retinanet_resnet152_v1_fpn_1024x1024 CPU, GPU, MYRIAD
seefood_segmenter_mobile_food_segmenter_V1_1 CPU, GPU, MYRIAD
small_bert_bert_en_uncased_L-4_H-768_A-12 CPU, GPU, MYRIAD
small_bert_bert_en_uncased_L-6_H-256_A-4 CPU, GPU, MYRIAD
small_bert_bert_en_uncased_L-6_H-512_A-8 CPU, GPU, MYRIAD
tfgan_eval_inception CPU, GPU, MYRIAD
tweening_conv3d_bair CPU, GPU, MYRIAD
universal-sentence-encoder-cmlm_en-base CPU, GPU, MYRIAD
vision_classifier_imet_attributes_V1 CPU, GPU, MYRIAD
wiki40b-lm-es CPU, GPU, MYRIAD

Other Models

Model Name Supported Devices
 3d-pose-baseline  CPU, iGPU, MYRIAD, VAD-M 
 ACGAN   CPU 
 adv_inception_v3   CPU 
 ALBERT   CPU 
arttrack-coco-multi CPU, iGPU, MYRIAD
arttrack-mpii-single CPU, iGPU, MYRIAD
 BERT_LARGE   CPU 
 context_rcnn_resnet101_snapshot_serenget   CPU 
 cpm-person  CPU, iGPU, MYRIAD, VAD-M 
 cpm-pose  CPU, iGPU, VAD-M 
 CRNN  CPU, iGPU, MYRIAD, VAD-M 
 ctpn  CPU, iGPU, MYRIAD, VAD-M 
 deeplab   CPU 
 deeplabv3  CPU, MYRIAD, VAD-M 
 densenet161  CPU, iGPU, MYRIAD, VAD-M 
 dilation  CPU, iGPU
 east_resnet_v1_50  CPU, iGPU, MYRIAD, VAD-M 
 efficientdet-d0_frozen  CPU,  iGPU,  MYRIAD 
 EfficientDet-D0-512x512   CPU 
 efficientdet-d1_frozen  CPU,  iGPU,  MYRIAD 
 EfficientDet-D1-640x640   CPU 
 EfficientDet-D2-768x768   CPU 
 EfficientDet-D3-896x896   CPU 
 EfficientDet-D4-1024x1024   CPU 
 EfficientDet-D5-1280x1280   CPU 
 EfficientDet-D6-1280x1280   CPU 
 EfficientDet-D7-1536x1536   CPU 
 efficientnet-b0_auto_aug  CPU, iGPU, MYRIAD, VAD-M 
 efficientnet-b7_auto_aug  CPU, iGPU, MYRIAD, VAD-M 
 ens3_adv_inception_v3   CPU 
 facenet-20180408-102900   CPU, iGPU, MYRIAD 
 faster_rcnn_inception_resnet_v2_atrous_lowproposals_coco   CPU 
 faster_rcnn_inception_resnet_v2_atrous_oid   CPU 
 faster_rcnn_nas_coco  CPU 
 faster_rcnn_nas_coco_2018_01_28   CPU, VAD-M 
 faster_rcnn_nas_lowproposals_coco  CPU, MYRIAD, VAD-M 
 faster_rcnn_resnet101_ava_v2.1  CPU
 faster_rcnn_resnet101_fgvc   CPU
 faster_rcnn_resnet101_kitti  CPU 
 faster_rcnn_resnet101_lowproposals_coco   CPU 
 faster_rcnn_resnet101_snapshot_serengeti   CPU 
 faster_rcnn_resnet50_fgvc   CPU 
 fc_densenet_103  CPU, iGPU, MYRIAD, VAD-M 
 fcrn-dp-nyu-depth-v2-tf  CPU, iGPU, MYRIAD, VAD-M 
 googlenet-v1  CPU, iGPU, MYRIAD, VAD-M 
 googlenet-v2  CPU, iGPU, MYRIAD, VAD-M 
 googlenet-v3  CPU, iGPU, MYRIAD, VAD-M 
 googlenet-v4  CPU, iGPU, MYRIAD, VAD-M 
 handwritten-score-recognition-0003   CPU 
 i3d-flow  CPU, iGPU, MYRIAD, VAD-M 
 i3d-rgb  CPU, iGPU, MYRIAD, VAD-M 
 icnet-camvid-ava-0001  CPU
 icnet-camvid-ava-sparse-30-0001  CPU
 icnet-camvid-ava-sparse-60-0001  CPU
 image-retrieval-0001  CPU 
 inception_resnet_v2  CPU, iGPU, MYRIAD, VAD-M 
 license-plate-recognition-barrier-0007  CPU, iGPU, MYRIAD, VAD-M 
 lm_1b  CPU, iGPU, MYRIAD 
 mask_rcnn_resnet101_atrous_coco  CPU, iGPU, MYRIAD, VAD-M
 mask_rcnn_resnet50_atrous  CPU, iGPU, MYRIAD 
 mask_rcnn_resnet50_atrous_coco   CPU, iGPU, MYRIAD, VAD-M 
 mobilenet_v1_0.25_128  CPU, iGPU, MYRIAD, VAD-M 
 mobilenet_v1_0.50_160  CPU, iGPU, MYRIAD, VAD-M 
 mobilenet_v1_0.50_224  CPU, iGPU, MYRIAD, VAD-M 
 mobilenet_v1_1.0_224  CPU, iGPU, MYRIAD, VAD-M 
 mobilenet_v2_1.0_224  CPU, iGPU, MYRIAD, VAD-M 
 mobilenet_v2_fpn_ssdlite_crossroad  CPU, iGPU, MYRIAD, VAD-M 
 mobilenet-v3-large-1.0-224-tf  CPU, iGPU, MYRIAD, VAD-M 
 mobilenet-v3-small-1.0-224-tf  CPU, iGPU, MYRIAD, VAD-M 
 mozilla-deepspeech-0.6.1 CPU, iGPU, MYRIAD, VAD-M 
 mozilla-deepspeech-0.7.1  CPU, iGPU, MYRIAD, VAD-M 
 mozilla-deepspeech-0.8.2  CPU, MYRIAD, VAD-M 
 NCF-1B   CPU 
 netvlad  CPU, iGPU, MYRIAD, VAD-M 
 NiftyNet  CPU, iGPU, MYRIAD, VAD-M 
 openpose-pose  CPU, iGPU, MYRIAD, VAD-M 
 person-vehicle-bike-detection-crossroad-yolov3-1020   CPU 
 pose-ae-multiperson  CPU, iGPU, MYRIAD, VAD-M 
 pose-ae-refinement  CPU, iGPU, MYRIAD, VAD-M 
 PRNet  CPU, iGPU, MYRIAD, VAD-M 
 resnet_50  CPU, iGPU, MYRIAD, VAD-M 
 resnet_50_v1.5  CPU, iGPU, MYRIAD, VAD-M 
 resnet_v2_101  CPU, iGPU, MYRIAD, VAD-M 
 resnet-101  CPU, iGPU, MYRIAD, VAD-M 
 resnet-152  CPU, iGPU, MYRIAD, VAD-M 
 ResNet-50_v1.5   CPU 
 resnet-50-tf  CPU, iGPU, MYRIAD, VAD-M 
 ResNeXt_101   CPU 
 ResNext_50   CPU 
 resnext50v2   CPU, iGPU, MYRIAD, VAD-M 
 R-FCN   CPU 
 rfcn_resnet101_coco  CPU, iGPU, MYRIAD, VAD-M 
 se-resnext-50  CPU, iGPU, MYRIAD, VAD-M 
 SqueezeNet   CPU 
 squeezenet1.1  CPU, iGPU, MYRIAD, VAD-M 
 srgan  CPU, iGPU, MYRIAD, VAD-M 
 ssd_inception_v2_coco   CPU 
 ssd_mobilenet_v1_0.75_depth_300x300_coco   CPU 
 ssd_mobilenet_v1_ppn_shared_box_predictor_300x300_coco   CPU 
 ssd_resnet_101_fpn_oidv4   CPU 
 ssd_resnet34_1200x1200   CPU 
 ssd_resnet34_300x300   CPU 
 ssd_resnet34_fp32_1200x1200_pretrained_model   CPU 
 SSD_ResNet50_V1_FPN_640x640_RetinaNet50   CPU 
 ssd_resnet50_v1_fpn_coco  CPU 
 STN  CPU, iGPU, MYRIAD, VAD-M 
 text-recognition-0012   CPU 
 Transformer-LT   CPU 
 vehicle-attributes-barrier-0103  CPU, iGPU, MYRIAD, VAD-M 
 vehicle-license-plate-detection-barrier-0106   CPU 
 vehicle-license-plate-detection-barrier-0123  CPU, iGPU, MYRIAD, VAD-M 
 vggvox  CPU, iGPU, MYRIAD, VAD-M 
 wavenet   CPU 
 wide_deep   CPU 
 yolo_v2  CPU, iGPU, MYRIAD, VAD-M 
 yolo_v2_tiny  CPU, iGPU, MYRIAD, VAD-M 
 yolo_v3_darknet  CPU, iGPU, MYRIAD, VAD-M 
 yolo-v1-tiny-tf  CPU, iGPU, MYRIAD 
 yolo-v3  CPU, iGPU, MYRIAD, VAD-M 
 yolo-v3-tiny-tf  CPU, iGPU, MYRIAD, VAD-M 
 yolo-v4  CPU, iGPU, MYRIAD, VAD-M 

Pre-trained frozen model files are provided for only some of these models. For the rest, please refer to the links provided.

Quantization Support (Preview)

OpenVINO™ integration with TensorFlow now supports INT8 models quantized using Quantization-Aware Training (QAT) tools such as OpenVINO™ Neural Network Compression Framework (NNCF) and TensorFlow Model Optimization ToolKit (TFMOT). This support is currently in a preview state and performance optimizations are in progress.

Some examples of NNCF usage to produce quantized models can be found here.

Some quantized models are shown to provide more optimized performance by setting the environment variable 'OPENVINO_TF_CONSTANT_FOLDING' to 1 before running inference.

[Note: The latest supported TensorFlow versions for NNCF and OpenVINO™ integration with TensorFlow may be different. It is advised that the users create a separate virtual environment for quantizing the models with NNCF to avoid any TensorFlow version incompatability issues. The quantized models can then be run in the environment that is compatible with OpenVINO™ integration with TensorFlow. NNCF compatible with TensorFlow version 2.4.2 is validated with OpenVINO™ integration with TensorFlow compatible with TensorFlow version 2.8.0.]