Skip to content

Latest commit

 

History

History
87 lines (65 loc) · 4.54 KB

README.md

File metadata and controls

87 lines (65 loc) · 4.54 KB
Raw

Facial Detector modular resource

This module implements the rdk:service:vision API in a facial-detector model to be used with (viam-server](https://docs.viam.com/). This detector leverages the DeepFace library to perform facial detections.

Note

For more information, see Modular Resources.

Requirements

This module is compatible with the following platforms:

  • MacOS (darwin)
  • Linux

Configure your facial detector

Note

Before configuring your vision service, you must create a machine.

Navigate to the Config tab of your machine's page in the Viam app. Click on the Services subtab and click Create service. Select the vision type, then select the detector:facial-detector model. Click Add module, then enter a name for your vision service and click Create.

On the new service panel, copy and paste the following attribute template into your vision service's Attributes box:

{
  "detection_framework": "<detection-framework>",
  "recognition_model": "<recognition-model>",
  "face_labels": {
    "matt": "<path-to-image-1>",
    "suzy": "<path-to-image-2>"
  },
  "verify_threshold": <verify-threshold>,
  "disable_detect": <disable-detect>,
  "disable_verify": <disable-verify>
}

Note

For more information, see Configure a Machine.

Attributes

The following attributes are available for vision:facial-detector:ssd vision services:

Name Type Inclusion Description Supported
detection_framework enum Optional The detection framework to use for facial detection.
Default: ssd, for a good balance of speed and accuracy.		 "opencv", "retinaface", "mtcnn", "ssd", "dlib", "mediapipe", "yolov8"
recognition_model enum Optional The model to use for facial recognition.
Default: ArcFace, for a good balance of speed and accuracy.		 "VGG-Face", "Facenet", "Facenet512", "OpenFace", "DeepFace", "DeepID", "ArcFace", "Dlib", "SFace"
face_labels object Optional An object map of key:label, value:path for matching against reference face images. -
verify_threshold number Optional If disable_verify is set to false and face_labels are set, this threshold must be met or exceeded for a verification match.
Default: 0.8		 -
disable_detect bool Optional If set to false, any faces detected but not verified as matching a label will be labeled as "face".
Default: false		 -
disable_verify bool Optional If set to false and face_labels are set, will attempt to verify any faces detected. If you only want verified faces, set disable_verify to false and disable_detect to true.
Default: false		 -

Example configuration

{
  "detection_framework": "ssd",
  "recognition_model": "ArcFace",
  "face_labels": {
    "matt": "/path/to/matt.jpg",
    "suzy": "/path/to/suzy_photo.jpg"
  },
  "verify_threshold": 0.8,
  "disable_detect": false,
  "disable_verify": false
}

API

The facial-detector resource provides the following methods from Viam's vision API:

Method Parameters Description
get_detections image Get a list of detections in the given image using the specified detector.
get_detections_from_camera camera_name=string Get a list of classifications in the next image given a camera and a classifier.

Next Steps