detect

Detect objects using SSD object detector configured for monocular camera

Since R2020a

Syntax

bboxes = detect(detector,I)

[bboxes,scores] = detect(detector,I)

[___,labels] = detect(detector,I)

[___] = detect(___,roi)

detectionResults = detect(detector,ds)

[___] = detect(___,Name,Value)

Description

bboxes = detect(detector,I) detects objects within image I using an SSD (singe shot detection convolutional neural networks) multibox object detector configured for a monocular camera. The locations of objects detected are returned as a set of bounding boxes.

When using this function, use of a CUDA^®-enabled NVIDIA^® GPU. The GPU reduces computation time significantly. Usage of the GPU requires Parallel Computing Toolbox™. For information about the supported compute capabilities, see GPU Computing Requirements (Parallel Computing Toolbox).

[bboxes,scores] = detect(detector,I) also returns the detection confidence scores for each bounding box.

[___,labels] = detect(detector,I) also returns a categorical array of labels assigned to the bounding boxes, using either of the preceding syntaxes. The labels used for object classes are defined during training using the trainSSDObjectDetector function.

[___] = detect(___,roi) detects objects within the rectangular search region specified by roi. Use output arguments from any of the previous syntaxes. Specify input arguments from any of the previous syntaxes.

detectionResults = detect(detector,ds) detects objects within the series of images returned by the read function of the input datastore.

[___] = detect(___,Name,Value) specifies options using one or more Name,Value pair arguments. For example, detect(detector,I,'Threshold',0.75) sets the detection score threshold to 0.75. Any detections with a lower score are removed.

Examples

Detect Vehicles Using Monocular Camera and SSD

Configure an SSD object detector for use with a monocular camera mounted on an ego vehicle. Use this detector to detect vehicles within an image captured by the camera.

Load an ssdObjectDetector object pretrained to detect vehicles.

vehicleDetector = load('ssdVehicleDetector.mat','detector');
detector = vehicleDetector.detector;

Model a monocular camera sensor by creating a monoCamera object. This object contains the camera intrinsics and the location of the camera on the ego vehicle.

focalLength = [309.4362 344.2161];    % [fx fy]
principalPoint = [318.9034 257.5352]; % [cx cy]
imageSize = [480 640];                % [mrows ncols]
height = 2.1798;                      % height of camera above ground, in meters
pitch = 14;                           % pitch of camera, in degrees
intrinsics = cameraIntrinsics(focalLength,principalPoint,imageSize);

sensor = monoCamera(intrinsics,height,'Pitch',pitch);

Configure the detector for use with the camera. Limit the width of detected objects to 1.5 – 2.5 meters. The configured detector is an ssdObjectDetectorMonoCamera object.

vehicleWidth = [1.5 2.5];
detectorMonoCam = configureDetectorMonoCamera(detector,sensor,vehicleWidth);

Read an image captured by the camera.

I = imread('highwayCars.png');

Detect the vehicles in the image by using the detector. Annotate the image with the bounding boxes for the detections and the detection confidence scores.

[bboxes,scores,labels] = detect(detectorMonoCam,I,'Threshold',0.6);
I = insertObjectAnnotation(I,'rectangle',bboxes,scores,'AnnotationColor','g');
imshow(I)

Display the labels for detected bounding boxes. The labels specify the class names of the detected objects.

disp(labels)

     vehicle 
     vehicle 

Input Arguments

detector — SSD multibox object detector

SSDObjectDetector object

SSD multibox object detector, specified as an ssdObjectDetector object. To create this object, call the trainSSDObjectDetector function with training data as input.

I — Input image

H-by-W-by-C-by-B numeric array of images

Input image, specified as an H-by-W-by-C-by-B numeric array of images. Images must be real, nonsparse, grayscale or RGB image.

• H — Height in pixels.

• W — Width in pixels

• C — The channel size in each image must be equal to the network's input channel size. For example, for grayscale images, C must be equal to 1. For RGB color images, it must be equal to 3.

• B — Number of images in the array.

The detector is sensitive to the range of the input image. Therefore, ensure that the input image range is similar to the range of the images used to train the detector. For example, if the detector was trained on uint8 images, rescale this input image to the range [0, 255] by using the im2uint8 or rescale function. The size of this input image should be comparable to the sizes of the images used in training. If these sizes are very different, the detector has difficulty detecting objects because the scale of the objects in the input image differs from the scale of the objects the detector was trained to identify. Consider whether you used the SmallestImageDimension property during training to modify the size of training images.

Data Types: uint8 | uint16 | int16 | double | single | logical

ds — Datastore

datastore object

Datastore, specified as a datastore object containing a collection of images. Each image must be a grayscale, RGB, or multichannel image. The function processes only the first column of the datastore, which must contain images and must be cell arrays or tables with multiple columns.

roi — Search region of interest

[x y width height] vector

Search region of interest, specified as a four-element vector of the form [x y width height]. The vector specifies the upper left corner and size of a region in pixels.

Name-Value Arguments

Specify optional pairs of arguments as Name1=Value1,...,NameN=ValueN, where Name is the argument name and Value is the corresponding value. Name-value arguments must appear after other arguments, but the order of the pairs does not matter.

Before R2021a, use commas to separate each name and value, and enclose Name in quotes.

Example: 'SelectStrongest',true

Threshold — Detection threshold

0.5 (default) | scalar

Detection threshold, specified as a scalar in the range [0, 1]. Detections that have scores less than this threshold value are removed. To reduce false positives, increase this value.

SelectStrongest — Select strongest bounding box

true (default) | false

Select the strongest bounding box for each detected object, specified as the comma-separated pair consisting of 'SelectStrongest' and either true or false.

• true — Return the strongest bounding box per object. To select these boxes, detect calls the selectStrongestBboxMulticlass function, which uses nonmaximal suppression to eliminate overlapping bounding boxes based on their confidence scores.

  For example:

   selectStrongestBboxMulticlass(bbox,scores, ...
              'RatioType','Min', ...
              'OverlapThreshold',0.5);

• false — Return all detected bounding boxes. You can then create your own custom operation to eliminate overlapping bounding boxes.

MinSize — Minimum region size

[1 1] (default) | [height width] vector

Minimum region size that contains a detected object, specified as the comma-separated pair consisting of 'MinSize', and [height width] vector. Units are in pixels.

To reduce computation time, set this value to the known minimum region size for the objects being detected in the image. By default, 'MinSize' is set to [1 1].

MaxSize — Maximum region size

size(I) (default) | [height width] vector

Maximum region size that contains a detected object, specified as the comma-separated pair consisting of 'MaxSize' and a [height width] vector. Units are in pixels.

To reduce computation time, set this value to the known maximum region size for the objects being detected in the image. By default, 'MaxSize' is set to the height and width of the input image, I.

MiniBatchSize — Minimum batch size

128 (default) | scalar

Minimum batch size, specified as the comma-separated pair consisting of 'MiniBatchSize' and a scalar value. Use the MiniBatchSize to process a large collection of images. Images are grouped into minibatches and processed as a batch to improve computation efficiency. Increase the minibatch size to decrease processing time. Decrease the size to use less memory.

ExecutionEnvironment — Hardware resource

'auto' (default) | 'gpu' | 'cpu'

Hardware resource on which to run the detector, specified as the comma-separated pair consisting of 'ExecutionEnvironment' and 'auto', 'gpu', or 'cpu'.

• 'auto' — Use a GPU if it is available. Otherwise, use the CPU.

• 'gpu' — Use the GPU. To use a GPU, you must have Parallel Computing Toolbox and a CUDA enabled NVIDIA GPU. If a suitable GPU is not available, the function returns an error. For information about the supported compute capabilities, see GPU Computing Requirements (Parallel Computing Toolbox).

• 'cpu' — Use the CPU.

Output Arguments

bboxes — Location of objects detected

M-by-4 matrix | B-by-1 cell array

Location of objects detected within the input image or images, returned as an M-by-4 matrix or a B-by-1 cell array. M is the number of bounding boxes in an image, and B is the number of M-by-4 matrices when the input contains an array of images.

Each row of bboxes contains a four-element vector of the form [x y width height]. This vector specifies the upper left corner and size of that corresponding bounding box in pixels.

scores — Detection scores

M-by-1 vector | B-by-1 cell array

Detection confidence scores, returned as an M-by-1 vector or a B-by-1 cell array. M is the number of bounding boxes in an image, and B is the number of M-by-1 vectors when the input contains an array of images. A higher score indicates higher confidence in the detection.

labels — Labels for bounding boxes

M-by-1 categorical array | B-by-1 cell array

Labels for bounding boxes, returned as an M-by-1 categorical array or a B-by-1 cell array. M is the number of labels in an image, and B is the number of M-by-1 categorical arrays when the input contains an array of images. You define the class names used to label the objects when you train the input detector.

detectionResults — Detection results

3-column table

Detection results, returned as a 3-column table with variable names, Boxes, Scores, and Labels. The Boxes column contains M-by-4 matrices, of M bounding boxes for the objects found in the image. Each row contains a bounding box as a 4-element vector in the format [x,y,width,height]. The format specifies the upper-left corner location and size in pixels of the bounding box in the corresponding image.

Version History

Introduced in R2020a