Speech Command Recognition Code Generation Using Simulink

This example demonstrates how to deploy feature extraction and a convolutional neural network (CNN) for speech command recognition on Intel® processors. To generate the feature extraction and network code, you use Embedded Coder in Simulink® and the Intel® Math Kernel Library for Deep Neural Networks (MKL-DNN). In this example you generate Software-in-the-loop (SIL) code for a reference model which performs feature extraction and predicts the speech command. The generated SIL code is called in a Simulink model which displays the predicted speech command and predicted scores for the given inputs. For details about audio preprocessing and network training, see Train Deep Learning Network for Speech Command Recognition.

Prepare Simulink Model to Deploy

Create a Simulink model and capture the feature extraction, convolutional neural network and postprocessing as developed in Apply Speech Command Recognition Network in Simulink. This model is shipped with this example. Open the model to understand its configurations.

modelToDeploy = "recognizeSpeechCommand";
open_system(modelToDeploy)

Set the Data type, Port dimensions, Sample time, and Signal type of the input port block as shown.

Configure Code Generation Settings

Open the recognizeSpeechCommand model. Go to the MODELING Tab and click on Model Settings or press Ctrl+E. Select Code Generation and set the System Target File to ert.tlc whose Description is Embedded Coder. Set the Language to C++, which will automatically set the Language Standard to C++11 (ISO).

Alternatively, use set_param to configure the settings programmatically,

set_param(modelToDeploy,SystemTargetFile="ert.tlc")
set_param(modelToDeploy,TargetLang="C++")
set_param(modelToDeploy,TargetLangStandard="C++11 (ISO)")

Select a solver that supports code generation. Set Solver to auto (Automatic solver selection) and Solver type to Fixed-step.

set_param(modelToDeploy,SolverName="FixedStepAuto")
set_param(modelToDeploy,SolverType="Fixed-step")

In Configuration > Hardware Implementation, set Device vendor to Intel and Device type to x86-64 (Windows64) or x86-64 (Linux 64) or x86-64 (Mac OS X) depending on your target system. Alternatively, use set_param to configure the settings programmatically.

switch(computer("arch"))
    case "win64"
        ProdHWDeviceType = "Intel->x86-64 (Windows64)";
    case "glnxa64"
        ProdHWDeviceType = "Intel->x86-64 (Linux 64)";
    case "maci64"
        ProdHWDeviceType = "Intel->x86-64 (Mac OS X)";
end
set_param(modelToDeploy, "ProdHWDeviceType", ProdHWDeviceType)

To automate setting the Device type, add the above code in Property Inspector > Properties > Callbacks > PreLoadFcn of the recognizeSpeechCommand model.

Use Embedded Coder app to generate and build the code. Click on APPS tab and then click on Embedded coder as shown.

It will open a new C++ CODE tab, then click on Build to generate and build the code. It will generate the code in a folder named recognizeSpeechCommand_ert_rtw. After generating the code, you view the report by clicking on Open Report.

Alternatively, you can use slbuild to generate the code programmatically.

slbuild(modelToDeploy);

### Searching for referenced models in model 'recognizeSpeechCommand'.
### Total of 1 models to build.
### Starting build procedure for: recognizeSpeechCommand
### Generating code and artifacts to 'Model specific' folder structure
### Generating code into build folder: C:\Users\user\OneDrive - MathWorks\Documents\MATLAB\ExampleManager\user.Bdoc.j2748394_2\deeplearning_shared-ex14618832\recognizeSpeechCommand_ert_rtw
### Generated code for 'recognizeSpeechCommand' is up to date because no structural, parameter or code replacement library changes were found.
### Saving binary information cache.
### Skipping makefile generation and compilation because C:\Users\user\OneDrive - MathWorks\Documents\MATLAB\ExampleManager\user.Bdoc.j2748394_2\deeplearning_shared-ex14618832\recognizeSpeechCommand.exe is up to date
### Successful completion of build procedure for: recognizeSpeechCommand

Build Summary

0 of 1 models built (1 models already up to date)
Build duration: 0h 0m 22.586s

Now close the recognizeSpeechCommand model.

save_system(modelToDeploy)
close_system(modelToDeploy)

Create a Simulink Model that Calls recognizeSpeechCommand and Displays its Output

Create a new simulink model and add recognizeSpeechCommand as a model reference block to it. Add the same base workspace variables, source blocks, and sink blocks as developed in Apply Speech Command Recognition Network in Simulink. Use a radio button group for selecting speech command files. For your reference, this model is shipped with this example. Open the same simulink model.

mainModel = "slexSpeechCommRecognitionCodegenWithMklDnnExample";
open_system(mainModel)

To set the Software-in-the-loop (SIL) simulation mode for the model reference block, click on MODELING tab.

Now click on the drop-down button as shown above, and it will open a window. Select Property Inspector as shown below.

You will get a Property Inspector window at the right of your model. Click on the Model block to get its Property Inspector. If the Model name is not set, browse for the recognizeSpeechCommand.slx and set the Model name. Now set Simulation mode to Software-in-the-loop (SIL) as shown.

Run the model to deploy the recognizeSpeechCommand.slx on your computer and perform speech command recognition.

set_param(mainModel,StopTime="20")
sim(mainModel)

### Searching for referenced models in model 'slexSpeechCommRecognitionCodegenWithMklDnnExample'.
### Total of 1 models to build.
### Starting serial model reference code generation build.
### Checking status of model reference code generation target for model 'recognizeSpeechCommand'.
### Model reference code generation target (recognizeSpeechCommand.cpp) for model recognizeSpeechCommand might have been out of date. Previous build was performed when model or linked library was dirty.
### Starting build procedure for: recognizeSpeechCommand
### Generating code and artifacts to 'Model specific' folder structure
### Code for the model reference code generation target for model recognizeSpeechCommand is up to date because no functional changes were found in referenced model.
### Saving binary information cache.
### Model reference code generation target for recognizeSpeechCommand is up to date.

Build Summary

0 of 1 models built (1 models already up to date)
Build duration: 0h 0m 25.135s
### Preparing to start SIL simulation ...
### Skipping makefile generation and compilation because C:\Users\user\OneDrive - MathWorks\Documents\MATLAB\ExampleManager\user.Bdoc.j2748394_2\deeplearning_shared-ex14618832\slprj\ert\recognizeSpeechCommand\sil\recognizeSpeechCommand.exe is up to date
### Starting SIL simulation for component: recognizeSpeechCommand
### Application stopped
### Stopping SIL simulation for component: recognizeSpeechCommand

ans = 

  Simulink.SimulationOutput:

     SimulationMetadata: [1x1 Simulink.SimulationMetadata] 
           ErrorMessage: [0x0 char] 

Now close the mainModel.

save_system(mainModel)
close_system(mainModel)

Copyright 2021-2024 The MathWorks, Inc.