Transformer Network Layers Creation Problem- missing toolbox?

Hi, I am struggling with creating layers for Deep Transformer Network as my error says there is unrecognized function or variable transformerEncoderLayer.How Can I get a toolbox including this layer or is there any other way to create layers for Deep Transformer Network?

[Sachin]

Hi Karoline

Could you please provide some more information like code etc?

Answer 1

[Debraj Maji]

Hi @Karolina

I see that you are trying to create layers for a Deep Transformer Network and are getting an error that is related to an unrecognized function.

For using pre-built Transformer layers, you need to have Deep Learning Toolbox installed with MATLAB. For instructions on how to install, you can refer to the following answer: https://in.mathworks.com/support/search.html/answers/101885-how-do-i-install-additional-toolboxes-into-an-existing-installation-of-matlab.html?fq%5B%5D=asset_type_name:answer&fq%5B%5D=category:support/introduct1740&page=1

You can get more info on available predefined layers in the following documentation: https://in.mathworks.com/help/deeplearning/ug/list-of-deep-learning-layers.html?searchHighlight=transformerEncoderLayer&s_tid=srchtitle_support_results_1_transformerEncoderLayer

You can also create custom Transformer layers in MATLAB from scratch as well as using predefined templates, as stated in the following documentation: https://in.mathworks.com/help/deeplearning/ug/define-custom-deep-learning-layers.html

Hope that helps!