I want to implement an autoencoder that separated to an encoder in tramsmitter and a decoder in receiver in an OFDM system . The joint loss function of system is sum of two separated loss functions(L1: reduction of BER, L2: reduction of PAPR). The L2 loss function is only related to encoder and L1 is related to both encoder and decoder. I don't know how design a DNN with a black box between two separated part of that by Deep Network designer? Also I don't know how can I reduce the PAPR that is only related to encoder(i.e. the method of backpropagation in this structure)?
You should be able to write custom layers, and import them into Deep Network Designer. However, currently it is not possible to implement the architecture you mentioned with only Deep Network Designer.