Q Learning Agent Error: error occurred when invoking 'outputImpl' method of 'rl.simuli​nk.blocks.​AgentWrapp​er'

Good afternoon everyone,

I am trying to implement a Q-Learning agent into a SimEvents Simulink environment.

I have created a critic network first using: rlQValueRepresentation

Then, I specified the options with rlQAgentOptions and created the agent rlQAgent.

But, when I try to run the simulink file with the agent connected, I get the following error:

• MATLAB System block 'model17/RL Agent/AgentWrapper' error occurred when invoking 'outputImpl' method of 'rl.simulink.blocks.AgentWrapper'. The error was thrown from ' 'C:\Program Files\MATLAB\R2020b\toolbox\rl\rl\+rl\+policy\AbstractPolicy.m' at line 237 'C:\Program Files\MATLAB\R2020b\toolbox\rl\rl\simulink\+rl\+simulink\+blocks\AgentWrapper.m' at line 98'.
• Invalid input argument type or size such as observation, reward, isdone or loggedSignals.
• Invalid observation type or size.
• Unable to evaluate representation.
• Invalid data specified. The data must be an element of the rlFiniteSetSpec.

And I don't know how to solve it since we cannot modify the file AgentWrapper and I am already creating the observations and actions using rlFiniteSetSpec.

Has anyone some idea of how to solve it?

Thank you in advance.

Regards,

Mar.

[mehdi azari]

Hi Maria,

Could you solve this problem?

Regards,

Mehdi