Modify ActionInfo for Agent

For reinforcement learning, I have defined my own environment class. Importantly, the ActionInfo of the environment is updated after every iteration based on a newly calculated component of the state, similar to the following:

The environment works well enough. For the agent, I am using rlQAgent. However, the agent's ActionInfo is not getting updated after every iteration like the environment's ActionInfo, leading to a mismatch in the action space and thus an error. How would I modify the agent such that its action space gets updated along with the environment's after every iteration? I would like to do almost exactly as the above, except it would be done in the agent instead of the environment. I know that we can create custom agents, but I don't really need the agent to be customized apart from updating the action space after each iteration, and so I would like to avoid having to create a fully custom agent merely to alter one behavior of a predefined agent.