Brandon Rohrer on Nostr: In practice this will introduce a small delay of several hardware steps, resulting in ...

In practice this will introduce a small delay of several hardware steps, resulting in some noise in the agent. I don’t know of any way to avoid this. This is an important feature of real time #ReinforcementLearning that gets lost in simulations. Any real time controller or physical hardware has to deal with this delay.