Decisions and On-Demand Decision Making

You may have noticed while playing the soccer (football) game in the previous exercise that the game went into slow motion at times. This is because the agent brains were consuming too much processing power, thus slowing the game's frame rate. This can be a problem, as we have seen from several agents running. The reason for this is that we are currently letting the agent/brains make a decision every five frames, or 1/12 second. While this is great for training, in a real game, we likely want our agents to respond at the same speed as a human would. This can remove the issue of performance since the agents now decide much less frequently. We can tune this using a feature called On-Demand Decision Making and Decision Frequency. Open up Unity to the last Soccer example we used and follow this exercise:

1. Load up the SoccerTwos scene from...