Hello Kevin,
Thank you for your post.
The Agent generates the password once, which then stored (not the password, but its hash, of course) in a folder with Agent settings on your local disc. The password will change if you wipe the Agent's settings folder and re-run the Agent.
I'm not sure you can randomize the password at each Agent run automatically. So far you can do that manually by clicking the "Generate new password" link in the Agent window. The ability to automatically randomize the password at each run can make a good new feature suggestion though. We'll see what we can do.