Default hyperparameters create confusion in "Getting Started with Balance Ball"

[ashwal]

When following the "Getting Started with Balance Ball" tutorial the hyperparameters max_steps and summary_freq in PPO.ipynb are equal. This leads to tensorboard showing only a single point. Which may have confused, uhh, some of us, that something was broken :)

[awjuliani]

Thanks for pointing this out @ashwal! I actually think a better solution is to set the network to train for longer than 10,000 timesteps, since that will be required anyway for all but the most trivial environments.

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.