Gym interface-compatible environments

In this section, we will have a deeper look into environments that are compatible with the Gym interface out of the box. You should be able to use any of the agents we developed in the previous chapters in these environments. Let's get started and look at a few very useful and promising learning environments.

Roboschool

Roboschool (https://github.com/openai/roboschool) provides several environments for controlling robots in simulation. It was released by OpenAI and the environments have the same interface as the OpenAI Gym environments that we have been using in this book. The Gym's MuJoCo-based environments offer a rich variety of robotic tasks, but MuJoCo requires a license for use after the free trial. Roboschool provides eight environments that quite closely match the MuJoCo ones, which is a good news as it offers a free alternative. Apart from these eight environments, Roboschool also offers several new and challenging environments.

The following table...