- Python3 support!
- Compatibility with the newest version of pycolab.
Please make sure to see the new installation instructions in README.md in order to update to the correct version of pycolab.
- Added a new side effects environment - conveyor_belt.py, described in the accompanying paper: Measuring and avoiding side effects using relative reachability.