FrozenLake v0

Overview

Details

• Name: FrozenLake-v0
• Category: Classic Control
• Leaderboard Page
• Old links:
  • Environment Page
  • Algorithms Page

Description

The goal of this game is to go from the starting state (S) to the goal state (G) by walking only on frozen tiles (F) and avoid holes (H). However, the ice is slippery, so you won't always move in the direction you intend (stochastic environment)

Source

Came from this Colab and blog Blog

Environment

Observation

Type: Discrete (16)

Num	Observation (State)
0 - 15	For 4x4 square, counting each position from left to right, top to bottom

Actions

Type: Discrete(4)

Num	Action
0	Move Left
1	Move Down
2	Move Right
3	Move Up

Reward

Reward is 0 for every step taken, 0 for falling in the hole, 1 for reaching the final goal

Starting State

Starting state is at the top left corner

Episode Termination

1. Reaching the goal or fall into one of the holes
2. The environment also returns done if it has stepped 100 times.

Solved Requirements

• For the deterministic case (is_slippery=False): Reaching the goal without falling into hole over 100 consecutive trials.
• For the stochastic case (is_slippery=True): Reaching an average reward of 0.9 over 100 episodes.