MountainCar v0

Overview

Details

• Name: MountainCar-v0
• Category: Classic Control
• Leaderboard Page
• Old links:
  • Environment Page

Description

Get an under powered car to the top of a hill (top = 0.5 position)

Source

Andrew Moore in his PhD thesis [Moore90].

Environment

Observation

Type: Box(2)

Num	Observation	Min	Max
0	position	-1.2	0.6
1	velocity	-0.07	0.07

Actions

Type: Discrete(3)

Num	Action
0	push left
1	no push
2	push right

Reward

-1 for each time step, until the goal position of 0.5 is reached. As with MountainCarContinuous v0, there is no penalty for climbing the left hill, which upon reached acts as a wall.

Starting State

Random position from -0.6 to -0.4 with no velocity.

Episode Termination

The episode ends when you reach 0.5 position, or if 200 iterations are reached.

Solved Requirements

MountainCar-v0 defines "solving" as getting average reward of -110.0 over 100 consecutive trials.