How Spark runs in a cluster

Jump to bottom

Awantik Das edited this page Mar 21, 2018 · 5 revisions

Architecture & Components
Life Cycle
Low level execution properties
Requirements for running spark application

Components

Driver
Executor
Cluster Manager

Execution Modes

Cluster Mode
Client Mode
Local Mode

Life Cycle of Spark Application

Client Request
Launch
Execution
Completion